Open Access Open Access  Restricted Access Subscription or Fee Access

Routing in Elastic Optical Networks Based on Deep Reinforcement Learning


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/iremos.v15i1.21569

Abstract


Modern optical network schemes consist of eighty channels involving fixed grids and offering speeds of up to 400 Gbps per channel rendering the allocated bandwidths insufficient during certain timeframes and underutilized during others. These speeds will become inefficient when compared to the accelerated growth of traditional traffic, which threatens to be tripled by 2025. In order to exploit the capacity of elastic optical networks, efficient algorithms are essential. This article assesses Deep reinforcement learning RMCSA algorithms, focused on providing high availability to the allocation of routing, spectrum and modulation resources over a given network topology, in order to determine how to allocate physical resources in optical transport networks and increase capacity while accounting for traffic variability and demands. Reinforcement learning is currently used in many scientific fields for the solution of different problems. In optical networks, this work will use this method to determine the best path and resources for each type of traffic-related demand. Simulations are performed by increasing volumes of variable traffic over a fourteen-node topology. The results show a significant 40% improvement in blocking probability for 22 links with 100 frequency slots compared to current transmission systems. They also reflect low latency, higher speeds, and high availability, which can deliver better quality of service for the end user.
Copyright © 2022 Praise Worthy Prize - All rights reserved.

Keywords


Elastic Optical Network; Reinforcement Learning; Deep Reinforcement Learning

Full Text:

PDF


References


Cisco, Cisco Visual Networking Index: Forecast and Trends, 2017-2022 White Paper, 2019, [Online]. Available: https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11-741490.html

V. L. Kalyani and Pinky, The Study of Self Driven Cars With Special Reference to Google Drive And Maruti Celerio In High Speed Internet Connectivity, Journal of Management Engineering and Information Technology (JMEIT): 4 pp. 12-18 (6), Dec. 2017.
https://doi.org/10.5281/ZENODO.1134249

V. V. Anusuya and V. Gomathi, Framework for advanced weather forecasting technique using DMaaS in Cloud, in Proceedings of the 2018 International Conference on Current Trends towards Converging Technologies, ICCTCT 2018, Nov. 2018.
https://doi.org/10.1109/ICCTCT.2018.8550961

V. Perasso and B. Mundo, "News Latin America International Economy Technology Science What is the fourth industrial revolution (and why should we care)," 2016. Accessed: May 07, 2020. [Online]. Available: http://www.bbc.com/mundo/noticias-37631834?ocid=socialflow_facebook

T. Koyama, J. Kawamoto, M. Kawaragi, T. Kurakake, and K. Saito, Implementing 8K Vision Mixer for Cloud-Based Production System, SMPTE Motion Imaging J., vol. 128, no. 6, pp. 30-37, Jul. 2019.
https://doi.org/10.5594/JMI.2019.2910705

C. Chung and J. P. Jeong, A Design of IoT Device Configuration Translator for Intent-Based IoT-Cloud Services, in 2020 22nd International Conference on Advanced Communication Technology (ICACT), Feb. 2020, pp. 52-56.
https://doi.org/10.23919/ICACT48636.2020.9061282

Mahesa, R., Yudoko, G., Anggoro, Y., Intelligent Traffic Monitoring System as Part of Realizing Smart City-A Case Study: Traffic Engineering in Northern Jakarta's Mixed-Use Area, (2020) International Review of Civil Engineering (IRECE), 11 (4), pp. 188-197.
https://doi.org/10.15866/irece.v11i4.18087

A. A. Al-Mekhlafi, O. M. Al-Kamali, R. Q. Shaddad and M. A. Abduljalil, Dense 5G Network Planning for Coastal Area at Aden City, Yemen, 2019 First International Conference of Intelligent Computing and Engineering (ICOICE), 2019, pp. 1-7.
https://doi.org/10.1109/ICOICE48418.2019.9035140

Y. Zhou et al., Service-aware 6G: An intelligent and open network based on the convergence of communication, computing and caching, Digit. Commun. Networks, vol. 6, no. 3, pp. 253-260, Aug. 2020.
https://doi.org/10.1016/j.dcan.2020.05.003

N. Mahala, Ujjwal, and J. Thangaraj, Weight distributed spectrum allocation in flexible-grid optical networks, Optik (Stuttg)., vol. 228, Feb. 2021.
https://doi.org/10.1016/j.ijleo.2020.166171

O. Király et al., Preventing problematic internet use during the COVID-19 pandemic: Consensus guidance, Compr. Psychiatry, vol. 100, p. 152180, Jul. 2020.
https://doi.org/10.1016/j.comppsych.2020.152180

Z. R. Alashhab, M. Anbar, M. M. Singh, Y.-B. Leau, Z. A. Al-Sai, and S. A. Alhayja'a, Impact of Coronavirus Pandemic Crisis on Technologies and Cloud Computing Applications, J. Electron. Sci. Technol., vol. 19, no. 1, pp. 25-40, Nov. 2020.
https://doi.org/10.1016/j.jnlest.2020.100059

R. of an E. E. Roundtable, Economic Impact Of Covid-19 On Digital Infrastructure, ITU, 2020.

L. Velasco, A. P. Vela, F. Morales, and M. Ruiz, Designing, operating, and reoptimizing elastic optical networks, J. Light. Technol., vol. 35, no. 3, pp. 513-526, Feb. 2017.
https://doi.org/10.1109/JLT.2016.2593986

C. S. R. Murthy and M. Gurusamy, WDM optical networks : concepts, design, and algorithms. Prentice Hall PTR, 2002.

D. F. A. Moreno, O. J. S. Parra, and D. A. L. Sarmiento, Heuristic algorithm for flexible optical networks OTN, in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2018, vol. 10699 LNCS, pp. 163-172.
https://doi.org/10.1007/978-3-319-73830-7_17

M. Moharrami, A. Fallahpour, H. Beyranvand, and J. A. Salehi, Resource Allocation and Multicast Routing in Elastic Optical Networks, in IEEE Transactions on Communications, May 2017, vol. 65, no. 5, pp. 2101-2113.
https://doi.org/10.1109/TCOMM.2017.2667664

T. J. O'Shea and J. Hoydis, An Introduction to Machine Learning Communications Systems. 2017.

Y. Li and D. C. Kilper, Optical Physical Layer SDN [Invited], J. Opt. Commun. Netw., vol. 10, no. 1, p. A110, Jan. 2018.
https://doi.org/10.1364/JOCN.10.00A110

A. Mestres et al., Knowledge-defined networking, Comput. Commun. Rev., vol. 47, no. 3, pp. 1-10, Jul. 2017.
https://doi.org/10.1145/3138808.3138810

J. Hyun and J. W. K. Hong, Knowledge-defined networking using in-band network telemetry, in 19th Asia-Pacific Network Operations and Management Symposium: Managing a World of Things, APNOMS 2017, Nov. 2017, pp. 54-57.
https://doi.org/10.1109/APNOMS.2017.8094178

E. E. Moghaddam, H. Beyranvand, and J. A. Salehi, Routing, Spectrum and Modulation Level Assignment, and Scheduling in Survivable Elastic Optical Networks Supporting Multi-Class Traffic, J. Light. Technol. Vol. 36, Issue 23, pp. 5451-5461, vol. 36, no. 23, pp. 5451-5461, Dec. 2018.
https://doi.org/10.1109/JLT.2018.2874820

X. Huang and M. Ma, A heuristic adaptive QoS prediction scheme in single-hop passive star coupled WDM optical networks, J. Netw. Comput. Appl., vol. 34, no. 2, pp. 581-588, 2011.
https://doi.org/10.1016/j.jnca.2010.12.005

L. R. R. D. Santos and T. Abrão, "Heuristic Chaotic Hurricane-Aided Efficient Power Assignment for Elastic Optical Network," in IEEE Access, vol. 8, pp. 83359-83374, 2020.
https://doi.org/10.1109/ACCESS.2020.2991417

M. S. Moreolo, J. M. Fàbrega, and L. Nadal, Sliceable BVT evolution towards programmable multi-Tb/s networking, Electron., vol. 8, no. 12, Dec. 2019.
https://doi.org/10.3390/electronics8121476

M. Klinkowski and K. Walkowiak, An efficient optimization framework for solving RssA problems in spectrally and spatially flexible optical networks, IEEE/ACM Trans. Netw., vol. 27, no. 4, pp. 1474-1486, Aug. 2019.
https://doi.org/10.1109/TNET.2019.2922761

R. Zhu, S. Li, P. Wang, and J. Yuan, Time and spectrum fragmentation-aware virtual optical network embedding in elastic optical networks, Opt. Fiber Technol., vol. 54, Jan. 2020.
https://doi.org/10.1016/j.yofte.2019.102117

M. Tanha, D. Sajjadi, R. Ruby, and J. Pan, Traffic Engineering Enhancement by Progressive Migration to SDN, IEEE Commun. Lett., vol. 22, no. 3, pp. 438-441, Mar. 2018.
https://doi.org/10.1109/LCOMM.2018.2789419

E. De A Barboza, C. J. A. Bastos-Filho, J. F. Martins-Filho, U. C. de Moura, and J. R. F. de Oliveira, Self-adaptive erbium-doped fiber amplifiers using machine learning, in 2013 SBMO/IEEE MTT-S International Microwave & Optoelectronics Conference (IMOC), Aug. 2013, pp. 1-5.
https://doi.org/10.1109/IMOC.2013.6646588

S. Yan, R. Nejabati, and D. Simeonidou, Data-driven network analytics and network optimisation in SDN-based programmable optical networks, in 22nd Conference on Optical Network Design and Modelling, ONDM 2018 - Proceedings, Jun. 2018, pp. 234-238.
https://doi.org/10.23919/ONDM.2018.8396137

T. Panayiotou, K. Manousakis, S. P. Chatzis, and G. Ellinas, On learning bandwidth allocation models for time-varying traffic in flexible optical networks, in 22nd Conference on Optical Network Design and Modelling, ONDM 2018 - Proceedings, Jun. 2018, pp. 194-199.
https://doi.org/10.23919/ONDM.2018.8396130

R. Alvizu, S. Troia, G. Maier, and A. Pattavina, Matheuristic with machine-learning-based prediction for software-defined mobile metro-core networks, J. Opt. Commun. Netw., vol. 9, no. 9, pp. D19-D30, Sep. 2017.
https://doi.org/10.1364/JOCN.9.000D19

X. Chen et al., Leveraging Deep Learning to Achieve Knowledge-based Autonomous Service Provisioning in Broker-based Multi-Domain SD-EONs with Proactive and Intelligent Predictions of Multi-Domain Traffic, in European Conference on Optical Communication, ECOC, Sep. 2017, vol. 2017, pp. 1-3.
https://doi.org/10.1109/ECOC.2017.8346218

Xiaoxia Wu, J. A. Jargon, R. A. Skoog, L. Paraschis, and A. E. Willner, Applications of Artificial Neural Networks in Optical Performance Monitoring, J. Light. Technol., vol. 27, no. 16, pp. 3580-3589, Aug. 2009.
https://doi.org/10.1109/JLT.2009.2024435

T. Jiménez et al., A cognitive system for fast Quality of Transmission estimation in core optical networks, IEEE Netw., 2012.
https://doi.org/10.1364/OFC.2012.OW3A.5

L. Barletta, A. Giusti, C. Rottondi, and M. Tornatore, QoT Estimation for Unestablished Lighpaths using Machine Learning, in Optical Fiber Communication Conference, Mar. 2017, p. Th1J.1.
https://doi.org/10.1364/OFC.2017.Th1J.1

D. R. B. de Araújo, C. J. A. Bastos-Filho, and J. F. Martins-Filho, Methodology to Obtain a Fast and Accurate Estimator for Blocking Probability of Optical Networks, J. Opt. Commun. Netw., vol. 7, no. 5, p. 380, May 2015.
https://doi.org/10.1364/JOCN.7.000380

D. Hernandez, P. Morales, A. Lozada, R. Olivares, and N. Jara, On sorting transmission demands in Elastic Optical Networks with Spatial-Division Multiplexing, Proc. - Int. Conf. Chil. Comput. Sci. Soc. SCCC, vol. 2020-November, Nov. 2020.
https://doi.org/10.1109/SCCC51225.2020.9281183

F. Morales, M. Ruiz, L. Gifre, L. M. Contreras, V. López, and L. Velasco, Virtual Network Topology Adaptability Based on Data Analytics for Traffic Prediction, J. Opt. Commun. Netw., vol. 9, no. 1, p. A35, Jan. 2017.
https://doi.org/10.1364/JOCN.9.000A35

D. Garrido, A. Leiva, A. Beghelli, R. Ahumada, and R. Olivares, Routing, code, modulation level and spectrum assignment (RCMLSA) algorithm for elastic optical networks, Int. Conf. Transparent Opt. Networks, vol. 2016-August, Aug. 2016.
https://doi.org/10.1109/ICTON.2016.7550388

Danilo R. B. Araújo, "NsfNet -Topology with 14 nodes and 21 links. | Download Scientific Diagram." (accessed Mar. 12, 2019). https://www.researchgate.net/figure/Figura-2-NsfNet-Topologia-com-14-nos-e-21-enlaces_fig2_307578174


Refbacks

  • There are currently no refbacks.



Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize