AI-driven Digital Twin for Optical Networks

Qunbi Zhuge

2022-01-01

Abstract:Building digital twin for self-driving optical networks requires physical layer modeling, impairment monitoring and adaptive learning technologies. This tutorial will review the recent advances on these aspects, focusing on the adoption of AI algorithms and methodologies to enable full-life cycle assessment of network status.

What problem does this paper attempt to address?

Building a digital twin for intelligent optical networks

Qunbi Zhuge,Xiaomin Liu,Yihao Zhang,Meng Cai,Yichen Liu,Qizhi Qiu,Xueying Zhong,Jiaping Wu,Ruoxuan Gao,Lilin Yi,Weisheng Hu

DOI: https://doi.org/10.1364/JOCN.483600

IF: 4.508

2023-01-01

Journal of Optical Communications and Networking

Abstract:To support the development of intelligent optical networks, accurate modeling of the physical layer is crucial. Digital twin (DT) modeling, which relies on continuous learning with real-time data, provides a new paradigm to build a virtual replica of the physical layer with a significant improvement in accuracy and reliability. In addition, DT models will be able to forecast future change by analyzing historical data. In this tutorial, we introduce and discuss three key technologies, including modeling, telemetry, and self-learning, to build a DT for optical networks. The principles and progress of these technologies on major impairments that affect the quality of transmission are presented, and a discussion on the remaining challenges and future research directions is provided.
Building a digital twin for intelligent optical networks [Invited Tutorial].

Qunbi Zhuge,Xiaomin Liu,Yihao Zhang,Meng Cai,Yichen Liu,Qizhi Qiu,Xueying Zhong,Jiaping Wu,Ruoxuan Gao,Lilin Yi,Weisheng Hu

DOI: https://doi.org/10.1364/jocn.483600

2022-01-01

Abstract:To support the development of intelligent optical networks, accurate modeling of the physical layer is crucial. Digital twin (DT) modeling, which relies on continuous learning with real-time data, provides a new paradigm to build a virtual replica of the physical layer with a significant improvement in accuracy and reliability. In addition, DT models will be able to forecast future change by analyzing historical data. In this tutorial, we introduce and discuss three key technologies, including modeling, telemetry, and self-learning, to build a DT for optical networks. The principles and progress of these technologies on major impairments that affect the quality of transmission are presented, and a discussion on the remaining challenges and future research directions is provided.
Digital Twin of Optical Networks: A Review of Recent Advances and Future Trends

Danshi Wang,Yuchen Song,Yao Zhang,Xiaotian Jiang,Jiawei Dong,Faisal Nadeem Khan,Takeo Sasai,Shanguo Huang,Alan Pak Tao Lau,Massimo Tornatore,Min Zhang

DOI: https://doi.org/10.1109/jlt.2024.3401419

IF: 4.7

2024-01-01

Journal of Lightwave Technology

Abstract:Digital twin (DT) has revolutionized optical communication networks by enabling their full life-cycle management, including planning, prediction, optimization, upgrade, and troubleshooting. The rapid development of DT applications for optical networks, from concepts and architecture to simulation and experimental validation, has been exceptional. As a real-time virtual replica of physical optical networks, the DT of optical networks can be divided into three parts: real-time monitoring, mirror modeling, and automatic control. Recent advancements in each part have individually propelled the network towards intelligence and automation. In this paper, we make a comprehensive survey on this timely topic and illustrate the principal evolutions within these three parts. This will be followed by an overview of ongoing DT research in optical communications and networking, as well as an outlook on potential future directions for further investigation.
Building a Digital Twin for Large-Scale and Dynamic C+L-band Optical Networks

Yao Zhang,Min Zhang,Yuchen Song,Yan Shi,Chunyu Zhang,Cheng Ju,Bingli Guo,Shanguo Huang,Danshi Wang

DOI: https://doi.org/10.1364/jocn.503265

IF: 4.508

2023-01-01

Journal of Optical Communications and Networking

Abstract:Bridging the gap between the real and virtual worlds, a digital twin (DT) leverages data, models, and algorithms for comprehensive connectivity. The research on DTs in optical networks has increased in recent years; however, optical networks are evolving toward wideband capabilities, highly dynamic states, and ever-increasing scales, posing huge challenges, including high complexity, extensive computational duration, and limited accuracy for DT modeling. In this study, the DT models are developed based on the Gaussian noise (GN) model and a deep neural network (DNN) to perform efficient and accurate quality of transmission estimations in large-scale C+L-band optical networks, facilitating effective management and control in the digital platform. The DNN-based model obtained the estimated generalized signal-to-noise absolute errors within 0.2 dB in large-scale network simulation, specifically a 77-node network topology. Additionally, compared to the GN-based model, the testing time by using the DNN-based model has been significantly reduced from tens of minutes to 110 ms. Moreover, based on the DT models, multiple potential application scenarios are studied to ensure high-reliability operation and high-efficiency management, including optimization and control of physical layer devices, real-time responses to deterioration alarms and link faults, and network rerouting and resource reallocation. The constructed DT framework integrates practical analysis and deduction functions, with fast operation and accurate calculation to gradually promote the efficient design of optical networks.
Role of Digital Twin in Optical Communication: Fault Management, Hardware Configuration, and Transmission Simulation

Danshi Wang,Zhiguo Zhang,Min Zhang,Meixia Fu,Jin Li,Shanyong Cai,Chunyu Zhang,Xue Chen

DOI: https://doi.org/10.48550/arXiv.2011.04877

2020-11-10

Abstract:Optical communication is developing rapidly in the directions of hardware resource diversification, transmission system flexibility, and network function virtualization. Its proliferation poses a significant challenge to traditional optical communication management and control systems. Digital twin (DT), a technology that utilizes data, models, and algorithms and integrates multiple disciplines, acts as a bridge between the real and virtual worlds for comprehensive connectivity. In the digital space, virtual models are stablished dynamically to simulate and describe the states, behaviors, and rules of physical objects in the physical space. DT has been significantly developed and widely applied in industrial and military fields. This study introduces the DT technology to optical communication through interdisciplinary crossing and proposes a DT framework suitable for optical communication. The intelligent fault management model, flexible hardware configuration model, and dynamic transmission simulation model are established in the digital space with the help of deep learning algorithms to ensure the highreliability operation and high-efficiency management of optical communication systems and networks.

Networking and Internet Architecture
The Role of Digital Twin in Optical Communication: Fault Management, Hardware Configuration, and Transmission Simulation

Danshi Wang,Zhiguo Zhang,Min Zhang,Meixia Fu,Jin Li,Shanyong Cai,Chunyu Zhang,Xue Chen

DOI: https://doi.org/10.1109/mcom.001.2000727

IF: 9.03

2021-01-01

IEEE Communications Magazine

Abstract:Optical communication is developing rapidly in the directions of hardware resource diversification, transmission system flexibility, and network function virtualization. Its proliferation poses a significant challenge to traditional optical communication management and control systems. Digital twin (DT), a technology that utilizes data, models, and algorithms and integrates multiple disciplines, acts as a bridge between the real and virtual worlds for comprehensive connectivity. In the digital space, virtual models are established dynamically to simulate and describe the states, behaviors, and rules of physical objects in the physical space. DT has been significantly developed and widely applied in the industrial and military fields. This study introduces the DT technology to optical communication through interdisciplinary crossing and proposes a DT framework suitable for optical communication. The intelligent fault management model, flexible hardware configuration model, and dynamic transmission simulation model are established in the digital space with the help of deep learning algorithms to ensure the high-reliability operation and high-ef-ficiency management of optical communication systems and networks.
Implementing Digital Twin in Field-Deployed Optical Networks: Uncertain Factors, Operational Guidance, and Field-Trial Demonstration

Yuchen Song,Min Zhang,Yao Zhang,Yan Shi,Shikui Shen,Bingli Guo,Shanguo Huang,Danshi Wang

DOI: https://doi.org/10.1109/MNET.2023.3332893

2023-12-06

Abstract:Digital twin has revolutionized optical communication networks by enabling their full life-cycle management, including design, troubleshooting, optimization, upgrade, and prediction. While extensive literature exists on frameworks, standards, and applications of digital twin, there is a pressing need in implementing digital twin in field-deployed optical networks operating in real-world environments, as opposed to controlled laboratory settings. This paper addresses this challenge by examining the uncertain factors behind the inaccuracy of digital twin in field-deployed optical networks from three main challenges and proposing operational guidance for implementing accurate digital twin in field-deployed optical networks. Through the proposed guidance, we demonstrate the effective implementation of digital twin in a field-trial C+L-band optical transmission link, showcasing its capabilities in performance recovery in a fiber cut scenario.

Networking and Internet Architecture,Signal Processing
Network Digital Twin: Context, Enabling Technologies and Opportunities

Paul Almasan,Miquel Ferriol-Galmés,Jordi Paillisse,José Suárez-Varela,Diego Perino,Diego López,Antonio Agustin Pastor Perales,Paul Harvey,Laurent Ciavaglia,Leon Wong,Vishnu Ram,Shihan Xiao,Xiang Shi,Xiangle Cheng,Albert Cabellos-Aparicio,Pere Barlet-Ros

DOI: https://doi.org/10.1109/MCOM.001.2200012

2022-08-02

Abstract:The proliferation of emergent network applications (e.g., telesurgery, metaverse) is increasing the difficulty of managing modern communication networks. These applications entail stringent network requirements (e.g., ultra-low deterministic latency), which hinders network operators to manage their resources efficiently. In this article, we introduce the network digital twin (NDT), a renovated concept of classical network modeling tools whose goal is to build accurate data-driven network models that can operate in real-time. We describe the general architecture of the NDT and argue that modern machine learning (ML) technologies enable building some of its core components. Then, we present a case study that leverages a ML-based NDT for network performance evaluation and apply it to routing optimization in a QoS-aware use case. Lastly, we describe some key open challenges and research opportunities yet to be explored to achieve effective deployment of NDTs in real-world networks.

Networking and Internet Architecture
Fusion of Physics and AI for Building Self-driving Optical Networks

Xiaomin Liu,Yihao Zhang,Meng Cai,Lilin Yi,Weisheng Hu,Qunbi Zhuge

DOI: https://doi.org/10.1364/networks.2022.new2d.1

2022-01-01

Abstract:For building a self-driving optical network, advanced techniques for network modeling and monitoring are essential. We discuss possible approaches for fusing the artificial intelligence and physics to further improve the accuracy and reliability.
The Digital Twin Framework for the Physical Wideband and Long‐Haul Optical Fiber Communication Systems

Hang Yang,Zekun Niu,Qirui Fan,Lyu Li,Minghui Shi,Chuyan Zeng,Shilin Xiao,Weisheng Hu,Lilin Yi

DOI: https://doi.org/10.1002/lpor.202400234

2024-01-01

LASER & PHOTONICS REVIEWS

Abstract:Digital twin (DT) modeling is essential to optical fiber communication systems, particularly for enhancing system performance, controlling the system in real time, and understanding signal nonlinearity. Conventional split‐step Fourier method ‐based simulations, however, struggle with wide‐band transmissions, plagued by increasing complexity and inherent biases due to inconsistent link parameter availability. Addressing these challenges, a hybrid data‐driven and model‐driven DT approach for the wide‐band and long‐haul physical systems with various system effects is developed. The approach utilizes a neural network (NN) to capture fiber nonlinear features as well as biased perturbations as “lumped” stochastic noises while offloading the linear effects to modules described by physical models of link elements. The model, tested in a 30.5‐Tbps 1200 km fiber transmission link with 40 channels, achieves a mean Q factor error of less than 0.1 dB and a maximum runtime of 1.3 s for NN processing under various launch powers, transmission lengths, and optical signal‐to‐noise ratios. Furthermore, the study has implemented a nonlinear compensation algorithm on the DT model, yielding a consistent enhancement in experimental data. The accuracy and adaptability of the DT model underline its suitability for planning, design, and optimization within the physical optical fiber communication systems.
AI-based traffic analysis in digital twin networks

Sarah Al-Shareeda,Khayal Huseynov,Lal Verda Cakir,Craig Thomson,Mehmet Ozdem,Berk Canberk

2024-11-01

Abstract:In today's networked world, Digital Twin Networks (DTNs) are revolutionizing how we understand and optimize physical networks. These networks, also known as 'Digital Twin Networks (DTNs)' or 'Networks Digital Twins (NDTs),' encompass many physical networks, from cellular and wireless to optical and satellite. They leverage computational power and AI capabilities to provide virtual representations, leading to highly refined recommendations for real-world network challenges. Within DTNs, tasks include network performance enhancement, latency optimization, energy efficiency, and more. To achieve these goals, DTNs utilize AI tools such as Machine Learning (ML), Deep Learning (DL), Reinforcement Learning (RL), Federated Learning (FL), and graph-based approaches. However, data quality, scalability, interpretability, and security challenges necessitate strategies prioritizing transparency, fairness, privacy, and accountability. This chapter delves into the world of AI-driven traffic analysis within DTNs. It explores DTNs' development efforts, tasks, AI models, and challenges while offering insights into how AI can enhance these dynamic networks. Through this journey, readers will gain a deeper understanding of the pivotal role AI plays in the ever-evolving landscape of networked systems.

Networking and Internet Architecture,Artificial Intelligence,Emerging Technologies
How AI-driven Digital Twins Can Empower Mobile Networks

Tong Li,Fenyu Jiang,Qiaohong Yu,Wenzhen Huang,Tao Jiang,Depeng Jin

2023-11-21

Abstract:The growing complexity of next-generation networks exacerbates the modeling and algorithmic flaws of conventional network optimization methodology. In this paper, we propose a mobile network digital twin (MNDT) architecture for 6G networks. To address the modeling and algorithmic shortcomings, the MNDT uses a simulation-optimization structure. The feedback from the network simulation engine, which serves as validation for the optimizer's decision outcomes, is used explicitly to train artificial intelligence (AI) empowered optimizers iteratively. In practice, we develop a network digital twin prototype system leveraging data-driven technology to accurately model the behaviors of mobile network elements (e.g., mobile users and base stations), wireless environments, and network performance. An AI-powered network optimizer has been developed based on the deployed MNDT prototype system for providing reliable and optimized network configurations. The results of the experiments demonstrate that the proposed MNDT infrastructure can provide practical network optimization solutions while adapting to the more complex environment.

Networking and Internet Architecture,Systems and Control
Accuracy Enhancement of an Optical Network Digital Twin Based on Open-Source Field Data

Ambashri Purkayastha,Cédric Ware,Mounia Lourdiane,Patricia Layec,Camille Delezoide

2024-10-03

Abstract:We propose a two-stage hybrid QoT model for twinning a real transport network and evaluate it on recently published field data. Accounting for partial calibration of key parameters, we improve the SNR prediction accuracy by more than a factor of two.

Optics,Signal Processing
The Impact of Data Acquisition Inconsistency and Time Sensitivity on Digital Twin for AI-Driven Optical Networks

Kangqi Zhu,Nan Hua,Yanhe Li,Xiaoping Zheng,Bingkun Zhou

DOI: https://doi.org/10.1109/ogc52961.2021.9654301

2021-01-01

Abstract:We focus on the causes and impact of noise and distortion in the digital twin for AI-driven optical networks, which is the cornerstone of convergence of resources for perception, transmission, storage and computing. Some possible solutions are put forward to reduce or eliminate the influence of the above two factors as well.
Digital Twin Modeling and Controlling of Optical Power Evolution Enabling Autonomous-Driving Optical Networks: a Bayesian Approach

Xiaomin Liu,Yihao Zhang,Yuli Chen,Yichen Liu,Meng Cai,Qizhi Qiu,Mengfan Fu,Lilin Yi,Weisheng Hu,Qunbi Zhuge

DOI: https://doi.org/10.1117/1.ap.6.2.026006

IF: 13.582

2024-01-01

Advanced Photonics

Abstract:Optical networks are evolving toward ultrawide bandwidth and autonomous operation. In this scenario, it is crucial to accurately model and control optical power evolutions (OPEs) through optical amplifiers (OAs), as they directly affect the signal-to-noise ratio and fiber nonlinearities. However, a fundamental contradiction arises between the complex physical phenomena in optical transmission and the required precision in network control. Traditional theoretical methods underperform due to ideal assumptions, while data-driven approaches entail exorbitant costs associated with acquiring massive amounts of data to achieve the desired level of accuracy. In this work, we propose a Bayesian inference framework (BIF) to construct the digital twin of OAs and control OPE in a data-efficient manner. Only the informative data are collected to balance the exploration and exploitation of the data space, thus enabling efficient autonomous-driving optical networks (ADONs). Simulations and experiments demonstrate that the BIF can reduce the data size for modeling erbium-doped fiber amplifiers by 80% and Raman amplifiers by 60%. Within 30 iterations, the optimal controlling performance can be achieved to realize target signal/gain profiles in links with different types of OAs. The results show that the BIF paves the way to accurately model and control OPE for future ADONs.
AI-Based Modeling and Monitoring Techniques for Future Intelligent Elastic Optical Networks

Xiaomin Liu,Huazhi Lun,Mengfan Fu,Yunyun Fan,Lilin Yi,Weisheng Hu,Qunbi Zhuge

DOI: https://doi.org/10.3390/app10010363

2020-01-03

Applied Sciences

Abstract:With the development of 5G technology, high definition video and internet of things, the capacity demand for optical networks has been increasing dramatically. To fulfill the capacity demand, low-margin optical network is attracting attentions. Therefore, planning tools with higher accuracy are needed and accurate models for quality of transmission (QoT) and impairments are the key elements to achieve this. Moreover, since the margin is low, maintaining the reliability of the optical network is also essential and optical performance monitoring (OPM) is desired. With OPM, controllers can adapt the configuration of the physical layer and detect anomalies. However, considering the heterogeneity of the modern optical network, it is difficult to build such accurate modeling and monitoring tools using traditional analytical methods. Fortunately, data-driven artificial intelligence (AI) provides a promising path. In this paper, we firstly discuss the requirements for adopting AI approaches in optical networks. Then, we review various recent progress of AI-based QoT/impairments modeling and monitoring schemes. We categorize these proposed methods by their functions and summarize advantages and challenges of adopting AI methods for these tasks. We discuss the problems remained for deploying AI-based methods to a practical system and present some possible directions for future investigation.
Digital Twin Assisted Intelligent Network Management for Vehicular Applications

Kaige Qu,Weihua Zhuang

2024-03-24

Abstract:The emerging data-driven methods based on artificial intelligence (AI) have paved the way for intelligent, flexible, and adaptive network management in vehicular applications. To enhance network management towards network automation, this article presents a digital twin (DT) assisted two-tier learning framework, which facilitates the automated life-cycle management of machine learning based intelligent network management functions (INMFs). Specifically, at a high tier, meta learning is employed to capture different levels of general features for the INMFs under nonstationary network conditions. At a low tier, individual learning models are customized for local networks based on fast model adaptation. Hierarchical DTs are deployed at the edge and cloud servers to assist the two-tier learning process, through closed-loop interactions with the physical network domain. Finally, a case study demonstrates the fast and accurate model adaptation ability of meta learning in comparison with benchmark schemes.

Networking and Internet Architecture
Digital Twin Network: Opportunities and Challenges

Paul Almasan,Miquel Ferriol-Galmés,Jordi Paillisse,José Suárez-Varela,Diego Perino,Diego López,Antonio Agustin Pastor Perales,Paul Harvey,Laurent Ciavaglia,Leon Wong,Vishnu Ram,Shihan Xiao,Xiang Shi,Xiangle Cheng,Albert Cabellos-Aparicio,Pere Barlet-Ros

DOI: https://doi.org/10.48550/arXiv.2201.01144

2022-01-04

Networking and Internet Architecture

Abstract:The proliferation of emergent network applications (e.g., AR/VR, telesurgery, real-time communications) is increasing the difficulty of managing modern communication networks. These applications typically have stringent requirements (e.g., ultra-low deterministic latency), making it more difficult for network operators to manage their network resources efficiently. In this article, we propose the Digital Twin Network (DTN) as a key enabler for efficient network management in modern networks. We describe the general architecture of the DTN and argue that recent trends in Machine Learning (ML) enable building a DTN that efficiently and accurately mimics real-world networks. In addition, we explore the main ML technologies that enable developing the components of the DTN architecture. Finally, we describe the open challenges that the research community has to address in the upcoming years in order to enable the deployment of the DTN in real-world scenarios.
Synergistic Interplay of Large Language Model and Digital Twin for Autonomous Optical Networks: Field Demonstrations

Yuchen Song,Yao Zhang,Anni Zhou,Yan Shi,Shikui Shen,Xiongyan Tang,Jin Li,Min Zhang,Danshi Wang

2024-11-01

Abstract:The development of large language models (LLM) has revolutionized various fields and is anticipated to drive the advancement of autonomous systems. In the context of autonomous optical networks, creating a high-level cognitive agent in the control layer remains a challenge. However, LLM is primarily developed for natural language processing tasks, rendering them less effective in predicting the physical dynamics of optical communications. Moreover, optical networks demand rigorous stability, where direct deployment of strategies generated from LLM poses safety concerns. In this paper, a digital twin (DT)-enhanced LLM scheme is proposed to facilitate autonomous optical networks. By leveraging monitoring data and advanced models, the DT of optical networks can accurately characterize their physical dynamics, furnishing LLMs with dynamic-updated information for reliable decision-making. Prior to deployment, the generated strategies from LLM can be pre-verified in the DT platform, which also provides feedback to the LLM for further refinement of strategies. The synergistic interplay between DT and LLM for autonomous optical networks is demonstrated through three scenarios: performance optimization under dynamic loadings in an experimental C+L-band long-haul transmission link, protection switching for device upgrading in a field-deployed six-node mesh network, and performance recovery after fiber cuts in a field-deployed C+L-band transmission link.

Networking and Internet Architecture,Optics
Blockchain for the digital twin-driven autonomous optical network

Yue Pang,Min Zhang,Lifang Zhang,Jin Li,Wenbin Chen,Yidi Wang,Danshi Wang

DOI: https://doi.org/10.1364/jocn.502483

IF: 4.508

2024-02-16

Journal of Optical Communications and Networking

Abstract:Yue Pang, Min Zhang, Lifang Zhang, Jin Li, Wenbin Chen, Yidi Wang, Danshi Wang In recent years, optical networks have become increasingly large-scale and complex, resulting in mounting pressures on operation and ... [J. Opt. Commun. Netw. 16, 278-293 (2024)]

computer science, information systems,telecommunications, hardware & architecture,optics

AI-driven Digital Twin for Optical Networks

Building a digital twin for intelligent optical networks

Building a digital twin for intelligent optical networks [Invited Tutorial].

Digital Twin of Optical Networks: A Review of Recent Advances and Future Trends

Building a Digital Twin for Large-Scale and Dynamic C+L-band Optical Networks

Role of Digital Twin in Optical Communication: Fault Management, Hardware Configuration, and Transmission Simulation

The Role of Digital Twin in Optical Communication: Fault Management, Hardware Configuration, and Transmission Simulation

Implementing Digital Twin in Field-Deployed Optical Networks: Uncertain Factors, Operational Guidance, and Field-Trial Demonstration

Network Digital Twin: Context, Enabling Technologies and Opportunities

Fusion of Physics and AI for Building Self-driving Optical Networks

The Digital Twin Framework for the Physical Wideband and Long‐Haul Optical Fiber Communication Systems

AI-based traffic analysis in digital twin networks

How AI-driven Digital Twins Can Empower Mobile Networks

Accuracy Enhancement of an Optical Network Digital Twin Based on Open-Source Field Data

The Impact of Data Acquisition Inconsistency and Time Sensitivity on Digital Twin for AI-Driven Optical Networks

Digital Twin Modeling and Controlling of Optical Power Evolution Enabling Autonomous-Driving Optical Networks: a Bayesian Approach

AI-Based Modeling and Monitoring Techniques for Future Intelligent Elastic Optical Networks

Digital Twin Assisted Intelligent Network Management for Vehicular Applications

Digital Twin Network: Opportunities and Challenges

Synergistic Interplay of Large Language Model and Digital Twin for Autonomous Optical Networks: Field Demonstrations

Blockchain for the digital twin-driven autonomous optical network