Abstract:Machine learning (ML) is widely being regarded as a powerful technology to solve various complex problems in fiberoptic communication networks. Recently, ML algorithms have been considered for a variety of use-cases in optical networks ranging from the design of network devices to the compensation of transmission impairments to predicting network-wide traffic flow patterns. As ML techniques are inherently data driven, the availability of relevant data sets largely dictates the performance of developed ML models. Presently, majority of ML-aided methods in the literature rely either on synthetic data from certain simulation tools or exploit data from some simple laboratory setups. However, developing robust ML-based solutions for real fiber-optic networks demands assembling big data from various parts as well as across different layers and domains of the network. Unfortunately, there is currently a lack of understanding among the research community about various crucial data aspects in practical optical networks as well as key challenges faced. While there has been a plethora of works discussing numerous ML applications in fiber-optic communications and networking, to the best of our knowledge, there is presently no paper which particularly focuses on data perspectives. In this paper, we aim to shed light on various critical data factors by first describing the tools and technologies imperative for adequate network monitoring and data acquisition. We also elucidate different data types, their physical sources, and their applications. Several useful data handling and pre-processing techniques for efficient network data collection, storage, presentation, analysis, etc., are discussed. Major challenges in the generation, transmission, and sharing of the data are highlighted and some potential solutions to the outstanding problems are proposed, thus paving the way for seamless availability of pertinent data sets essential for realizing intelligent data-driven operations in future fiber-optic networks.

Machine-Learning-Assisted Optical Fiber Communication System

Application of machine learning in optical fiber sensors

Machine Learning in Short-Reach Optical Systems: A Comprehensive Survey

Machine Learning for Fiber Nonlinearity Mitigation in Long-Haul Coherent Optical Transmission Systems : Invited Paper

An Overview on Application of Machine Learning Techniques in Optical Networks

Machine Learning Applications for Short Reach Optical Communication

Machine Learning for Intelligent Optical Networks: A Comprehensive Survey

Automating Optical Network Fault Management with Machine Learning

Analysis and Compensation of Nonlinear Dynamics in Optical Fiber Transmission with the Optoelectronic Reservoir Computing

SOON: self-optimizing optical networks with machine learning.

A Review of Machine Learning-based Failure Management in Optical Networks

Data perspectives in AI-assisted fiber-optic communication networks

Recent Advances in Machine Learning for Fiber Optic Sensor Applications

Machine learning compensation of fiber nonlinear noise

Fiber neural networks for the intelligent optical fiber communications

DeepONet-Based Waveform-Level Simulation for a Wideband Nonlinear WDM System

Elevating optical networks: Machine learning approach for optimal resource scheduling and performance boost

Application of optical network transmission based on machine learning and wireless sensor networks in artificial intelligence online education system

Machine Learning assisted aggregation schemes for optical cross-connect in hybrid electrical/optical data center networks

Machine Learning Assisted Optical Network Resource Scheduling in Data Center Networks

Artificial Intelligence in Optical Communications: From Machine Learning to Deep Learning