Abstract:Machine learning (ML) is widely being regarded as a powerful technology to solve various complex problems in fiberoptic communication networks. Recently, ML algorithms have been considered for a variety of use-cases in optical networks ranging from the design of network devices to the compensation of transmission impairments to predicting network-wide traffic flow patterns. As ML techniques are inherently data driven, the availability of relevant data sets largely dictates the performance of developed ML models. Presently, majority of ML-aided methods in the literature rely either on synthetic data from certain simulation tools or exploit data from some simple laboratory setups. However, developing robust ML-based solutions for real fiber-optic networks demands assembling big data from various parts as well as across different layers and domains of the network. Unfortunately, there is currently a lack of understanding among the research community about various crucial data aspects in practical optical networks as well as key challenges faced. While there has been a plethora of works discussing numerous ML applications in fiber-optic communications and networking, to the best of our knowledge, there is presently no paper which particularly focuses on data perspectives. In this paper, we aim to shed light on various critical data factors by first describing the tools and technologies imperative for adequate network monitoring and data acquisition. We also elucidate different data types, their physical sources, and their applications. Several useful data handling and pre-processing techniques for efficient network data collection, storage, presentation, analysis, etc., are discussed. Major challenges in the generation, transmission, and sharing of the data are highlighted and some potential solutions to the outstanding problems are proposed, thus paving the way for seamless availability of pertinent data sets essential for realizing intelligent data-driven operations in future fiber-optic networks.

Application of machine learning in optical fiber sensors

Machine-Learning-Assisted Optical Fiber Communication System

Recent Advances in Machine Learning for Fiber Optic Sensor Applications

Machine Learning Applications for Short Reach Optical Communication

Machine Learning for Intelligent Optical Networks: A Comprehensive Survey

An Overview on Application of Machine Learning Techniques in Optical Networks

Machine Learning in Short-Reach Optical Systems: A Comprehensive Survey

Data perspectives in AI-assisted fiber-optic communication networks

Machine Learning Approaches in Brillouin Distributed Fiber Optic Sensors

Machine Learning Assisted Fast Demodulation of Large Dynamic Range Dual-Parameter Optical Fiber Sensors

Multimode optical fiber sensors: from conventional to machine learning-assisted

Machine Learning for Fiber Nonlinearity Mitigation in Long-Haul Coherent Optical Transmission Systems : Invited Paper

A rapid demodulation method for the interference spectrum of optical fiber sensors based on machine learning

Artificial Intelligence in Optical Communications: From Machine Learning to Deep Learning

Fiber neural networks for the intelligent optical fiber communications

Machine learning compensation of fiber nonlinear noise

Automating Optical Network Fault Management with Machine Learning

Applying machine learning to optical metrology: a review

A collection of machine learning assisted distributed fiber optic sensors for infrastructure monitoring

Signal Processing in Optical Fiber Sensor Networks

Intelligent Sensing Analysis Using Mel-Time-Frequency-Imaging and Deep Learning for Distributed Fiber-Optic Vibration Detection