Abstract:Recently, end-to-end deep learning (E2EDL) has been proposed for communication systems to improve the overall performance of systems. In the domain of optical fiber communication systems, the theory of E2EDL and the backpropagation (BP) blocking problem have not been reported in detail. Many works focus on the simple channel with an explicit model (e.g., self-phase modulation-only or dispersion-only fiber channel), while long-haul fiber transmission with both dispersion and nonlinearity has not been discussed because of the BP blocking problem. This paper analyzes why end-to-end deep learning can optimize the transmitter effectively in theory and derives the mean square error (MSE) loss for E2EDL, which is suitable for practice training. We discuss the BP problem mathematically and utilize a gradient estimation method called differentiable surrogate channel (DSC) to address the BP blocking problem. For the first time, the E2EDL is applied to a long-haul fiber channel to optimize the transmitter by using DSC-based gradient estimation. The simulation results demonstrate the mutual information (MI) and the generalized mutual information (GMI) increment with the training process, verifying the effectiveness of the E2EDL in long-haul fiber transmission. In addition, the proposed algorithm is applied to geometric constellations shaping (GCS) for long-haul transmission to explore the performance boundary of GCS. After GCS-based optical fiber E2EDL, the Q factor and the GMI can be improved around 0.25 dB and 0.11 bitssym at 1200 km for 48 GBaud 64-ary dual-polarization signal compared with the square QAM signal, respectively. In addition, the trained 16-ary, 32-ary, and 64-ary GCSs are tested from 800 km to 2800 km, 800 km to 2000 km, and 400 km to 1200 km, respectively. We believe the proposed E2EDL with DSC can achieve a tight lower bound of GCS performance limitation and open the door to transmitter optimization in the practical long-haul fiber transmission.

Performance studies of evolutionary transfer learning for end-to-end QoT estimation in multi-domain optical networks [Invited]

Demonstration of Distributed Collaborative Learning with End-to-end QoT Estimation in Multi-Domain Elastic Optical Networks

Experimental Demonstration of Machine-Learning-aided QoT Estimation in Multi-Domain Elastic Optical Networks with Alien Wavelengths

Evolutionary neuron-level transfer learning for QoT estimation in optical networks

On the Generalization of Machine-Learning-aided QoT Estimation in Optical Networks

Meta-Learning Assisted Source Domain Optimization for Transfer Learning Based Optical Fiber Nonlinear Equalization

Hierarchical Learning for Cognitive End-to-End Service Provisioning in Multi-Domain Autonomous Optical Networks

Exploiting Multi-Task Learning to Achieve Effective Transfer Deep Reinforcement Learning in Elastic Optical Networks.

A Multi-Task-Learning-Based Transfer Deep Reinforcement Learning Design for Autonomic Optical Networks

End-to-End Deep Learning for Long-haul Fiber Transmission Using Differentiable Surrogate Channel

Quantum optical techniques for quality data transmission process in cognitive networks

Transfer learning-assisted modulation classification and OSNR estimation using constellation diagrams

Optical Performance Monitoring Using Lifelong Learning with Confrontational Knowledge Distillation in 7-Core Fiber for Elastic Optical Networks

Artificial Neural Network-Based QoT Estimation for Lightpath Provisioning in Optical Networks

Domain Adversarial Adaptation Framework for Few-Shot QoT Estimation in Fiber-Optic Networks

Machine Learning Approach for Online Monitoring of Quality of Transmission Performance Indicators in Optical Fiber Networks

Transfer Learning Assisted Deep Neural Network for OSNR Estimation.

Joint modulation format recognition and optical performance monitoring for efficient fiber-optic communication links using ensemble deep transfer learning

The First Testbed Demonstration Of Cognitive End-To-End Optical Service Provisioning With Hierarchical Learning Across Multiple Autonomous Systems

End-to-End Learning for 100G-PON Based on Noise Adaptation Network

Bridge the Gap Between Simulated and Real-World Data in Optical Fiber Mode Decomposition for Accuracy Improvement: A Deep Learning-Based Co-Learning Framework with Visual Similarity-Based Matching