Abstract:The rapid growth of online services and the global transition to digital platforms, accelerated by the COVID-19 pandemic and the emergence of AI-based services, have led to a surge in demand for high-capacity optical communication networks (OCNs). However, this transition exacerbates the issue of fiber nonlinearity, notably four-wave mixing (FWM), which can significantly impact signal integrity in long-distance OCN transmissions with multiple channels. To address this challenge, this paper presents a novel approach leveraging a convolutional neural network (CNN)-based digital signal processing (DSP) model to mitigate the nonlinear effects of FWM on signal quality. The proposed CNN model, designed with three convolutional layers and trained on a comprehensive dataset of simulated OCN transmissions, demonstrates significant improvement in reducing nonlinear distortions caused by FWM. Our method is compared with traditional compensation techniques, such as digital back-propagation and Volterra series-based equalizers, showing a reduction in power penalties by 1 dB and an enhancement in the power budget by 2 dB. Simulation results indicate that the bit error rates (BERs) remain consistently below the critical threshold of 10 −9 across various transmission distances, outperforming conventional methods. The simulation analysis, conducted on a 100 km multi-channel OCN testbed, confirms the CNN equalizer's efficacy in reducing crosstalk and improving power efficiency, with a demonstrated 15% reduction in required launch power. Moreover, the analytical models used to evaluate the CNN-based DSP model show high accuracy in predicting performance, underscoring the model's capability to achieve high-quality transmission with lower power requirements. These findings advocate for the integration of our CNN-based DSP model into OCNs, offering a fruitful solution for managing multi-channel, long-distance, and high-data-rate optical transmissions in real-world systems.

Efficient Deep Learning of Nonlinear Fiber-Optic Communications Using a Convolutional Recurrent Neural Network

Analysis and Compensation of Nonlinear Dynamics in Optical Fiber Transmission with the Optoelectronic Reservoir Computing

Deep Learning of the Nonlinear Schrödinger Equation in Fiber-Optic Communications

Convolutional Neural Network-Aided DP-64 QAM Coherent Optical Communication Systems

End-to-End Deep Learning of Optical Fiber Communications

Low Computationally Complex Recurrent Neural Network for High Speed Optical Fiber Transmission

Nonlinear Impairment Compensation Using Transfer Learning-Assisted Convolutional Bidirectional Long Short-Term Memory Neural Network for Coherent Optical Communication Systems

Improving Optical Transmission Performance in Multi-Channel Networks Utilizing Convolutional Neural Network-Enabled Digital Signal Processing to Mitigate Four-Wave Mixing

Ultralow complexity long short-term memory network for fiber nonlinearity mitigation in coherent optical communication systems

Demonstration of photonic neural network for fiber nonlinearity compensation in long-haul transmission systems

Inter-channel nonlinearity compensation in long-haul optical fiber communication using overlapped-dense LSTM network: Complexity reduction and visual understanding

Complex principal component analysis-based complex-valued fully connected NN equalizer for optical fibre communications

Functional-Link Neural Network for Nonlinear Equalizer in Coherent Optical Fiber Communications

Deep Learning Equalizer Connected with Viterbi-Viterbi Algorithm for PAM D-Band Radio over Fiber Link

An Iterative BP-CNN Decoder for Optical Fiber Communication Systems.

Fourier Neural Operator for Accurate Optical Fiber Modeling with Low Complexity

Signal recovery in optical wireless communication using photonic convolutional processor

Deep Neural Network-Based Digital Pre-Distortion for High Baudrate Optical Coherent Transmission

Compensation of Fiber Nonlinearities in Digital Coherent Systems Leveraging Long Short-Term Memory Neural Networks

Revisiting Efficient Multi-Step Nonlinearity Compensation with Machine Learning: An Experimental Demonstration

Experimental Demonstration of Millimeter-Wave Radio-over-Fiber System with Convolutional Neural Network (CNN) and Binary Convolutional Neural Network (BCNN)