Abstract:The rapid growth of online services and the global transition to digital platforms, accelerated by the COVID-19 pandemic and the emergence of AI-based services, have led to a surge in demand for high-capacity optical communication networks (OCNs). However, this transition exacerbates the issue of fiber nonlinearity, notably four-wave mixing (FWM), which can significantly impact signal integrity in long-distance OCN transmissions with multiple channels. To address this challenge, this paper presents a novel approach leveraging a convolutional neural network (CNN)-based digital signal processing (DSP) model to mitigate the nonlinear effects of FWM on signal quality. The proposed CNN model, designed with three convolutional layers and trained on a comprehensive dataset of simulated OCN transmissions, demonstrates significant improvement in reducing nonlinear distortions caused by FWM. Our method is compared with traditional compensation techniques, such as digital back-propagation and Volterra series-based equalizers, showing a reduction in power penalties by 1 dB and an enhancement in the power budget by 2 dB. Simulation results indicate that the bit error rates (BERs) remain consistently below the critical threshold of 10 −9 across various transmission distances, outperforming conventional methods. The simulation analysis, conducted on a 100 km multi-channel OCN testbed, confirms the CNN equalizer's efficacy in reducing crosstalk and improving power efficiency, with a demonstrated 15% reduction in required launch power. Moreover, the analytical models used to evaluate the CNN-based DSP model show high accuracy in predicting performance, underscoring the model's capability to achieve high-quality transmission with lower power requirements. These findings advocate for the integration of our CNN-based DSP model into OCNs, offering a fruitful solution for managing multi-channel, long-distance, and high-data-rate optical transmissions in real-world systems.

An Iterative BP-CNN Decoder for Optical Fiber Communication Systems.

Convolutional Neural Network-Aided DP-64 QAM Coherent Optical Communication Systems

Efficient Deep Learning of Nonlinear Fiber-Optic Communications Using a Convolutional Recurrent Neural Network

Complex principal component analysis-based complex-valued fully connected NN equalizer for optical fibre communications

Improving Optical Transmission Performance in Multi-Channel Networks Utilizing Convolutional Neural Network-Enabled Digital Signal Processing to Mitigate Four-Wave Mixing

A Neural Network-Based Compressive LDPC Decoder Design over Correlated Noise Channel

Deep Neural Network-Based Digital Pre-Distortion for High Baudrate Optical Coherent Transmission

End-to-End Deep Learning of Optical Fiber Communications

Nonlinear Impairment Compensation Using Transfer Learning-Assisted Convolutional Bidirectional Long Short-Term Memory Neural Network for Coherent Optical Communication Systems

Nonlinear Impairment Compensation in Multi-Channel Communication Systems Based on Correlated Digital Backpropagation with Separation of Walk-off Effect

A Novel Visible Light Communication Channel Compensation and Reconstruction Algorithm for Linear Decomposed CPM Signals

Performance and complexity study of a neural network post-equalizer in a 638-nm laser transmission system through over 100-m plastic optical fiber

Convolutional Neural Network-aided Bit-flipping for Belief Propagation Decoding of Polar Codes

Design of fully interpretable neural networks for digital coherent demodulation

A denoiser for correlated noise channel decoding: Gated-neural network

Channel Noise Optimization of Polar Codes Decoding Based on a Convolutional Neural Network

Inter-channel nonlinearity compensation in long-haul optical fiber communication using overlapped-dense LSTM network: Complexity reduction and visual understanding

Low-complexity LDPC decoding algorithms for ultra-high-order modulated signals

Binarized Coherent Optical Receiver Based on Opto-Electronic Neural Network

On the performance of multichannel digital backpropagation in high-capacity long-haul optical transmission

Intra-Channel Nonlinearity Mitigation in Optical Fiber Transmission Systems Using Perturbation-Based Neural Network