Abstract:The rapid growth of online services and the global transition to digital platforms, accelerated by the COVID-19 pandemic and the emergence of AI-based services, have led to a surge in demand for high-capacity optical communication networks (OCNs). However, this transition exacerbates the issue of fiber nonlinearity, notably four-wave mixing (FWM), which can significantly impact signal integrity in long-distance OCN transmissions with multiple channels. To address this challenge, this paper presents a novel approach leveraging a convolutional neural network (CNN)-based digital signal processing (DSP) model to mitigate the nonlinear effects of FWM on signal quality. The proposed CNN model, designed with three convolutional layers and trained on a comprehensive dataset of simulated OCN transmissions, demonstrates significant improvement in reducing nonlinear distortions caused by FWM. Our method is compared with traditional compensation techniques, such as digital back-propagation and Volterra series-based equalizers, showing a reduction in power penalties by 1 dB and an enhancement in the power budget by 2 dB. Simulation results indicate that the bit error rates (BERs) remain consistently below the critical threshold of 10 −9 across various transmission distances, outperforming conventional methods. The simulation analysis, conducted on a 100 km multi-channel OCN testbed, confirms the CNN equalizer's efficacy in reducing crosstalk and improving power efficiency, with a demonstrated 15% reduction in required launch power. Moreover, the analytical models used to evaluate the CNN-based DSP model show high accuracy in predicting performance, underscoring the model's capability to achieve high-quality transmission with lower power requirements. These findings advocate for the integration of our CNN-based DSP model into OCNs, offering a fruitful solution for managing multi-channel, long-distance, and high-data-rate optical transmissions in real-world systems.

Frequency-Domain Optimization of Signal Waveform Shaper in High-Speed Optical Communication Systems Considering ADC Quantization Noise

Nonlinearity-Aware Discrete Multi-Tone Terahertz Wireless Communications Accelerated by Photonics

Quantization of Neural Network Equalizers in Optical Fiber Transmission Experiments

Demonstration of photonic neural network for fiber nonlinearity compensation in long-haul transmission systems

High-Speed Long-Haul Multi-Channel Nonlinear Optical Communication Systems Influenced by Equalization Enhanced Phase Noise

OAM mode-division multiplexing IM/DD transmission at 4.32 Tbit/s with a low-complexity adaptive-network-based fuzzy inference system nonlinear equalizer

Dispersion Compensation Optimization Based on Neural Network

Complex principal component analysis-based complex-valued fully connected NN equalizer for optical fibre communications

Multi-Wavelength Photonic Neuromorphic Computing for Intra and Inter-Channel Distortion Compensations in WDM Optical Communication Systems

Advancing theoretical understanding and practical performance of signal processing for nonlinear optical communications through machine learning

Advanced Modulation Formats for 400 Gbps Optical Networks and AI-Based Format Recognition

Improving Optical Transmission Performance in Multi-Channel Networks Utilizing Convolutional Neural Network-Enabled Digital Signal Processing to Mitigate Four-Wave Mixing

Fourier Neural Operator for Accurate Optical Fiber Modeling with Low Complexity

Parallel Channel over Wide Optical Spectrum: Mining and Matching-Based Optimization

DeepONet-Based Waveform-Level Simulation for a Wideband Nonlinear WDM System

Physics-Informed Neural Network for Fibre Channel Modelling in Optical Communication Systems.

Meta-DSP: A Meta-Learning Approach for Data-Driven Nonlinear Compensation in High-Speed Optical Fiber Systems

Convolutional Neural Network-Aided DP-64 QAM Coherent Optical Communication Systems

Quantum optical techniques for quality data transmission process in cognitive networks

Low-Resolution Joint Encoding-Modulation Optical Fiber Communication System

Optimization of Optical Modulation Formats for High-Speed Short-Reach Connection