Abstract:The rapid growth of online services and the global transition to digital platforms, accelerated by the COVID-19 pandemic and the emergence of AI-based services, have led to a surge in demand for high-capacity optical communication networks (OCNs). However, this transition exacerbates the issue of fiber nonlinearity, notably four-wave mixing (FWM), which can significantly impact signal integrity in long-distance OCN transmissions with multiple channels. To address this challenge, this paper presents a novel approach leveraging a convolutional neural network (CNN)-based digital signal processing (DSP) model to mitigate the nonlinear effects of FWM on signal quality. The proposed CNN model, designed with three convolutional layers and trained on a comprehensive dataset of simulated OCN transmissions, demonstrates significant improvement in reducing nonlinear distortions caused by FWM. Our method is compared with traditional compensation techniques, such as digital back-propagation and Volterra series-based equalizers, showing a reduction in power penalties by 1 dB and an enhancement in the power budget by 2 dB. Simulation results indicate that the bit error rates (BERs) remain consistently below the critical threshold of 10 −9 across various transmission distances, outperforming conventional methods. The simulation analysis, conducted on a 100 km multi-channel OCN testbed, confirms the CNN equalizer's efficacy in reducing crosstalk and improving power efficiency, with a demonstrated 15% reduction in required launch power. Moreover, the analytical models used to evaluate the CNN-based DSP model show high accuracy in predicting performance, underscoring the model's capability to achieve high-quality transmission with lower power requirements. These findings advocate for the integration of our CNN-based DSP model into OCNs, offering a fruitful solution for managing multi-channel, long-distance, and high-data-rate optical transmissions in real-world systems.

Signal recovery in optical wireless communication using photonic convolutional processor

Multi-Wavelength Photonic Neuromorphic Computing for Intra and Inter-Channel Distortion Compensations in WDM Optical Communication Systems

Investigations on intelligent photonic signal processing technology

Convolutional Neural Network-Aided DP-64 QAM Coherent Optical Communication Systems

Complex principal component analysis-based complex-valued fully connected NN equalizer for optical fibre communications

Improving Optical Transmission Performance in Multi-Channel Networks Utilizing Convolutional Neural Network-Enabled Digital Signal Processing to Mitigate Four-Wave Mixing

Demonstration of photonic neural network for fiber nonlinearity compensation in long-haul transmission systems

Efficient Deep Learning of Nonlinear Fiber-Optic Communications Using a Convolutional Recurrent Neural Network

Optical Phase Conjugation with Complex-Valued Deep Neural Network for WDM 64-QAM Coherent Optical Systems

Low Computationally Complex Recurrent Neural Network for High Speed Optical Fiber Transmission

A silicon photonic–electronic neural network for fibre nonlinearity compensation

Photonic unsupervised learning processor for secure and high-throughput optical fiber communication

Study of Filter-based Neuromorphic Photonic Reservoir Computing for Signal Equalization in 224gbps Sub-carrier Modulation IM-DD Short Reach Optical Fiber Communication System

Deep Neural Network-Based Digital Pre-Distortion for High Baudrate Optical Coherent Transmission

Low-Complexity Multi-symbol Output Complex-Valued Neural Network for Nonlinear Equalization in 100G Coherent Photonic-assisted W-band Fiber-wireless Integrated Communication

Binarized Coherent Optical Receiver Based on Opto-Electronic Neural Network

System impairment compensation in coherent optical communications by using a bio-inspired detector based on artificial neural network and genetic algorithm

11 Tera-OPs/s Photonic Convolutional Accelerator and Deep Optical Neural Network Based on an Integrated Kerr Soliton Crystal Microcomb

Photonic machine learning implementation for signal recovery in optical communications

Optical Convolutional Neural Network with WDM-Based Optical Patching and Microring Weighting Banks

Neural Network Equalisation for High-Speed Eye-Safe Optical Wireless Communication with 850 nm SM-VCSELs