Abstract:Photonics-assisted millimeter wave (MMW) can overcome the bandwidth bottleneck of electronic devices, but it also faces nonlinear damage caused by optoelectronic devices. Nonlinear equalization algorithms based on neural networks (NN) have gradually been introduced in the receiving end of 6G MMW communication, but the high computational complexity limits the real-time performance of the equalizer, and there is a tradeoff between the good equalization performance and low complexity. This paper proposes an Automatic Search Algorithm (ASA) based on deep reinforcement learning (DRL), which learns the functional relationship between equalizer structure parameters and optimization objectives through DRL, in order to quickly search for the optimal structure of various equalizers. The experiment demonstrated the W-band 16QAM discrete multi-tone (DMT) signal transmission in an intensity modulation and direct detection (IM/DD) system over a 50 m wireless link. We implement real-valued time-domain neural network equalizer (TDNNE), and complex-valued frequency-domain neural network equalizer (FDNNE), to solve the nonlinear issues respectively. Subsequently, ASA and greedy search algorithm were applied to TDNNE and FDNNE respectively, and the superiority of ASA was verified based on the bit error rate (BER) and the number of Multiply-Accumulate Operations (MACs) consumed by the equalizer. Finally, the experiment verified that using ASA to optimize the pruning of FDNNE can greatly reduce the complexity with almost no BER loss, while retaining the good equalization performance of NN equalizers and overcoming the disadvantage of high computational complexity. Thanks to our proposed complex-valued FDNNE based on DRL, the effective data rate reaches 11.4Gb/s with 0.5 dB receiver sensitivity improvement compared to VNLE and TDNNE. At the same time, after pruning optimization, the average number of MACs consumed by FDNNE at various input optical powers into photodiode (PD) reduced by 37%. We believe ASA is an important application of using DRL to optimize neural networks in the field of nonlinear equalization. It can efficiently explore the performance limits of equalizers and has great potential for high-precision reception in future 6G wireless communications.

Machine Learning Classifier Based on FE-KNN Enabled High-Capacity PAM-4 and NRZ Transmission with 10-G Class Optics

Deep Learning Equalizer Connected with Viterbi-Viterbi Algorithm for PAM D-Band Radio over Fiber Link

A powerful equalizer based on modified SVM classifier without nonlinear kernel enabled 100-Gb/s NG-EPON system with 10-G class

High-efficient Equalizer based on the simplified Deep Neural Network for 56Gb/s/ PAM-4 in C-band 10G DML-based Short reach system

Nonlinear Equalization by SVM Classification Enabled 50-Gb/s PAM-4 Transmission in NG-EPON with 10-G Class Optics

Complex principal component analysis-based complex-valued fully connected NN equalizer for optical fibre communications

High-speed PAM4 Transmission with a GeSi Electro-Absorption Modulator and Dual-Path Neural-Network-based Equalization

Machine Learning for 100Gb/s/λ Passive Optical Network

OAM mode-division multiplexing IM/DD transmission at 4.32 Tbit/s with a low-complexity adaptive-network-based fuzzy inference system nonlinear equalizer

Joint Linear and Nonlinear Equalization Based on Cascaded ANN-MLSE with a Modified Loss Function for PAM-4 Optical Transmission

Functional-Link Neural Network for Nonlinear Equalizer in Coherent Optical Fiber Communications

Multi-Task Learning Aided Neural Networks for Equalization in Coherent Optical System

Adaptive Partial-Response Neural Network Equalization for Bandwidth-limited PAM Transmission in Intra-datacenter Interconnect

A Novel Machine Learning-based Equalizer for a Downstream 100G PAM-4 PON

Piecewise Feedforward Neural Network Based Nonlinear Equalizer for Short-Reach DML-DD System

Machine Learning for 100 Gb/s/<italic>λ</italic> Passive Optical Network

Frequency-Domain Complex-Valued NN Equalizer Based on Deep Reinforcement Learning for Photonics-Assisted W-Band 16QAM-DMT Signals System over 50 M

Performance and complexity study of a neural network post-equalizer in a 638-nm laser transmission system through over 100-m plastic optical fiber

AdaNN: Adaptive Neural Network-based Equalizer via Online Semi-supervised Learning for High-speed Optical Fiber Communication

Performance and Complexity Analysis of Conventional and Deep Learning Equalizers for the High-Speed IMDD PON

Neural Network-Based Equalization in High-Speed PONs.