Abstract:State-of-the-art high-spectral-efficiency communication systems employ high-order modulation formats coupled with high symbol rates to accommodate the ever-growing demand for data rate-hungry applications. However, such systems are more vulnerable to linear and nonlinear transmission impairments, and it is important to mitigate the performance loss via digital signal processing. In this paper, we propose a novel machine learning approach for blind channel equalization and estimation using the vector quantized (VQ) \ac{VAE} framework. The proposed approach generalizes the applicability of the conventional \ac{VAE}-based equalizer to nonlinear systems employing high-order modulation formats by introducing a codebook component and an associated novel loss function. We evaluate the performance of the proposed method over a linear additive white Gaussian noise channel with intersymbol interference and two nonlinear scenarios. Simulation results show that the proposed method can achieve similar performance as a data aided equalizer using the \acf{MMSE} criterion, and outperforms the blind\ac{CMA} and the \ac{VAE}-based channel equalizer. Furthermore, we show that for the linear channel, the proposed scheme exhibits better convergence properties than the \ac{MMSE}-based, the \ac{CMA}-based, and the \ac{VAE}-based equalizers in terms of both convergence speed and robustness to variations in training batch size and learning rate.

Nonlinear Blind Equalization for Volume Holographic Data Storage

Application of Blind Equalization for Volume Holographic Data Storage

Two channel-coding methods for digital volume holographic data storage

Blind Channel Equalization Using Vector-Quantized Variational Autoencoders

Study of Dual-Wavelength Readout Properties in Volume Holographic Storage System

A Two-Dimensional Constant-Weight Sparse Modulation Code for Volume Holographic Data Storage

Blind Equalization using a Variational Autoencoder with Second Order Volterra Channel Model

Study of intra-page crosstalk suppression in volume holographic storage

Parallelism and Discrimination Enhancement of Volume Holographic Image Processing System

Crosstalk Analysis of Multilayer Collinear Volume Holographic Data Storage

Blind Equalization and Channel Estimation in Coherent Optical Communications Using Variational Autoencoders

Two Dimensional Discrete Walsh Transform Based on Multi-Channel Volume Holographic Correlator

Volterra Series Based Blind Equalization for Nonlinear Distortions in Short Reach Optical CAP System

Dynamic Speckle Multiplexing Scheme in Volume Holographic Data Storage and Its Realization.

Improving Accuracy of Multichannel Volume Holographic Correlators by Using a Two-Dimensional Interleaving Method.

Reed–Solomon Volumetric Coding with Matched Interleaving for Holographic Data Storage

Multilayer volume holographic optical memory with reduced crosstalk (Conference Presentation)

Joint Neural Network Equalizer and Decoder

Blind Channel Equalization

Unequally spaced four levels phase encoding in holographic data storage

Blind Frequency-Domain Equalization Using Vector-Quantized Variational Autoencoders