Abstract:State-of-the-art high-spectral-efficiency communication systems employ high-order modulation formats coupled with high symbol rates to accommodate the ever-growing demand for data rate-hungry applications. However, such systems are more vulnerable to linear and nonlinear transmission impairments, and it is important to mitigate the performance loss via digital signal processing. In this paper, we propose a novel machine learning approach for blind channel equalization and estimation using the vector quantized (VQ) \ac{VAE} framework. The proposed approach generalizes the applicability of the conventional \ac{VAE}-based equalizer to nonlinear systems employing high-order modulation formats by introducing a codebook component and an associated novel loss function. We evaluate the performance of the proposed method over a linear additive white Gaussian noise channel with intersymbol interference and two nonlinear scenarios. Simulation results show that the proposed method can achieve similar performance as a data aided equalizer using the \acf{MMSE} criterion, and outperforms the blind\ac{CMA} and the \ac{VAE}-based channel equalizer. Furthermore, we show that for the linear channel, the proposed scheme exhibits better convergence properties than the \ac{MMSE}-based, the \ac{CMA}-based, and the \ac{VAE}-based equalizers in terms of both convergence speed and robustness to variations in training batch size and learning rate.

Blind Zero Forcing Equalization of Multichannel Nonlinear CDMA Systems.

Blind Equalization Algorithm of QAM Signal Based on SNR

A New Dual Mode Blind Equalization Algorithm

Blind Channel Equalization

A Variable Step Size Blind Equalization Algorithm for QAM Signals

Blind Channel Equalization Using Vector-Quantized Variational Autoencoders

Blind Equalization using a Variational Autoencoder with Second Order Volterra Channel Model

Blind Channel Estimation for Long Code MIMO CDMA Using First-Order Statistics

Higher Order Cumulants for Identification and Equalization of Multicarrier Spreading Spectrum Systems

Blind Equalization and Channel Estimation in Coherent Optical Communications Using Variational Autoencoders

Blind Equalization of MIMO Systems Based on Orthogonal Constant Modulus Algorithm

A Stop and Go Blind Equalization Algorithm for QAM Signals

Blind Channel Estimation for Long Code Multiuser CDMA Systems

Blind Equalization for Dual-Polarization Two-Subcarrier Coherent QPSK-OFDM Signals

Effects of Imperfect Blind Channel Estimation on Performance of Linear CDMA Receivers

Adaptive Blind Equalization for Rayleigh Fading Ionospheric Channels

Blind Adaptive Algorithms for Minimum Variance CDMA Receivers

Blind Frequency-Domain Equalization Using Vector-Quantized Variational Autoencoders

An Applied Equalization Scheme for Multi-Carrier CDMA Systems in a Slow Deep Rayleigh Fading Channel

Modified blind channel equalization method for MIMO OFDM systems

An Orthogonal Projection Approach for Blind Beamforming in Multipath CDMA Channels