Abstract:State-of-the-art high-spectral-efficiency communication systems employ high-order modulation formats coupled with high symbol rates to accommodate the ever-growing demand for data rate-hungry applications. However, such systems are more vulnerable to linear and nonlinear transmission impairments, and it is important to mitigate the performance loss via digital signal processing. In this paper, we propose a novel machine learning approach for blind channel equalization and estimation using the vector quantized (VQ) \ac{VAE} framework. The proposed approach generalizes the applicability of the conventional \ac{VAE}-based equalizer to nonlinear systems employing high-order modulation formats by introducing a codebook component and an associated novel loss function. We evaluate the performance of the proposed method over a linear additive white Gaussian noise channel with intersymbol interference and two nonlinear scenarios. Simulation results show that the proposed method can achieve similar performance as a data aided equalizer using the \acf{MMSE} criterion, and outperforms the blind\ac{CMA} and the \ac{VAE}-based channel equalizer. Furthermore, we show that for the linear channel, the proposed scheme exhibits better convergence properties than the \ac{MMSE}-based, the \ac{CMA}-based, and the \ac{VAE}-based equalizers in terms of both convergence speed and robustness to variations in training batch size and learning rate.

Blind Channel Equalization

Study and Simulation of New Blind Equalization Algorithm of Underwater Acoustic Channel

A New Dual Mode Blind Equalization Algorithm

Simulations of the Convergence Performance of Several Bussgang Family Blind Equalization Algorithms

Complex Communication Channel Blind Equalization Method Based on RLS-BP Algorithm

A New Dual-Mode Blind Equalization Approach Based on Modified Super-Exponential Iteration Algorithm

A Variable Step Size Blind Equalization Algorithm for QAM Signals

Blind Equalization Algorithms Based on Orthogonal Wavelet and Coordinate Transformation

Novel Blind Equalization Algorithm for Multipath Fading Underwater Acoustic Channel

Constrained Optimization Methods for Blind Equalization of Multiple Fir Channels

Adaptive Blind Equalization for Rayleigh Fading Ionospheric Channels

Blind equalisation technique based on an improved constant modulus adaptive algorithm

Blind equalization of CDMA systems with nonlinear channels

Blind Mmse Equalization of Fir/Iir Channels Using Oversampling and Multichannel Linear Prediction

Adaptive Blind Sparse-Channel Equalization

Blind Channel Equalization Using Vector-Quantized Variational Autoencoders

Blind and Channel-agnostic Equalization Using Adversarial Networks

A New Constant Modulus Blind Channel Equalization Algorithm

Blind Channel Equalization using Variational Autoencoders

Blind Adaptive Identification and Equalization Using Bias-Compensated NLMS Methods

Subspace-based Techniques for Certain Blind Equalization