Abstract:In signal processing and wireless communications, the generalized linear system (GLS) has been widely used to evaluate the impact of nonlinear preprocessing on receiver performance. Although generalized approximation message passing (GAMP) is a state-of-the-art algorithm for GLS signal recovery, it is only applicable to measurement matrices with independent and identically distributed (IID) elements. To overcome this limitation, the generalized orthogonal/vector approximate message passing (GOAMP/GVAMP) algorithm for unitarily invariant measurement matrices was developed and shown to be replica Bayes optimal in uncoded GLS. However, due to its complicated state evolution (SE), the information-theoretic limit of GOAMP/GVAMP remains an open problem for arbitrary input distributions. In this paper, we provide a rigorous achievable rate analysis of GOAMP/GVAMP in GLS, establishing its information-theoretic limit (i.e., maximum achievable rate). Specifically, GOAMP/GVAMP involves a dual-input-dual-output linear detector (LD) paired with two nonlinear detectors (NLD), making the achievable rate difficult to analyze. To address this issue, we convert the fully unfolded state evolution (SE) of a multi-layer iterative algorithm into an equivalent single-input single-output variational SE (VSE). The achievable rate of GOAMP/GVAMP is calculated using the VSE and the mutual information and minimum mean square error (I-MMSE) lemma. Also, the optimal coding principle for maximizing the achievable rate is provided. Furthermore, the methods presented in the paper can be easily extended to analyze the achievable rate and optimal code design for high-dimensional neural networks using multi-layer AMP-type algorithms. Clipping and quantization, two common nonlinear functions, are used as examples to show the advantages of GOAMP/GVAMP over existing techniques, such as the maximum ratio combining receivers based on the linearized model and the cascading GOAMP/GVAMP with separate LD and NLD. In numerical results, a kind of low-density parity-check (LDPC) code is optimized for GOAMP/GVAMP to approach the theoretical limit within dB. The finite-length performances of the GOAMP/GVAMP with optimized LDPC codes are within dB away from the theoretical limits in GLS.

Capacity-Achieving Sparse Regression Codes via Vector Approximate Message Passing

Efficient Recovery of Structured Sparse Signals Via Approximate Message Passing with Structured Spike and Slab Prior

Unitary Approximate Message Passing for Sparse Bayesian Learning

Adaptive One-Bit Quantisation Via Approximate Message Passing with Nearest Neighbour Sparsity Pattern Learning

Vector Approximate Message Passing Algorithm for Compressed Sensing with Structured Matrix Perturbation

Power Allocation for the Base Matrix of Spatially Coupled Sparse Regression Codes

On the Finite Length Performance of Sparse Regression Codes with Peak-Power Limitation

Sparse Regression LDPC Codes

Sparse superposition codes with rotational invariant coding matrices for memoryless channels

Sparse Vector Recovery: Bernoulli-Gaussian Message Passing

Lossy Compression Via Sparse Regression Codes: an Approximate Message Passing Approach.

Generalized Linear Systems with OAMP/VAMP Receiver: Achievable Rate and Coding Principle

Spinal Codes Optimization: Error Probability Analysis and Transmission Scheme Design.

An Efficient Two-Stage SPARC Decoder for Massive MIMO Unsourced Random Access

New Upper Bounds on the Error Probability under ML Decoding for Spinal Codes and the Joint Transmission-Decoding System Design

Compressive Spinal Codes

Generalized Sparse Regression Codes for Short Block Lengths

Coded Many-User Multiple Access via Approximate Message Passing

On Capacity-Based Codebook Design and Advanced Decoding for Sparse Code Multiple Access Systems

Generalized Sparse Codes for Non-Gaussian Channels: Code Design, Algorithms, and Applications

Achievable Rates of Generalized Linear Systems With Orthogonal/Vector AMP Receiver