Abstract:In signal processing and wireless communications, the generalized linear system (GLS) has been widely used to evaluate the impact of nonlinear preprocessing on receiver performance. Although generalized approximation message passing (GAMP) is a state-of-the-art algorithm for GLS signal recovery, it is only applicable to measurement matrices with independent and identically distributed (IID) elements. To overcome this limitation, the generalized orthogonal/vector approximate message passing (GOAMP/GVAMP) algorithm for unitarily invariant measurement matrices was developed and shown to be replica Bayes optimal in uncoded GLS. However, due to its complicated state evolution (SE), the information-theoretic limit of GOAMP/GVAMP remains an open problem for arbitrary input distributions. In this paper, we provide a rigorous achievable rate analysis of GOAMP/GVAMP in GLS, establishing its information-theoretic limit (i.e., maximum achievable rate). Specifically, GOAMP/GVAMP involves a dual-input-dual-output linear detector (LD) paired with two nonlinear detectors (NLD), making the achievable rate difficult to analyze. To address this issue, we convert the fully unfolded state evolution (SE) of a multi-layer iterative algorithm into an equivalent single-input single-output variational SE (VSE). The achievable rate of GOAMP/GVAMP is calculated using the VSE and the mutual information and minimum mean square error (I-MMSE) lemma. Also, the optimal coding principle for maximizing the achievable rate is provided. Furthermore, the methods presented in the paper can be easily extended to analyze the achievable rate and optimal code design for high-dimensional neural networks using multi-layer AMP-type algorithms. Clipping and quantization, two common nonlinear functions, are used as examples to show the advantages of GOAMP/GVAMP over existing techniques, such as the maximum ratio combining receivers based on the linearized model and the cascading GOAMP/GVAMP with separate LD and NLD. In numerical results, a kind of low-density parity-check (LDPC) code is optimized for GOAMP/GVAMP to approach the theoretical limit within dB. The finite-length performances of the GOAMP/GVAMP with optimized LDPC codes are within dB away from the theoretical limits in GLS.

On the Finite Length Performance of Sparse Regression Codes with Peak-Power Limitation

Efficient Recovery of Structured Sparse Signals Via Approximate Message Passing with Structured Spike and Slab Prior

Capacity-Achieving Sparse Regression Codes via Vector Approximate Message Passing

Lossy Compression Via Sparse Regression Codes: an Approximate Message Passing Approach.

Irregularly Clipped Sparse Regression Codes

Power Allocation for the Base Matrix of Spatially Coupled Sparse Regression Codes

Sparse Regression LDPC Codes

Coded Many-User Multiple Access via Approximate Message Passing

Compressed Coding, AMP-Based Decoding, and Analog Spatial Coupling

Achievable Rates of Generalized Linear Systems With Orthogonal/Vector AMP Receiver

Generalized Linear Systems with OAMP/VAMP Receiver: Achievable Rate and Coding Principle

Generalized Sparse Regression Codes for Short Block Lengths

Peak Reduction and Clipping Mitigation by Compressive Sensing

Improved Spinal Codes: A Segmented Crc-Aided Scheme

Performance Analysis Of Finite Length Non-Binary Raptor Codes Under Ordered Statistics Decoder

Sparse Decoding of Low Density Parity Check Codes Using Margin Propagation

On the Total-Power Capacity of Regular-LDPC Codes with Iterative Message-Passing Decoders

Sparse Estimation Based on a New Random Regularized Matching Pursuit Generalized Approximate Message Passing Algorithm.

Globally Variance-Constrained Sparse Representation and Its Application in Image Set Coding.

Rate-Compatible Protograph LDPC Codes for Source Coding in Joint Source—Channel Coded Modulation Systems

An Efficient Two-Stage SPARC Decoder for Massive MIMO Unsourced Random Access