Abstract:Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. While state evolution is a useful analytic tool, its convergence is not guaranteed. To solve the convergence problem of the state evolution of AMP-type algorithms in principle, this paper proposes a sufficient-statistic memory AMP (SS-MAMP) algorithm framework under the conditions of right-unitarily invariant sensing matrices, Lipschitz-continuous local processors and the sufficient-statistic constraint (i.e., the current message of each local processor is a sufficient statistic of the signal vector given the current and all preceding messages). We show that the covariance matrices of SS-MAMP are L-banded and convergent, which is an optimal framework (from the local MMSE/LMMSE perspective) for AMP-type algorithms given the Lipschitz-continuous local processors. Given an arbitrary MAMP, we can construct an SS-MAMP by damping, which not only ensures the convergence of the state evolution, but also preserves the orthogonality, i.e., its dynamics can be correctly described by state evolution. As a byproduct, we prove that the Bayes-optimal orthogonal/vector AMP (BO-OAMP/VAMP) is an SS-MAMP. As an example, we construct a sufficient-statistic Bayes-optimal MAMP (SS-BO-MAMP) whose state evolution converges to the minimum (i.e., Bayes-optimal) mean square error (MSE) predicted by replica methods when it has a unique fixed point. In addition, the MSE of SS-BO-MAMP is not worse than the original BO-MAMP. Finally, simulations are provided to support the theoretical results.

Unitary Approximate Message Passing for Sparse Bayesian Learning

An AMP-Based Low Complexity Generalized Sparse Bayesian Learning Algorithm

A Unitary Transform Based Generalized Approximate Message Passing

Concise Derivation of Complex Bayesian Approximate Message Passing Via Expectation Propagation.

Approximate Message Passing with Nearest Neighbor Sparsity Pattern Learning

A Unified Bayesian Inference Framework for Generalized Linear Models

Bilinear Adaptive Generalized Vector Approximate Message Passing

Block-Sparse Signal Recovery Based on Adaptive Matching Pursuit Via Spike and Slab Prior

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

A Concise Tutorial on Approximate Message Passing

Computationally Efficient Sparse Bayesian Learning Via Generalized Approximate Message Passing

Pattern Coupled Sparse Bayesian Learning Based on UTAMP for Robust High Resolution ISAR Imaging

A non-asymptotic distributional theory of approximate message passing for sparse and robust regression

Approximate Message Passing for the Matrix Tensor Product Model

Approximate Message Passing for orthogonally invariant ensembles: Multivariate non-linearities and spectral initialization

Unitary Approximate Message Passing for Matrix Factorization

A Non-Asymptotic Framework for Approximate Message Passing in Spiked Models

A unifying tutorial on Approximate Message Passing

Sufficient-Statistic Memory AMP

Sparse Estimation Based on a New Random Regularized Matching Pursuit Generalized Approximate Message Passing Algorithm.

UAMPnet: Unrolled approximate message passing network for nonconvex regularization