Abstract:Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state evolution. While state evolution is a useful analytic tool, its convergence is not guaranteed. To solve the convergence problem of the state evolution of AMP-type algorithms in principle, this paper proposes a sufficient-statistic memory AMP (SS-MAMP) algorithm framework under the conditions of right-unitarily invariant sensing matrices, Lipschitz-continuous local processors and the sufficient-statistic constraint (i.e., the current message of each local processor is a sufficient statistic of the signal vector given the current and all preceding messages). We show that the covariance matrices of SS-MAMP are L-banded and convergent, which is an optimal framework (from the local MMSE/LMMSE perspective) for AMP-type algorithms given the Lipschitz-continuous local processors. Given an arbitrary MAMP, we can construct an SS-MAMP by damping, which not only ensures the convergence of the state evolution, but also preserves the orthogonality, i.e., its dynamics can be correctly described by state evolution. As a byproduct, we prove that the Bayes-optimal orthogonal/vector AMP (BO-OAMP/VAMP) is an SS-MAMP. As an example, we construct a sufficient-statistic Bayes-optimal MAMP (SS-BO-MAMP) whose state evolution converges to the minimum (i.e., Bayes-optimal) mean square error (MSE) predicted by replica methods when it has a unique fixed point. In addition, the MSE of SS-BO-MAMP is not worse than the original BO-MAMP. Finally, simulations are provided to support the theoretical results.

On the Convergence of Orthogonal/Vector AMP: Long-Memory Message-Passing Strategy

Concise Derivation of Complex Bayesian Approximate Message Passing Via Expectation Propagation.

Unitary Approximate Message Passing for Sparse Bayesian Learning

An Expectation Propagation Perspective on Approximate Message Passing

A Unitary Transform Based Generalized Approximate Message Passing

Bilinear Adaptive Generalized Vector Approximate Message Passing

Sufficient-Statistic Memory AMP

Estimation of Sparse Massive MIMO-OFDM Channels With Approximately Common Support.

Orthogonal Approximate Message-Passing for Spatially Coupled Linear Models

Orthogonal AMP for Problems With Multiple Measurement Vectors and/or Multiple Transforms

Convolutional Approximate Message-Passing

A Concise Tutorial on Approximate Message Passing

On OAMP: Impact of the Orthogonal Principle

Long-Memory Message-Passing for Spatially Coupled Systems

Generalized Memory Approximate Message Passing

A Non-asymptotic Analysis of Generalized Approximate Message Passing Algorithms with Right Rotationally Invariant Designs

Approximate Message Passing for orthogonally invariant ensembles: Multivariate non-linearities and spectral initialization

Generalized Memory Approximate Message Passing for Generalized Linear Model.

Distributed Memory Approximate Message Passing