Abstract:This thesis is interested in the application of statistical physics methods and inference to sparse linear estimation problems. The main tools are the graphical models and approximate message-passing algorithm together with the cavity method. We will also use the replica method of statistical physics of disordered systems which allows to associate to the studied problems a cost function referred as the potential of free entropy in physics. It allows to predict the different phases of typical complexity of the problem as a function of external parameters such as the noise level or the number of measurements one has about the signal: the inference can be typically easy, hard or impossible. We will see that the hard phase corresponds to a regime of coexistence of the actual solution together with another unwanted solution of the message passing equations. In this phase, it represents a metastable state which is not the true equilibrium solution. This phenomenon can be linked to supercooled water blocked in the liquid state below its freezing critical temperature. We will use a method that allows to overcome the metastability mimicing the strategy adopted by nature itself for supercooled water: the nucleation and spatial coupling. In supercooled water, a weak localized perturbation is enough to create a crystal nucleus that will propagate in all the medium thanks to the physical couplings between closeby atoms. The same process will help the algorithm to find the signal, thanks to the introduction of a nucleus containing local information about the signal. It will then spread as a "reconstruction wave" similar to the crystal in the water. After an introduction to statistical inference and sparse linear estimation, we will introduce the necessary tools. Then we will move to applications of these notions to signal processing and coding theory problems.

Two Lectures on Iterative Coding and Statistical Mechanics

Error correcting codes and spatial coupling

Four lectures on computational statistical physics

Statistical physics and approximate message-passing algorithms for sparse linear estimation problems in signal processing and coding theory

Statistical Mechanics and error-correction Codes

Sparse representations, inference and learning

Information Theory and Statistical Physics - Lecture Notes

Three lectures on free probability

Points-Polynomials Incidence Theorem with Applications to Coding Theory

Statistical physics, Bayesian inference and neural information processing

Metodi Iterativi per Sistemi Lineari

An Algebraic and Probabilistic Framework for Network Information Theory

Processus aléatoires et applications -- Algorithmes MCMC et vitesse de convergence

Lectures on families of Dirac operators and applications

Statistical physics of linear and bilinear inference problems

Lectures on Statistics in Theory: Prelude to Statistics in Practice

Asymptotic Estimates in Information Theory with Non-Vanishing Error Probabilities

Three lectures on Fourier analysis and learning theory

Algebraic Methods for Quantum Codes on Lattices

Lecture Notes on Channel Coding