Abstract:We propose a probabilistic model for sparse signal reconstruction and develop several novel algorithms for computing the maximum likelihood (ML) parameter estimates under this model. The measurements follow an underdetermined linear model where the regression-coefficient vector is the sum of an unknown deterministic sparse signal component and a zero-mean white Gaussian component with an unknown variance. Our reconstruction schemes are based on an expectation-conditional maximization either (ECME) iteration that aims at maximizing the likelihood function with respect to the unknown parameters for a given signal sparsity level. Compared with the existing iterative hard thresholding (IHT) method, the ECME algorithm contains an additional multiplicative term and guarantees monotonic convergence for a wide range of sensing (regression) matrices. We propose a double overrelaxation (DORE) thresholding scheme for accelerating the ECME iteration. We prove that, under certain mild conditions, the ECME and DORE iterations converge to local maxima of the likelihood function. The ECME and DORE iterations can be implemented exactly in small-scale applications and for the important class of large-scale sensing operators with orthonormal rows used e. g., partial fast Fourier transform (FFT). If the signal sparsity level is unknown, we introduce an unconstrained sparsity selection (USS) criterion and a tuning-free automatic double overrelaxation (ADORE) thresholding method that employs USS to estimate the sparsity level. We compare the proposed and existing sparse signal reconstruction methods via one-dimensional simulation and two-dimensional image reconstruction experiments using simulated and real X-ray CT data.

Automatic Hard Thresholding for Sparse Signal Reconstruction from Nde Measurements

Sparse Signal Reconstruction Via ECME Hard Thresholding.

ECME Thresholding Methods for Sparse Signal Reconstruction

Double overrelaxation thresholding methods for sparse signal reconstruction

Adaptive Iterative Hard Thresholding for Least Absolute Deviation Problems with Sparsity Constraints

Iterative Hard Thresholding for Compressed Data Separation.

Sparse Deconvolution Method for Ultrasound Images Based on Automatic Estimation of Reference Signals.

Heavy-Ball-Based Hard Thresholding Algorithms for Sparse Signal Recovery

A Model-Based Regularized Inverse Method for Ultrasonic B-scan Image Reconstruction

A High Resolution Bearing Estimation Method Based on Sparse Reconstruction

Randomized Iterative Hard Thresholding for Sparse Approximations

Mask Iterative Hard Thresholding Algorithms for Sparse Image Reconstruction of Objects with Known Contour

Sparse Signal Reconstruction from Quantized Noisy Measurements Via GEM Hard Thresholding

ECME Hard Thresholding Methods for Image Reconstruction from Compressive Samples

Newton-Step-Based Hard Thresholding Algorithms for Sparse Signal Recovery

Normalised Iterative Hard Thresholding; guaranteed stability and performance

Conjugate Gradient Hard Thresholding Pursuit Algorithm For Sparse Signal Recovery

A Modified Iterative Hard Thresholding Algorithm

Iterative Difference Hard-Thresholding Algorithm for Sparse Signal Recovery.

Fast and Provable Algorithms for Spectrally Sparse Signal Reconstruction Via Low-Rank Hankel Matrix Completion

Wavelet-based Edge Correlation Incorporated Iterative Reconstruction for Undersampled MRI