Abstract:Solving linear regression problems based on the total least-squares (TLS) criterion has well-documented merits in various applications, where perturbations appear both in the data vector as well as in the regression matrix. However, existing TLS approaches do not account for sparsity possibly present in the unknown vector of regression coefficients. On the other hand, sparsity is the key attribute exploited by modern compressive sampling and variable selection approaches to linear regression, which include noise in the data, but do not account for perturbations in the regression matrix. The present paper fills this gap by formulating and solving TLS optimization problems under sparsity constraints. Near-optimum and reduced-complexity suboptimum sparse (S-) TLS algorithms are developed to address the perturbed compressive sampling (and the related dictionary learning) challenge, when there is a mismatch between the true and adopted bases over which the unknown vector is sparse. The novel S-TLS schemes also allow for perturbations in the regression matrix of the least-absolute selection and shrinkage selection operator (Lasso), and endow TLS approaches with ability to cope with sparse, under-determined "errors-in-variables" models. Interesting generalizations can further exploit prior knowledge on the perturbations to obtain novel weighted and structured S-TLS solvers. Analysis and simulations demonstrate the practical impact of S-TLS in calibrating the mismatch effects of contemporary grid-based approaches to cognitive radio sensing, and robust direction-of-arrival estimation using antenna arrays.

Regularized TLS-EM for estimating missing data

Solving the Electrocardiography Inverse Problem by Using an Optimal Algorithm Based on the Total Least Squares Theory

TLS-EM Algorithm of Mixture Density Models for Exponential Families

Geophysical Data Sparse Reconstruction Based on L0-Norm Minimization

Regularized EM algorithm

Regularized EM Algorithms: A Unified Framework and Statistical Guarantees

Distributed Sparse Total Least-Squares over Networks

Regularized EM algorithm for sparse parameter estimation in nonlinear dynamic systems with application to gene regulatory network inference

Minimum Total Error Entropy Method for Parameter Estimation

Em Algorithm of the Truncated Multinormal Distribution with Linear Restriction on the Variables

Sparsity-Cognizant Total Least-Squares for Perturbed Compressive Sampling

Statistical Machine Learning EM algorithm Lecture Notes 13 : EM algorithm

Extended Total Least Squares Problems for Linear Errors-in-variables Model and Its Typical Applications

Regularized and Structured Tensor Total Least Squares Methods with Applications

Maximum Likelihood from Incomplete Data Via the EM Algorithm

Inference of stochastic time series with missing data

Regularization Total Least Squares and Randomized Algorithms

Acceleration of the EM Algorithm

An alternating iterative minimisation algorithm for the double-regularised total least square functional

MSE-based Regularization Approach to Rank Determination in CLS and TLS Estimation.

An EM algorithm for estimating the parameters of the multivariate skew-normal distribution with censored responses