Abstract:Solving linear regression problems based on the total least-squares (TLS) criterion has well-documented merits in various applications, where perturbations appear both in the data vector as well as in the regression matrix. However, existing TLS approaches do not account for sparsity possibly present in the unknown vector of regression coefficients. On the other hand, sparsity is the key attribute exploited by modern compressive sampling and variable selection approaches to linear regression, which include noise in the data, but do not account for perturbations in the regression matrix. The present paper fills this gap by formulating and solving TLS optimization problems under sparsity constraints. Near-optimum and reduced-complexity suboptimum sparse (S-) TLS algorithms are developed to address the perturbed compressive sampling (and the related dictionary learning) challenge, when there is a mismatch between the true and adopted bases over which the unknown vector is sparse. The novel S-TLS schemes also allow for perturbations in the regression matrix of the least-absolute selection and shrinkage selection operator (Lasso), and endow TLS approaches with ability to cope with sparse, under-determined "errors-in-variables" models. Interesting generalizations can further exploit prior knowledge on the perturbations to obtain novel weighted and structured S-TLS solvers. Analysis and simulations demonstrate the practical impact of S-TLS in calibrating the mismatch effects of contemporary grid-based approaches to cognitive radio sensing, and robust direction-of-arrival estimation using antenna arrays.

Small Sample Statistical Condition Estimation for the Total Least Squares Problem

Condition numbers for the truncated total least squares problem and their estimations

On the Condition Number of the Total Least Squares Problem

A contribution to the condition number of the total least squares problem

Effective Condition Numbers and Small Sample Statistical Condition Estimation for the Generalized Sylvester Equation

Structured Condition Numbers of Structured Tikhonov Regularization Problem and Their Estimations

Distributed Sparse Total Least-Squares over Networks

Mixed, componentwise condition numbers and small sample statistical condition estimation of Sylvester equations.

Condition Numbers of the Multidimensional Total Least Squares Problems Having More Than One Solution

CONDITION NUMBERS OF THE MULTIDIMENSIONAL TOTAL LEAST SQUARES PROBLEM

An algorithm for solving rank-deficient scaled total least square problems

Sparsity-Cognizant Total Least-Squares for Perturbed Compressive Sampling

Spectral Condition-Number Estimation of Large Sparse Matrices

An Algorithm for Solving Scaled Total Least Squares Problems.

On the partial condition numbers for the indefinite least squares problem

Perturbation Analysis and Randomized Algorithms for Large-Scale Total Least Squares Problems

Small-sample Statistical Condition Estimation of Rational Riccati Equations

Condition Numbers of Multidimensional Mixed Least Squares-Total Least Squares Problems

Regularized and Structured Tensor Total Least Squares Methods with Applications

Condition Numbers for Structured Least Squares Problems

Total least squares adjustment in inequality constrained partial errors-in-variables models: optimality conditions and algorithms