Abstract:Solving linear regression problems based on the total least-squares (TLS) criterion has well-documented merits in various applications, where perturbations appear both in the data vector as well as in the regression matrix. However, existing TLS approaches do not account for sparsity possibly present in the unknown vector of regression coefficients. On the other hand, sparsity is the key attribute exploited by modern compressive sampling and variable selection approaches to linear regression, which include noise in the data, but do not account for perturbations in the regression matrix. The present paper fills this gap by formulating and solving TLS optimization problems under sparsity constraints. Near-optimum and reduced-complexity suboptimum sparse (S-) TLS algorithms are developed to address the perturbed compressive sampling (and the related dictionary learning) challenge, when there is a mismatch between the true and adopted bases over which the unknown vector is sparse. The novel S-TLS schemes also allow for perturbations in the regression matrix of the least-absolute selection and shrinkage selection operator (Lasso), and endow TLS approaches with ability to cope with sparse, under-determined "errors-in-variables" models. Interesting generalizations can further exploit prior knowledge on the perturbations to obtain novel weighted and structured S-TLS solvers. Analysis and simulations demonstrate the practical impact of S-TLS in calibrating the mismatch effects of contemporary grid-based approaches to cognitive radio sensing, and robust direction-of-arrival estimation using antenna arrays.

Perturbation Analysis and Randomized Algorithms for Large-Scale Total Least Squares Problems

Randomized algorithms for total least squares problems.

A contribution to perturbation analysis for total least squares problems

Total Least Squares with Application in Geospatial Data Processing

Distributed Sparse Total Least-Squares over Networks

Regularization Total Least Squares and Randomized Algorithms

Regularized and Structured Tensor Total Least Squares Methods with Applications

Regularized Total Least Squares: Computational Aspects and Error Bounds.

An algorithm for solving rank-deficient scaled total least square problems

Perturbation bounds for constrained and weighted least squares problems

Quantum-inspired algorithm for truncated total least squares solution

Sparsity-Cognizant Total Least-Squares for Perturbed Compressive Sampling

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

An Algorithm for Solving Scaled Total Least Squares Problems.

Assessing stochastic algorithms for large scale nonlinear least squares problems using extremal probabilities of linear combinations of gamma random variables

A stochastic perturbation analysis of the QR decomposition and its applications

Towards Practical Large-scale Randomized Iterative Least Squares Solvers through Uncertainty Quantification

Low rank approximation method for perturbed linear systems with applications to elliptic type stochastic PDEs

Roundoff Error Analysis of an Algorithm Based on Householder Bidiagonalization for Total Least Squares Problems

Optimal Randomized First-Order Methods for Least-Squares Problems

Randomized Core Reduction for Discrete Ill-Posed Problem