Abstract:Solving linear regression problems based on the total least-squares (TLS) criterion has well-documented merits in various applications, where perturbations appear both in the data vector as well as in the regression matrix. However, existing TLS approaches do not account for sparsity possibly present in the unknown vector of regression coefficients. On the other hand, sparsity is the key attribute exploited by modern compressive sampling and variable selection approaches to linear regression, which include noise in the data, but do not account for perturbations in the regression matrix. The present paper fills this gap by formulating and solving TLS optimization problems under sparsity constraints. Near-optimum and reduced-complexity suboptimum sparse (S-) TLS algorithms are developed to address the perturbed compressive sampling (and the related dictionary learning) challenge, when there is a mismatch between the true and adopted bases over which the unknown vector is sparse. The novel S-TLS schemes also allow for perturbations in the regression matrix of the least-absolute selection and shrinkage selection operator (Lasso), and endow TLS approaches with ability to cope with sparse, under-determined "errors-in-variables" models. Interesting generalizations can further exploit prior knowledge on the perturbations to obtain novel weighted and structured S-TLS solvers. Analysis and simulations demonstrate the practical impact of S-TLS in calibrating the mismatch effects of contemporary grid-based approaches to cognitive radio sensing, and robust direction-of-arrival estimation using antenna arrays.

A Total Least Squares Approach for the Solution of the Perturbation Equation

Iterative Total Least-Squares Image Reconstruction Algorithm for Optical Tomography by the Conjugate Gradient Method

A Multiresolution Total Least Squares Reconstruction Algorithm Based On Wavelet In Medical Optical Tomography

Regularized Total Least Squares Reconstruction for Optical Tomographic Imaging Using Conjugate Gradient Method

A Wavelet-Based Multiresolution Regularized Least Squares Reconstruction Approach for Optical Tomography

A Robust Least Squares Framework for PET Image Reconstruction

Wavelet Based Multigrid Reconstruction Algorithm for Optical Tomography

Uncertainty Penalized Weighted Least Squares Framework For Pet Reconstruction Under Uncertain System Models

Stabilizing The Iterative Solution To Ultrasonic Ray Tomography

Template-based CT Reconstruction with Optimal Transport and Total Generalized Variation

Perturbation Analysis and Randomized Algorithms for Large-Scale Total Least Squares Problems

Laplacian and Bilateral Weighted Relative Total Variation Sparse Angle CT Reconstruction

Perturbation Identities for Regularized Tikhonov Inverses and Weighted Pseudoinverses

Low rank approximation method for perturbed linear systems with applications to elliptic type stochastic PDEs

A Modified Least Squares-based Tomography with Density Matrix Perturbation and Linear Entropy Consideration Along with Performance Analysis

Noniterative Least-Squares Reverse Time Migration Based on an Efficient Asymptotic Hessian/point-spread Function Estimation

Sparsity-Cognizant Total Least-Squares for Perturbed Compressive Sampling

Regularized Total Least Squares: Computational Aspects and Error Bounds.

Optimization-based Algorithm for Solving the Discrete X-Ray Transform with Nonlinear Partial Volume Effect

Quantum-inspired algorithm for truncated total least squares solution