Abstract:Distributed estimation is attracting more and more attention due to its scalability, robustness, and low power-consumption. In most distributed estimation algorithms, the output of the system is assumed to be noisy, while the input data is assumed to be accurate. However, in real applications, both of the input and output data may be perturbed by noise. Thus, it is unrealistic to assume that all the entries in the input data are accurate and only those in the output data are corrupted. In the cases of noisy input and output data, the total least-squares (TLS) method has the ability of minimizing the perturbations in both input and output data, and thus provides a better performance than the least-squares (LS)-based method. Besides, many nature and manmade systems present high level of sparsity. In this paper, we consider the case in which both the input and output data are corrupted by noise, and the parameter of interest is sparse. We present several sparsity-aware distributed TLS algorithms for the in-network cooperative estimation problem, in which the l(1) - or l(0) - norm penalty term is used to exploit the sparsity of the signal. We then present theoretical analysis on the mean and mean-square performance of the proposed algorithms. In addition, several numerical simulations are given to verify the effectiveness and advantages of these proposed algorithms.

Efficient Distributed Estimation of High-Dimensional Sparse Precision Matrix

Efficient Distributed Estimation of High-dimensional Sparse Precision Matrix for Transelliptical Graphical Models

Distributed Sparse Precision Matrix Estimation via Alternating Block-Based Gradient Descent

Positive-Definite Sparse Precision Matrix Estimation

Adjusting for High-Dimensional Covariates in Sparse Precision Matrix Estimation by Lasso Penalized D-Trace Loss

Confidence Intervals for Sparse Precision Matrix Estimation Via Lasso Penalized D-trace Loss

Distributed Semi-Supervised Sparse Statistical Inference

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

A fast ADMM algorithm for sparse precision matrix estimation using lasso penalized D-trace loss

Distributed Sparse Recursive Least-Squares over Networks

Distributed Sparse Total Least-Squares over Networks

Fast and Adaptive Sparse Precision Matrix Estimation in High Dimensions

Sparse and Debiased Adaptive Huber Regression in Distributed Data: Aggregated and Communication-Efficient Approaches

An Efficient ADMM Algorithm for High Dimensional Precision Matrix Estimation Via Penalized Quadratic Loss

Distributed Jointly Sparse Multitask Learning over Networks

Communication-efficient Estimation of High-Dimensional Quantile Regression

Sparse and Debiased Lasso Estimation and Inference for High-Dimensional Composite Quantile Regression with Distributed Data

A Constrained L1 Minimization Approach to Sparse Precision Matrix Estimation

A Unified Precision Matrix Estimation Framework Via Sparse Column-Wise Inverse Operator under Weak Sparsity

Multitask Diffusion Affine Projection Sign Algorithm and Its Sparse Variant for Distributed Estimation