Abstract:The topic of identification for sparse vector in a distributed way has triggered great interest in the area of adaptive filtering. Grouping components in the sparse vector has been validated to be an efficient way for enhancing identification performance for sparse parameter. The technique of pairwise fused lasso, which can promote similarity between each possible pair of nonnegligible components in the sparse vector, does not require that the nonnegligible components have to be distributed in one or multiple clusters. In other words, the nonnegligible components may be randomly scattered in the unknown sparse vector. In this article, based on the technique of pairwise fused lasso, we propose the novel pairwise fused lasso diffusion least mean-square (PFL-DLMS) algorithm, to identify sparse vector. The objective function we construct consists of three terms, i.e., the mean-square error (MSE) term, the regularizing term promoting the sparsity of all components, and the regularizing term promoting the sparsity of difference between each pair of components in the unknown sparse vector. After investigating mean stability condition of mean-square behavior in theoretical analysis, we propose the strategy of variable regularizing coefficients to overcome the difficulty that the optimal regularizing coefficients are usually unknown. Finally, numerical experiments are conducted to verify the effectiveness of the PFL-DLMS algorithm in identifying and tracking sparse parameter vector.

Hidden Markov Model Decorrelated Diffusion Leaky LMS With Optimized Leaky Factor

Diffusion Bayesian Decorrelation Algorithms Over Networks

Low-complexity Correlated Time-Averaged Variable Forgetting Factor Mechanism for Diffusion RLS Algorithm in Sensor Networks

Diffusion probabilistic LMS algorithm

Diffusion-Probabilistic Least Mean Square Algorithm

Diffusion LMS for Distributed Estimation over Wireless Networks with Inter-Node Interference Perturbation

Estimation of Space-Time Varying Parameters Using a Diffusion LMS Algorithm

Variable Forgetting Factor Mechanisms for Diffusion Recursive Least Squares Algorithm in Sensor Networks.

Diffusion Information Theoretic Learning for Distributed Estimation over Network

Diffusion Sparse Least-Mean Squares over Networks

Diffusion sign-error LMS algorithm: Formulation and stochastic behavior analysis

Distributed Estimation with Partially Accessible Information: An IMAT Approach to LMS Diffusion

Maximum Entropy Estimator for Hidden Markov Models: Reduction to Dimension 2

Where to Diffuse, How to Diffuse, and How to Get Back: Automated Learning for Multivariate Diffusions

Latent-based Diffusion Model for Long-tailed Recognition

Distributed adaptive algorithm based on the asymmetric cost of error functions

Adaptive Diffusion Pairwise Fused Lasso LMS Algorithm Over Networks

Simple and Effective Masked Diffusion Language Models

Second-Order Nonlinearity Estimated and Compensated Diffusion LMS Algorithm: Theoretical Upper Bound, Cramer-Rao Lower bound, and Convergence Analysis

Trimmed Diffusion Least Mean Squares For Distributed Estimation

On the Approximate Maximum Likelihood Estimation for Diffusion Processes