Abstract:In this paper, a class of diffusion zero-attracting stochastic gradient algorithms with exponentiated error cost functions is put forward due to its good performance for sparse system identification. Distributed estimation algorithms based on the popular mean-square error criterion have poor behavior for sparse system identification with color noise. To overcome this drawback, a class of stochastic gradient least exponentiated (LE) algorithms with exponentiated error cost functions were proposed, which achieved a low steady-state compared with the least mean square (LMS) algorithm. However, those LE algorithms may suffer from performance deterioration in the spare system. For sparse system identification in the adaptive network, a polynomial variable scaling factor improved diffusion least sum of exponentials (PZA-VSIDLSE) algorithm and an $l_{mathrm {p}}$ -norm constraint diffusion least exponentiated square (LP-DLE2) algorithm are proposed in this work. Instead of using the $l_{1}$ -norm penalty, an $l_{mathrm {p}}$ -norm penalty and a polynomial zero-attractor are employed as a substitution in the cost functions of the LE algorithms. Then, we perform mean behavior model and mean square behavior modal of the LP-DLE2 algorithm with several common assumptions. Moreover, simulations in the context of distributed network sparse system identification show that the proposed algorithms have a low steady-state compared with the existing algorithms.

Transient Analysis of Diffusion Recursive Least Squares Via Signed Error Algorithm for Cyclostationary Colored Inputs

Online Diffusion Source Detection in Social Networks.

Diffusion sign-error LMS algorithm: Formulation and stochastic behavior analysis

Recursive Least Squares for Censored Regression

Distributed Sparse Recursive Least-Squares over Networks

Variable Forgetting Factor Mechanisms for Diffusion Recursive Least Squares Algorithm in Sensor Networks.

Robust Stability and Robust Periodicity of Delayed Recurrent Neural Networks with Noise Disturbance

Distributed Censored Regression over Networks

Dissipativity-based Asynchronous State Estimation for Markov Jump Neural Networks with Jumping Fading Channels.

Diffusion Sparse Least-Mean Squares over Networks

Diffusion Information Theoretic Learning for Distributed Estimation over Network

Low-complexity Correlated Time-Averaged Variable Forgetting Factor Mechanism for Diffusion RLS Algorithm in Sensor Networks

Stochastic Modeling and Simulations of the RED Algorithm

A Class of Diffusion Zero Attracting Stochastic Gradient Algorithms With Exponentiated Error Cost Functions

Decentralized RLS with Data-Adaptive Censoring for Regressions over Large-Scale Networks

How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework

Diffusion Bayesian Decorrelation Algorithms Over Networks

Error Analysis for Semilinear Stochastic Subdiffusion with Integrated Fractional Gaussian Noise

Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent

Impulsive Control for Existence, Uniqueness, and Global Stability of Periodic Solutions of Recurrent Neural Networks with Discrete and Continuously Distributed Delays.

Adaptive event-triggered state estimation for a class of stochastic complex networks subject to coding-decoding schemes and missing measurements