Abstract:This paper proposes the Set-Membership sign-NLMS (SM-sign-NLMS) adaptive filter, which combines the ability for data censoring (offered by Set-Membership schemes) with robustness against impulsive noise (provided by signed schemes). The algorithm can present a much lower steady-state probability of update than the standard SM-NLMS algorithm when impulsive noise is present in the system. It is derived from a local deterministic optimization problem modulated by a minimum disturbance cost function combined with a bounded error criterion. Several stochastic models are proposed in order to extract insights and a time-variant step size extension of the algorithm. The first of them, based on energy conservation arguments, leads to a fixed-point analytic equation whose solution predicts the asymptotic performance of the algorithm. Further, a transient analysis based on a statistical decoupling of the radial and (discrete) angular distributions of the input vector is derived. Based on such an analysis, an efficient time-variant step-size version of the algorithm is proposed. Additionally, such an analysis is also utilized to obtain a fixed-point formula whose solution describes the asymptotic performance when the unknown plant that the filter intends to match varies according to a first-order Markovian model. Lastly, a novel stochastic model is advanced for the description of the algorithm learning behavior under a deficient-length scenario for a white input signal, which provides some insights about the asymptotic performance of the algorithm. The findings are confirmed by extensive simulations.

A Complete Transient Analysis for the Incremental LMS Algorithm

A Novel Approach to Incremental SVM Learning Algorithm

Transient performance analysis of zero-attracting LMS

Convergence Analysis of an Incremental Approach to Online Inverse Reinforcement Learning

A Unified Analysis Approach for LMS-based Variable Step-Size Algorithms

Tracking Performance of Incremental LMS Algorithm over Adaptive Distributed Sensor Networks

Stochastic Analysis of LMS Algorithm with Delayed Block Coefficient Adaptation

Optimal Variable Step-Size Lms Model and Algorithm with Independence Assumption

Sparse Incremental Delta-Bar-Delta for System Identification

On the convergence analysis of the transform domain normalized LMS and related M-estimate algorithms

Adaptive Monitoring For Transition Process Using Dynamic Mutual Information Similarity Analysis

Behavior of the LMS algorithm with hyperbolic secant cost

Stability analysis of the bias compensated LMS algorithm

On the Mean-Square Performance of the Constrained LMS Algorithm

Optimized LMS algorithm for system identification and noise cancellation

Performance Analysis of L-0-Lms with Gaussian Input Signal

Stochastic Analysis of the Filtered-x LMS Algorithm for Active Noise Control

An Incremental Extreme Learning Machine for Online Sequential Learning Problems

Diffusion-KLMS Algorithm and its Performance Analysis for Non-Linear Distributed Networks

Stochastic Modeling of the Set-Membership- Sign-NLMS Algorithm

Superior Step-Size Theorem and Its Application - Parallel Variable Step-Size LMS Filters Algorithm.