Abstract:Renyi's entropy, as a crucial similarity measure of information quantity, is the cornerstone of the minimum error entropy (MEE) criterion. However, the conventional MEE cost had to employ a computationally feasible estimator to approximate the error entropy directly from the data samples, which could be contaminated by large interference outliers, and the performance of MEE could deteriorate in the presence of complex non-Gaussian noises. To address this problem, utilizing the robust statistical properties of M-estimation, the M-estimators are introduced to the MEE criterion by down-weighting or discarding large error residuals; we can then proceed to obtain a more accurate Renyi's-entropy estimator compared to the empirical form under the recalculated error distribution. This innovative approach could be simply implemented while ensuring great robustness. Therefore, a robust adaption criterion called the M-estimation-based minimum error entropy (MMEE), and its corresponding adaptive filtering algorithm are proposed that detect and bound the influence of outliers in non-Gaussian noise. In addition, the mean stability and steady-state performance of the proposed MMEE are evaluated, furthermore, we theoretically prove that the MMEE algorithm could achieve lower steady-state error than MEE under the same conditions. Simulation results verify our theoretical predictions, and demonstrate the superiority and robustness of the MMEE algorithm compared with several existing robust filtering algorithms for restraining various non-Gaussian noises.

A Robust Adaptive FIR Filter Based on M-Estimation

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Adaptive M-Estimation for Robust Cubature Kalman Filtering

Robust Frequency-Domain Recursive Least M-Estimate Adaptive Filter for Acoustic System Identification

Robust Adaptive Filtering based on M-estimation-based Minimum Error Entropy Criterion

Robust Finite-Time H ∞ Filtering for Uncertain Systems Subject to Missing Measurements

Novel Approach to Robust H_∞ State Estimation for Parametric Uncertainty

Robust Constrained Normalized M-Estimate Subband Adaptive Filter: Algorithm Derivation and Performance Analysis

Robust Adaptive Unscented Particle Filter

A Robust and Fault-Tolerant Filter and Its Application in MEMS-INS/GPS.

Robust Andrew's sine estimate adaptive filtering

New Adaptive Recursive M-Estimation Algorithm and Its Performance Analysis

Robust H∞ resilient filtering for uncertain discrete-time delayed systems

New Design of Robust $h_{\infty}$ Filters for 2-D Systems

Robust Adaptive ℒ∞-gain Neural Filtering for Non-Linear Systems in the Presence of Bounded Disturbances

Robust Finite‐frequency Filter Design for Linear Uncertain Systems Using Polynomially Parameter‐dependent Approach

Robust Total Least Mean Square Adaptive Filter:Algorithm and Analysis

Unsupervised Robust Adaptive Filtering Against Impulsive Noise

Robust Information Unscented Particle Filter Based on M-estimate

Robust H<inf>&#x221E;</inf> Filtering for Continuous Time-Varying Uncertain Systems with Adaptive Mechanism

An M-Estimator based algorithm for active impulse-like noise control