Abstract:Renyi's entropy, as a crucial similarity measure of information quantity, is the cornerstone of the minimum error entropy (MEE) criterion. However, the conventional MEE cost had to employ a computationally feasible estimator to approximate the error entropy directly from the data samples, which could be contaminated by large interference outliers, and the performance of MEE could deteriorate in the presence of complex non-Gaussian noises. To address this problem, utilizing the robust statistical properties of M-estimation, the M-estimators are introduced to the MEE criterion by down-weighting or discarding large error residuals; we can then proceed to obtain a more accurate Renyi's-entropy estimator compared to the empirical form under the recalculated error distribution. This innovative approach could be simply implemented while ensuring great robustness. Therefore, a robust adaption criterion called the M-estimation-based minimum error entropy (MMEE), and its corresponding adaptive filtering algorithm are proposed that detect and bound the influence of outliers in non-Gaussian noise. In addition, the mean stability and steady-state performance of the proposed MMEE are evaluated, furthermore, we theoretically prove that the MMEE algorithm could achieve lower steady-state error than MEE under the same conditions. Simulation results verify our theoretical predictions, and demonstrate the superiority and robustness of the MMEE algorithm compared with several existing robust filtering algorithms for restraining various non-Gaussian noises.

A Recursive Least P-Order Algorithm Based on M-Estimation in a Non-Gaussian Environment.

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

A recursive adaptive lattice filters for impulsive signals

A Robust Adaptive FIR Filter Based on M-Estimation

A New Recursive Bounded GM Estimator for Regression

Set-Membership Filtering Subject to Impulsive Measurement Outliers: A Recursive Algorithm

Recursive Least Squares for Censored Regression

An M-Estimator based algorithm for active impulse-like noise control

Robust Adaptive Filtering based on M-estimation-based Minimum Error Entropy Criterion

Random Fourier Features Extended Kernel Recursive Least P-Power Algorithm

One-Bit Recursive Least-Squares Algorithm with Application to Distributed Target Localization

Selecting an Adaptive Sequence for Computing Recursive M-estimators in Multivariate Linear Regression Models

Adaptive filtering based on recursive minimum error entropy criterion

l1 norm‐based recursive estimation for non‐linear systems with non‐Gaussian noises

Proportionate Recursive Maximum Correntropy Criterion Adaptive Filtering Algorithms and their Performance Analysis

Quantized criterion-based kernel recursive least squares adaptive filtering for time series prediction

A New Penalized Recursive Least Squares Method With a Variable Regularization Factor for Adaptive Sparse Filtering.

An Outlier-Robust Kalman Filter With Adaptive Selection of Elliptically Contoured Distributions

PGPAL: A Monotonic Iterative Algorithm for Phase-Retrieval Under the Presence of Poisson-Gaussian Noise

Robust Gradient Estimation Algorithm for a Stochastic System with Colored Noise

A Gaussian-Multivariate Laplacian Mixture Distribution Based Robust Cubature Kalman Filter