Abstract:Renyi's entropy, as a crucial similarity measure of information quantity, is the cornerstone of the minimum error entropy (MEE) criterion. However, the conventional MEE cost had to employ a computationally feasible estimator to approximate the error entropy directly from the data samples, which could be contaminated by large interference outliers, and the performance of MEE could deteriorate in the presence of complex non-Gaussian noises. To address this problem, utilizing the robust statistical properties of M-estimation, the M-estimators are introduced to the MEE criterion by down-weighting or discarding large error residuals; we can then proceed to obtain a more accurate Renyi's-entropy estimator compared to the empirical form under the recalculated error distribution. This innovative approach could be simply implemented while ensuring great robustness. Therefore, a robust adaption criterion called the M-estimation-based minimum error entropy (MMEE), and its corresponding adaptive filtering algorithm are proposed that detect and bound the influence of outliers in non-Gaussian noise. In addition, the mean stability and steady-state performance of the proposed MMEE are evaluated, furthermore, we theoretically prove that the MMEE algorithm could achieve lower steady-state error than MEE under the same conditions. Simulation results verify our theoretical predictions, and demonstrate the superiority and robustness of the MMEE algorithm compared with several existing robust filtering algorithms for restraining various non-Gaussian noises.

Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion

Steady-state performance analysis for adaptive filters with error nonlinearities

Excess MSE Analysis of the Concurrent Constant Modulus Algorithm and Soft Decision-Directed Scheme for Blind Equalisation

Constrained maximum correntropy adaptive filtering

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Robust Constrained Adaptive Filtering under Minimum Error Entropy Criterion

Newtonian-Type Adaptive Filtering Based on the Maximum Correntropy Criterion

Convergence of a Fixed-Point Algorithm under Maximum Correntropy Criterion

Kernel Adaptive Filtering with Maximum Correntropy Criterion

An Adaptive Channel Estimation Based on Fixed-Point Generalized Maximum Correntropy Criterion

Proportionate Recursive Maximum Correntropy Criterion Adaptive Filtering Algorithms and their Performance Analysis

Sparsity-Aware Recursive Maximum Correntropy Criteria Adaptive Filtering Algorithm

Convergence Performance Analysis of an Adaptive Kernel Width MCC Algorithm

Maximum correntropy criterion based sparse adaptive filtering algorithms for robust channel estimation under non-Gaussian environments

A Smoothed Algorithm with Convergence Analysis under Generalized Maximum Correntropy Criteria in Impulsive Interference

Convex Combination Of Multiple Adaptive Filters Under The Maximum Correntropy Criterion

A variable step-size adaptive algorithm under maximum correntropy criterion

Adaptive Convex Combination Filter under Minimum Error Entropy Criterion

Complex Correntropy with Variable Center: Definition, Properties, and Application to Adaptive Filtering

Robust Adaptive Filtering based on M-estimation-based Minimum Error Entropy Criterion

An Adaptive Kernel Width Update Method of Correntropy for Channel Estimation