Abstract:Highlights • In this paper, we propose an improved minimum error entropy criterion with fiducial points for the high computational complexity of the minimum error entropy criterion with fiducial points (MEEF), and derive a gradient-based adaptive filtering algorithm based on the improved criterion. • We analyze the convergence conditions, transient and steady state behaviors of the proposed algorithm based on statistical properties. • The experimental results show that the proposed algorithm ensures the accuracy of the algorithm while greatly reducing the computational complexity of the algorithm and the correctness of the theoretical model. Recently, there has been a strong interest in the minimum error entropy (MEE) criterion derived from information theoretic learning, which is effective in dealing with the multimodal non-Gaussian noise case. However, the kernel function is shift invariant resulting in the MEE criterion being insensitive to the error location. An existing solution is to combine the maximum correntropy (MC) with MEE criteria, leading to the MEE criterion with fiducial points (MEEF). Nevertheless, the algorithms based on the MEEF criterion usually require higher computational complexity. To remedy this problem, an improved MEEF (IMEEF) criterion is devised, aiming to avoid repetitive calculations of the aposteriori error, and an adaptive filtering algorithm based on gradient descent (GD) method is proposed, namely, GD-based IMEEF (IMEEF-GD) algorithm. In addition, we provide the convergence condition in terms of mean sense, along with an analysis of the steady-state and transient behaviors of IMEEF-GD in the mean-square sense. Its computational complexity is also analyzed. Simulation results demonstrate that the computational requirement of our algorithm does not vary significantly with the error sample number and the derived theoretical model is highly consistent with the learning curve. Ultimately, we employ the IMEEF-GD algorithm in tasks such as system identification, wind signal magnitude prediction, temperature prediction, and acoustic echo cancellation (AEC) to validate the effectiveness of the IMEEF-GD algorithm.

Fixed-Point Minimum Error Entropy With Fiducial Points

Generalized Minimum Error with Fiducial Points Criterion for Robust Learning

Computationally efficient robust adaptive filtering algorithm based on improved minimum error entropy criterion with fiducial points

A Fast Incremental Method Based on Regularized Extreme Learning Machine

Adaptive filtering by minimizing error's entropy power

Minimum Total Error Entropy Method for Parameter Estimation

Adaptive Unscented Kalman Filter under Minimum Error Entropy with Fiducial Points for Non-Gaussian Systems

Restricted Minimum Error Entropy Criterion for Robust Classification

Convex Regularized Recursive Minimum Error Entropy Algorithm

Mean-square convergence analysis of ADALINE training with minimum error entropy criterion.

Robust Adaptive Filtering based on M-estimation-based Minimum Error Entropy Criterion

Understanding the Method of Interval Errors from the Information Theory Perspective

Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy.

Broad learning system based on the quantized minimum error entropy criterion

Cubature Kalman Filter Under Minimum Error Entropy With Fiducial Points for INS/GPS Integration

Dual Extended Kalman Filter under Minimum Error Entropy with Fiducial Points

Generalized Minimum Error Entropy for Adaptive Filtering

Cubature Kalman filter Based on generalized minimum error entropy with fiducial point

Improved Minimum Entropy Filtering for Continuous Nonlinear Non-Gaussian Systems Using a Generalized Density Evolution Equation

A New Interpretation on the MMSE As a Robust MEE Criterion

On Optimal Estimations with Minimum Error Entropy Criterion