Abstract:Highlights • In this paper, we propose an improved minimum error entropy criterion with fiducial points for the high computational complexity of the minimum error entropy criterion with fiducial points (MEEF), and derive a gradient-based adaptive filtering algorithm based on the improved criterion. • We analyze the convergence conditions, transient and steady state behaviors of the proposed algorithm based on statistical properties. • The experimental results show that the proposed algorithm ensures the accuracy of the algorithm while greatly reducing the computational complexity of the algorithm and the correctness of the theoretical model. Recently, there has been a strong interest in the minimum error entropy (MEE) criterion derived from information theoretic learning, which is effective in dealing with the multimodal non-Gaussian noise case. However, the kernel function is shift invariant resulting in the MEE criterion being insensitive to the error location. An existing solution is to combine the maximum correntropy (MC) with MEE criteria, leading to the MEE criterion with fiducial points (MEEF). Nevertheless, the algorithms based on the MEEF criterion usually require higher computational complexity. To remedy this problem, an improved MEEF (IMEEF) criterion is devised, aiming to avoid repetitive calculations of the aposteriori error, and an adaptive filtering algorithm based on gradient descent (GD) method is proposed, namely, GD-based IMEEF (IMEEF-GD) algorithm. In addition, we provide the convergence condition in terms of mean sense, along with an analysis of the steady-state and transient behaviors of IMEEF-GD in the mean-square sense. Its computational complexity is also analyzed. Simulation results demonstrate that the computational requirement of our algorithm does not vary significantly with the error sample number and the derived theoretical model is highly consistent with the learning curve. Ultimately, we employ the IMEEF-GD algorithm in tasks such as system identification, wind signal magnitude prediction, temperature prediction, and acoustic echo cancellation (AEC) to validate the effectiveness of the IMEEF-GD algorithm.

Robust Constrained Adaptive Filtering under Minimum Error Entropy Criterion

Robust Adaptive Filtering based on M-estimation-based Minimum Error Entropy Criterion

Computationally efficient robust adaptive filtering algorithm based on improved minimum error entropy criterion with fiducial points

Adaptive filtering by minimizing error's entropy power

Constrained maximum correntropy adaptive filtering

Restricted Minimum Error Entropy Criterion for Robust Classification

Adaptive filtering based on recursive minimum error entropy criterion

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Generalized Minimum Error Entropy for Adaptive Filtering

Generalized Minimum Error with Fiducial Points Criterion for Robust Learning

Fixed-Point Minimum Error Entropy With Fiducial Points

Convex Regularized Recursive Minimum Error Entropy Algorithm

Adaptive FIR Filtering under Minimum Error/Input Information Criterion

Adaptive Unscented Kalman Filter under Minimum Error Entropy with Fiducial Points for Non-Gaussian Systems

Improved Minimum Entropy Filtering for Continuous Nonlinear Non-Gaussian Systems Using a Generalized Density Evolution Equation

Research on Robustness of Geometric Algebra Based Adaptive Filtering Algorithms In Non-Gaussian Environment

Steady-state performance analysis for adaptive filters with error nonlinearities

Minimum Total Error Entropy Method for Parameter Estimation

Mean-square convergence analysis of ADALINE training with minimum error entropy criterion.

On Optimal Estimations with Minimum Error Entropy Criterion

Adaptive filtering under minimum information divergence criterion