Abstract:Highlights • In this paper, we propose an improved minimum error entropy criterion with fiducial points for the high computational complexity of the minimum error entropy criterion with fiducial points (MEEF), and derive a gradient-based adaptive filtering algorithm based on the improved criterion. • We analyze the convergence conditions, transient and steady state behaviors of the proposed algorithm based on statistical properties. • The experimental results show that the proposed algorithm ensures the accuracy of the algorithm while greatly reducing the computational complexity of the algorithm and the correctness of the theoretical model. Recently, there has been a strong interest in the minimum error entropy (MEE) criterion derived from information theoretic learning, which is effective in dealing with the multimodal non-Gaussian noise case. However, the kernel function is shift invariant resulting in the MEE criterion being insensitive to the error location. An existing solution is to combine the maximum correntropy (MC) with MEE criteria, leading to the MEE criterion with fiducial points (MEEF). Nevertheless, the algorithms based on the MEEF criterion usually require higher computational complexity. To remedy this problem, an improved MEEF (IMEEF) criterion is devised, aiming to avoid repetitive calculations of the aposteriori error, and an adaptive filtering algorithm based on gradient descent (GD) method is proposed, namely, GD-based IMEEF (IMEEF-GD) algorithm. In addition, we provide the convergence condition in terms of mean sense, along with an analysis of the steady-state and transient behaviors of IMEEF-GD in the mean-square sense. Its computational complexity is also analyzed. Simulation results demonstrate that the computational requirement of our algorithm does not vary significantly with the error sample number and the derived theoretical model is highly consistent with the learning curve. Ultimately, we employ the IMEEF-GD algorithm in tasks such as system identification, wind signal magnitude prediction, temperature prediction, and acoustic echo cancellation (AEC) to validate the effectiveness of the IMEEF-GD algorithm.

Adaptive filtering by minimizing error's entropy power

Computationally efficient robust adaptive filtering algorithm based on improved minimum error entropy criterion with fiducial points

Robust Constrained Adaptive Filtering under Minimum Error Entropy Criterion

Adaptive Convex Combination Filter under Minimum Error Entropy Criterion

Adaptive FIR Filtering under Minimum Error/Input Information Criterion

Adaptive Filtering Based on Minimum Error Entropy Conjugate Gradient

Robust Adaptive Filtering based on M-estimation-based Minimum Error Entropy Criterion

Mixture Quantized Error Entropy for Recursive Least Squares Adaptive Filtering

Kernel Minimum Error Entropy Algorithm

Adaptive filtering based on recursive minimum error entropy criterion

Generalized Minimum Error Entropy for Adaptive Filtering

A kernel recursive minimum error entropy adaptive filter

Adaptive Filtering with Quantized Minimum Error Entropy Criterion

Fixed-Point Minimum Error Entropy With Fiducial Points

Adaptive filtering under minimum information divergence criterion

Minimum Error Entropy Algorithms With Sparsity Penalty Constraints

On the Smoothed Minimum Error Entropy Criterion.

Sparsity Aware Minimum Error Entropy Algorithms

Adaptive Filtering With Adaptive P-Power Error Criterion

Generalized Minimum Error with Fiducial Points Criterion for Robust Learning

Adaptive Filtering For Desired Error Distribution Under Minimum Information Divergence Criterion