Abstract:Highlights • In this paper, we propose an improved minimum error entropy criterion with fiducial points for the high computational complexity of the minimum error entropy criterion with fiducial points (MEEF), and derive a gradient-based adaptive filtering algorithm based on the improved criterion. • We analyze the convergence conditions, transient and steady state behaviors of the proposed algorithm based on statistical properties. • The experimental results show that the proposed algorithm ensures the accuracy of the algorithm while greatly reducing the computational complexity of the algorithm and the correctness of the theoretical model. Recently, there has been a strong interest in the minimum error entropy (MEE) criterion derived from information theoretic learning, which is effective in dealing with the multimodal non-Gaussian noise case. However, the kernel function is shift invariant resulting in the MEE criterion being insensitive to the error location. An existing solution is to combine the maximum correntropy (MC) with MEE criteria, leading to the MEE criterion with fiducial points (MEEF). Nevertheless, the algorithms based on the MEEF criterion usually require higher computational complexity. To remedy this problem, an improved MEEF (IMEEF) criterion is devised, aiming to avoid repetitive calculations of the aposteriori error, and an adaptive filtering algorithm based on gradient descent (GD) method is proposed, namely, GD-based IMEEF (IMEEF-GD) algorithm. In addition, we provide the convergence condition in terms of mean sense, along with an analysis of the steady-state and transient behaviors of IMEEF-GD in the mean-square sense. Its computational complexity is also analyzed. Simulation results demonstrate that the computational requirement of our algorithm does not vary significantly with the error sample number and the derived theoretical model is highly consistent with the learning curve. Ultimately, we employ the IMEEF-GD algorithm in tasks such as system identification, wind signal magnitude prediction, temperature prediction, and acoustic echo cancellation (AEC) to validate the effectiveness of the IMEEF-GD algorithm.

Maximum entropy Kalman filter for image reconstruction and compression

Enhancement Algorithm for Infrared Images Based on Kalman Filter

Kernel Minimum Error Entropy Algorithm

Minimum Cross-Entropy Algorithm for Image Reconstruction from Incomplete Projection

A kernel recursive minimum error entropy adaptive filter

Sparsity Aware Minimum Error Entropy Algorithms

Adaptive filtering by minimizing error's entropy power

Graph-Based Minimum Error Entropy Kalman Filtering

Adaptive Convex Combination Filter under Minimum Error Entropy Criterion

Minimum Error Entropy Algorithms With Sparsity Penalty Constraints

Generalized Minimum Error Entropy Kalman Filter for Non-Gaussian Noise.

Improved Minimum Entropy Filtering for Continuous Nonlinear Non-Gaussian Systems Using a Generalized Density Evolution Equation

Extended Kalman Filter Under Maximum Correntropy Criterion

Adaptive Filtering with Quantized Minimum Error Entropy Criterion

Maximum Entropy Function Method for Nonconvex Optimization in Compressed Sensing

Adaptive Filtering Based on Minimum Error Entropy Conjugate Gradient

Weighted information entropy‐based Kalman filter for outliers and structural noise

Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy.

Robust Constrained Adaptive Filtering under Minimum Error Entropy Criterion

Computationally efficient robust adaptive filtering algorithm based on improved minimum error entropy criterion with fiducial points

Perceptual Kalman Filters: Online State Estimation under a Perfect Perceptual-Quality Constraint