Abstract:Highlights • In this paper, we propose an improved minimum error entropy criterion with fiducial points for the high computational complexity of the minimum error entropy criterion with fiducial points (MEEF), and derive a gradient-based adaptive filtering algorithm based on the improved criterion. • We analyze the convergence conditions, transient and steady state behaviors of the proposed algorithm based on statistical properties. • The experimental results show that the proposed algorithm ensures the accuracy of the algorithm while greatly reducing the computational complexity of the algorithm and the correctness of the theoretical model. Recently, there has been a strong interest in the minimum error entropy (MEE) criterion derived from information theoretic learning, which is effective in dealing with the multimodal non-Gaussian noise case. However, the kernel function is shift invariant resulting in the MEE criterion being insensitive to the error location. An existing solution is to combine the maximum correntropy (MC) with MEE criteria, leading to the MEE criterion with fiducial points (MEEF). Nevertheless, the algorithms based on the MEEF criterion usually require higher computational complexity. To remedy this problem, an improved MEEF (IMEEF) criterion is devised, aiming to avoid repetitive calculations of the aposteriori error, and an adaptive filtering algorithm based on gradient descent (GD) method is proposed, namely, GD-based IMEEF (IMEEF-GD) algorithm. In addition, we provide the convergence condition in terms of mean sense, along with an analysis of the steady-state and transient behaviors of IMEEF-GD in the mean-square sense. Its computational complexity is also analyzed. Simulation results demonstrate that the computational requirement of our algorithm does not vary significantly with the error sample number and the derived theoretical model is highly consistent with the learning curve. Ultimately, we employ the IMEEF-GD algorithm in tasks such as system identification, wind signal magnitude prediction, temperature prediction, and acoustic echo cancellation (AEC) to validate the effectiveness of the IMEEF-GD algorithm.

A Joint Stochastic Gradient Algorithm And Its Application To System Identification With Rbf Networks

Application of Gradient Radial Basis Function Network in the Modeling of MEMS Gyro's Random Drift

Computationally efficient robust adaptive filtering algorithm based on improved minimum error entropy criterion with fiducial points

Mean-square convergence analysis of ADALINE training with minimum error entropy criterion.

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Modelling of Electrohydraulic System Using RBF Neural Networks and Genetic Algorithm

Adaptive Neural Dynamic Surface Control With Prespecified Tracking Accuracy of Uncertain Stochastic Nonstrict-Feedback Systems

An efficient non-negative least mean squares algorithm based on q-gradient for system identification

Multi-innovation stochastic gradient identification method

Efficient Identification Of Rbf Neural-Net Models For Nonlinear Discrete-Time Multivariable Dynamical-Systems

Stochastic gradient identification of Wiener system with maximum mutual information criterion

Robust Gradient Estimation Algorithm for a Stochastic System with Colored Noise

Fixed-Point Minimum Error Entropy With Fiducial Points

Data Filtering-Based Multi-innovation Stochastic Gradient Algorithm for Nonlinear Output Error Autoregressive Systems

A Qualitative Study of the Dynamic Behavior for Adaptive Gradient Algorithms

Adaptive FIR Filtering under Minimum Error/Input Information Criterion

Generalized Minimum Error with Fiducial Points Criterion for Robust Learning

Robust Adaptive Filtering based on M-estimation-based Minimum Error Entropy Criterion

Hierarchical Stochastic Gradient Algorithm and its Performance Analysis for a Class of Bilinear-in-Parameter Systems

The Growing Radial Basis Function (RBF) Neural Network and Its Applications.

Gradient Compared Lp-LMS Algorithms for Sparse System Identification