A Modified LMS Algorithm for Second-Order Volterra Filter

刘岚,胡钋,韩进能

DOI: https://doi.org/10.3321/j.issn:1000-436x.2002.06.018

2002-01-01

Abstract:A new LMS algorithm for identifying second-order systems is presented. Numerical simulation shows it has shorter calculation time and converges faster than faster Kalman filter.

What problem does this paper attempt to address?

Recursive Maximum Correntropy Algorithms for Second-Order Volterra Filtering

Ji Zhao,J. Andrew Zhang,Qiang Li,Hongbin Zhang,Xueyuan Wang

DOI: https://doi.org/10.1109/tcsii.2021.3064946

2022-01-01

Abstract:As a special case of the Volterra system, the second-order Volterra (SOV) filter is very efficient for nonlinear system identification. The improved correntorpy based on the generalized Gaussian density function has been proven robust against impulsive noise. In this brief, we propose several SOV filters based on a recursive maximum correntropy (RMC) algorithm for nonlinear system identification. We first introduce a basic RMC algorithm, which faces a trade-off between filtering accuracy and tracking capability due to the use of a fixed forgetting factor (FFF). Two RMCs with variable FF (VFF) are further proposed to enhance the tracking ability. Simulation results demonstrate that our proposed algorithms outperform existing ones in impulsive noise environments and/or in time-varying systems.
Modified Strong Tracking Kalman Filter Based on Logic Switching

柯晶,钱积新

DOI: https://doi.org/10.3321/j.issn:0372-2112.2002.06.042

2002-01-01

Abstract:A modified strong tracking Kalman filter (MSTKF) for linear stochastic systems is proposed.By changing the multiple time-varying fading factors of the strong tracking filter,MSTKF switches between Kalman filtering and strong tracking filtering.When Kalman filtering cannot track efficiently the state with abrupt changes,MSTKF switches to strong tracking filtering with varying softening factor.A numerical simulation example is given to show the effectiveness of the method.
Recursive Geman–McClure Estimator for Implementing Second-Order Volterra Filter

Lu,Wenyuan Wang,Xiaomin Yang,Wei Wu,Guangya Zhu

DOI: https://doi.org/10.1109/tcsii.2018.2875039

2018-01-01

IEEE Transactions on Circuits & Systems II Express Briefs

Abstract:The second-order Volterra (SOV) filter is a powerful tool for modeling the nonlinear system. The Geman-McClure estimator, whose loss function is non-convex and has been proven to be a robust and efficient optimization criterion for learning system. In this brief, we present a SOV filter, named SOV recursive Geman-McClure, which is an adaptive recursive Volterra algorithm based on the Geman-McClure estimator. The mean stability and mean-square stability (steady-state excess mean square error) of the proposed algorithm is analyzed in detail. Simulation results support the analytical findings and show the improved performance of the proposed new SOV filter as compared with existing algorithms in both Gaussian and impulsive noise environments.
A Modified LMS Algorithm

Liu Yingdong,Liu Lan

2007-01-01

Abstract:Based on the study of some algorithm of variable step size LMS,momentum factor is presented and a new modified LMS algorithm is proposed.In the whole,the new algorithm is superior to the original.The theoretic analysis and computer simulation results show that the new algorithm gets significant improvements in the speed of convergence and better tracking capability.
A DFP-method-based Second-Order Volterra Filter and Its Application to Chaotic Time Series Prediction

张玉梅,吴晓军,白树林

DOI: https://doi.org/10.1360/132012-734

2013-01-01

Abstract:In order to overcome problems caused by improper parameters selection when applying Least Mean Square (LMS), Normalized LMS (NLMS) or Recursive Least Square (RLS) algorithms to estimate coefficients of second-order Volterra filter, a Davidon-Fletcher-Powell (DFP)-method-based second-order Volterra filter (DFPSOVF) has been proposed, which is based on a posteriori error assumption and is characteristic of variable convergence factor. Recursive update formulation of the inverse of auto-correlation matrix and analysis of computational complexity for the DFPSOVF filter are presented. Simulations, which apply DFPSOVF filter to single step predictions for Lorenz chaotic time series in pure and different signal-to-noise ratio (SNR) as well as real measured chaotic temperature series, illustrate that the proposed filter can guarantee its stability and convergence and there havent divergence problems using LMS and NLMS algorithms.
Performance Analysis of a Novel Variable Step Size LMS Algorithm

朱斌,马艳

DOI: https://doi.org/10.3969/j.issn.1006-9348.2008.09.024

2008-01-01

Abstract:The least mean square(LMS) algorithm is abroad applied in the field of adaptive filter dealing with simply computation and easy realized.However,the insistency between convergence speed and steady state error is difficult to be solved by the fixed step-size LMS.By using non-linear function,a novel variable step-size LMS algorithm is presented in this paper.The results of computer simulation show that the better convergence and smaller steady state error will be obtained through the algorithm.
A Low-Complexity Volterra Filtered-Error LMS Algorithm with a Kronecker Product Decomposition

Jinhui Zhang,Chengshi Zheng,Fangjie Zhang,Xiaodong Li

DOI: https://doi.org/10.3390/app11209637

2021-01-01

Applied Sciences

Abstract:Nonlinear active control is very important in many practical applications. Many well-known nonlinear active noise control algorithms may suffer from high computational complexity and low convergence speed, especially in the nonlinear secondary path case. Thus, it is still an actively researched topic for reducing complexity and improving the convergence rate. This paper presents a low-complexity Volterra filtered-error least mean square algorithm when taking a decomposable Volterra model into account for active control of nonlinear noise processes, which is referred as DVMFELMS. The computational complexity analysis shows that the proposed DVMFELMS algorithm can significantly reduce the nonlinear active noise control system’s complexity. The simulation results further show that the proposed algorithm can achieve promising performance compared with the Volterra-based FELMS algorithm and other state-of-the-art nonlinear filters, while the decomposable error of the Volterra kernel may be introduced inevitably. Moreover, the proposed DVMFELMS algorithm shows a better convergence rate in the broadband primary noise case due to fewer parameters used in each sub-filter.
A Novel Second-Order Dfp-Based Volterra Filter and Its Applications to Chaotic Time Series Prediction

Zhang Yumei,Bai Shulin,Chen Ping,Qu Shiru

2012-01-01

Abstract:A novel adaptive second-order Volterra filter based on Davidon-Fletcher-Powell (DFPSOVF) technique has been proposed. Recursive update formula of the inverse estimate of auto-correlation matrix in the DFPSOVF filter is presented. In order to avoid some problems caused by using LMS, NLMS or RLS algorithms, a variable convergence factor based on a posteriori error assumption, which can change with input signal changes in real time, is employed. Simulations, which apply the DFPSOVF filter to single step predictions for Rössler chaotic series and compare its results with those using LMS and NLMS algorithms to SOVF filter, respectively, illustrate that the proposed filter can always guarantee its stability and convergence and there haven't divergence problems caused by selecting inappropriate parameters with LMS and NLMS algorithms. Key Words: Volterra filter, Davidon-Fletcher-Powell, chaotic time series, prediction, variable convergence factor.
STUDY ON FILTERED X-LMS ALGORITHM

LI Jia-quan,WANG Yong

DOI: https://doi.org/10.3969/j.issn.1000-3835.2008.03.002

2008-01-01

Abstract:Damping characteristics of secondary path have great effect on stability and convergence rate of filtered x-LMS algorithm. The effect is studied by giving a theorem, which is then proved. On this basis , a damping compensation subsystem for secondary path is presented to improve the performance of filtered x-LMS algorithm. To achieve it, the two-parameters configuration implementation method is widened to discrete system with sampling delay, and the design of damping compensation subsystem is provided, which is then added into the standard algorithm as an inner loop to form a new filtered x-LMS algorithm. A cantilever is taken as simulated object, for the purpose of controling its second-mode vibration by the method provided in the paper. Simulation results show that the new algorithm is capable of suppressing the second-mode vibration of cantilever in far less time then the standard one and reveal improvement of algorithm stability.
Total Least Square Algorithm and Its Application to Volterra Filter

孔祥玉,韩崇昭,马红光,魏瑞轩

DOI: https://doi.org/10.3321/j.issn:0253-987X.2004.04.003

2004-01-01

Abstract:Aiming at the filter problem that exists when the input and output signal are both corrupted by noise , a robust total least square adaptive algorithm is proposed. Taking the minimum Rayleigh quotient as the loss function , the recur2 sive formula of weight vector is derived , the stochastic discrete laws are applied to the analysis of the rule of the norm of the weight vector and the gradient is modified , and the robust anti2noise performance is improved. The algorithm is more simple and has excellent stability and high accuracy. The algorithm is applied to the Volterra filter ; it still keeps nice convergent performance in the nonlinear systems even when the signal2noise2ratio is 10dB and learning rate is 0. 01. The simulation results have also shown that , the robust anti2noise performance and the stable convergence precision of the pro2 posed algorithm are remarkably better than other total least square adaptive algorithms when the signal2noise2ratio is lower or a larger learning factor is used.
Collaborative Adaptive Volterra Filters for Nonlinear System Identification in Α-Stable Noise Environments

Lu,Haiquan Zhao,Badong Chen

DOI: https://doi.org/10.1016/j.jfranklin.2016.08.025

IF: 4.246

2016-01-01

Journal of the Franklin Institute

Abstract:The least mean pth power (LMP) and normalized LMP (NLMP) algorithms of adaptive Volterra filter have been successfully developed for nonlinear system identification in α-stable noise environments. However, there exists an inherent tradeoff between the convergence rate and steady-state performance. To address this compromise, a collaborative adaptive Volterra filter based on the convex combination scheme is proposed under the α-stable noise in this paper. By utilizing the convex combination which performs at least as well as the best component filter, the proposed algorithms achieve fast convergence rate and small misadjustment. Furthermore, by following a frame of the generalized combination scheme, two novel combination structures of Volterra filter are presented. Simulations in nonlinear system identification contexts demonstrate that the performances of the proposed algorithms are superior to the existing algorithms under the α-stable noise in terms of the convergence speed and steady state kernel error.
Modified LMS Adaptive Filtering Algorithm Based on Correlation Function

ma yingbo,wu yafeng,yang xinbo

DOI: https://doi.org/10.19708/j.ckjs.2018.03.018

2018-01-01

Abstract:The standard LMS algorithm adopts a fixed step factor, resulting in large steady-state error and poor real-time. performance, which is not suitable for non-stationary stochastic processes. A modified CLMS variable step size adaptive filtering algorithm is proposed, which uses the cross-correlation function of input-error signal to control the step size update. A relatively large step size at the initial convergence of the algorithm is taken for fast real-time tracking and a relatively small step size at the end of convergence of the algorithm is taken for minor steady-state error. The simulation results show that the CLMS algorithm has better application performance than the existing variable step size algorithms.
Simplified Volterra Series Identification Method Based on BLMS Filter

ZHANG Hua-jun,HAN Chong-zhao

DOI: https://doi.org/10.3969/j.issn.1004-731x.2006.08.069

2006-01-01

Abstract:Volterra series identification often suffers from the so called ‘dimension disaster’ because the scale of Volterra kernels expand exponentially with the increasing of system’s order and degree.In order to solve this difficulty,a simplified identification method based on Block Least Mean Square(BLMS) filter was proposed.By means of this method,the concept of the effect index was introduced in order to reduce the scale of Volterra kernels by selecting them according to the degree of their effectiveness in identification.This method is suitable for Volterra identification on line and its effectiveness has been validated by an engineering instance.
New Results on ℒ 2 −ℒ ℞ Filter Design for Delayed Stochastic Systems by Delay Decomposition Approach

Wang, Wenqin,Shouming Zhong,Nguang, Sing Kiong,Liu, Feng

2012-01-01

Abstract:This paper investigates the new results on ℒ 2 −ℒ ℞ filter design for delayed stochastic systems by delay decomposition approach. Based on the Lyapunov functional method, sufficient condition are obtained to ensure the error systems are mean-square asymptotically stable. Then the ℒ 2 −ℒ ℞ filters are designed in terms of linear matrix inequalities (LMIs). In order to develop less conservative results, a new integral inequality is established in the stochastic setting. Because we have carefully considered the ranges for the time-varying delays, our criteria can be applicable to both fast and slow time-varying delays. Meanwhile, by dividing the time-varying delays into multiple nonuniformly subintervals and choosing an appropriate Lyapunov functional, new delay-dependent stability criteria are obtained and formulated in terms of LMIs which can be easily checked in practice. Finally, a example is given to illustrate the effectiveness and advantages of the proposed results.
A Robust Filtered-X LMS Algorithm for Active Vibration Control

Yong Wang,Zhihao Fu,Xiaojian Li,Jinwen Pan,Shaoqing Chen

DOI: https://doi.org/10.1109/icmc.2014.7231563

2014-01-01

Abstract:In this paper, a new robust filtered-x LMS algorithm is proposed for active vibration control system. A Tracking-Differentiator filter and a non-linear transformation function are designed to process the reference and error signals respectively. The updating formula of the filter coefficients in the proposed algorithm is derived from a new minimization criterion that minimizes the Euclidean norm of difference between the currently innovation vector and past vector. Compared with the existed algorithms, the proposed algorithm is more robust against interference to reference signals. Numerical simulation results show the effectiveness of the algorithm.
A Universal Modified LMS Algorithm with Iteration Order Hybrid Switching.

Songsong Cheng,Yiheng Wei,Yuquan Chen,Shu Liang,Yong Wang

DOI: https://doi.org/10.1016/j.isatra.2016.11.019

IF: 7.3

2016-01-01

ISA Transactions

Abstract:This paper presents a fractional order modified least square algorithm(FOMLMS), which involves an iteration order switch strategy. A FOMLMS scheme whose iteration order can be extended into α∈(0,2) is investigated. The performance of FOMLMS with the iteration order in different interval (0<α<1or1<α<2) is separately analyzed. It turns out that, both of a larger iteration order (0<α<2) and iteration step size can always result in a faster response speed and convergence speed. Therefore, in order to obtain a satisfying convergence speed without sacrificing other performance, a hybrid switch law of iteration order is naturally developed. Finally, the validity of this proposed algorithm is illustrated by three numerical examples.
Iteration-based Variable Step-size LMS Algorithm and Its Performance Analysis

Jian-cheng Liu,Hong-zhi Zhao,Hou-de Quan,You-xi Tang

DOI: https://doi.org/10.11999/JEIT141501

2015-01-01

Abstract:The Iteration-based Variable Step-Size LMS (IVSSLMS) algorithm is proposed to overcome the compromise between the convergence speed and the steady-state misadjustment error, which can’not be handled in Fixed Step-Size LMS algorithm (FXSSLMS). This algorithm is different from other Variable Step-Size LMS (VSSLMS) algorithms, since its step-size is not controlled by the error signal but the iteration time. In the other words, a modified Logistic-function nonlinear relationship is constructed between the iteration time and the step-size to conquer the slow convergence speed of the FXSSLMS and interference of the current VSSLMS. Finally, the performance and parameters settings of the proposed algorithm are analyzed. The theoretical analysis and simulations verify that the proposed algorithm has not only faster convergence speed but also smaller misadjustment error. The misadjustment error of this algorithm, with color noise interfering, is 7 dB less than existing methods.
New results on L 2 ∞ filter design for delayed stochastic systems by delay decomposition approach

Wenqin Wang,Shouming Zhong,Sing Kiong Nguang,Feng Liu

2012-01-01

Abstract:This paper investigates the new results on 2∞ filter design for delayed stochastic systems by delay decomposition approach. Based on the Lyapunov functional method, sufficient condition are obtained to ensure the error systems are mean-square asymptotically stable. Then the 2∞ filters are designed in terms of linear matrix inequalities (LMIs). In order to develop less conservative results, a new integral inequality is established in the stochastic setting. Because we have carefully considered the ranges for the time-varying delays, our criteria can be applicable to both fast and slow time-varying delays. Meanwhile, by dividing the time-varying delays into multiple nonuniformly subintervals and choosing an appropriate Lyapunov functional, new delay-dependent stability criteria are obtained and formulated in terms of LMIs which can be easily checked in practice. Finally, a example is given to illustrate the effectiveness and advantages of the proposed results. © 2012 Huazhong Univ of Sci & Tec.
A Novel Variable Step-Size LMS Adaptive Filtering Algorithm Based on Lorentzian Function

刘剑锋,蒋卓勤,李娟,霍效新

DOI: https://doi.org/10.3969/j.issn.1673-3819.2009.02.011

2009-01-01

Abstract:In order to ameliorate LMS algorithm’s flaw, accelerate the convergence rate and improve the tracking performance, a novel variable step-size LMS adaptive filtering algorithm based on Lorentzian function is proposed. In this algorithm, a nonlinear function relationship between μ(n) and the error signal e(n) is established by using the Lorentzian function aiming to improve the convergence rate and ameliorate the tracking performance. Computer simulations demonstrate that the performance of the proposed algorithm is better than that of LMS algorithm.
A DFP-Based Second-Order Volterra Model with Applications to R?ssler Chaotic Series Prediction

Yu-mei ZHANG,Xiao-jun WU,Shu-lin BAI

DOI: https://doi.org/10.3969/j.issn.0372-2112.2014.09.021

2014-01-01

Abstract:To overcome problems caused by improper parameters selection when least mean square (LMS )or normalized LMS(NLMS)method is apphied to model second-order Volterra ,based on the LMS method ,a novel Davidon-Fletcher-Powell (DFP )-method-based second-order Volterra filter (DFPSOVF )was proposed ,which is based on a posteriori error assumption and is characteristic of a variable convergence factor .Recursive update formulation positive definiteness and bounded property of the in-verse autocorrelation matrix estimation ,role of τ( n ) of DFPSOVF model are studied .Simulations ,which apply DFPSOVF model to single step predictions for R?ssler chaotic time series ,illustrate that the proposed algorithm can guarantee its stability and conver-gence and there haven’t divergence problems using LMS and NLMS algorithms .

A Modified LMS Algorithm for Second-Order Volterra Filter

Recursive Maximum Correntropy Algorithms for Second-Order Volterra Filtering

Modified Strong Tracking Kalman Filter Based on Logic Switching

Recursive Geman–McClure Estimator for Implementing Second-Order Volterra Filter

A Modified LMS Algorithm

A DFP-method-based Second-Order Volterra Filter and Its Application to Chaotic Time Series Prediction

Performance Analysis of a Novel Variable Step Size LMS Algorithm

A Low-Complexity Volterra Filtered-Error LMS Algorithm with a Kronecker Product Decomposition

A Novel Second-Order Dfp-Based Volterra Filter and Its Applications to Chaotic Time Series Prediction

STUDY ON FILTERED X-LMS ALGORITHM

Total Least Square Algorithm and Its Application to Volterra Filter

Collaborative Adaptive Volterra Filters for Nonlinear System Identification in Α-Stable Noise Environments

Modified LMS Adaptive Filtering Algorithm Based on Correlation Function

Simplified Volterra Series Identification Method Based on BLMS Filter

New Results on ℒ 2 −ℒ ℞ Filter Design for Delayed Stochastic Systems by Delay Decomposition Approach

A Robust Filtered-X LMS Algorithm for Active Vibration Control

A Universal Modified LMS Algorithm with Iteration Order Hybrid Switching.

Iteration-based Variable Step-size LMS Algorithm and Its Performance Analysis

New results on L 2 ∞ filter design for delayed stochastic systems by delay decomposition approach

A Novel Variable Step-Size LMS Adaptive Filtering Algorithm Based on Lorentzian Function

A DFP-Based Second-Order Volterra Model with Applications to R?ssler Chaotic Series Prediction