Sliding Window Delta Operator-Based Adaptive Lattice Filters

Weihua Li

1998-01-01

Abstract:The detailed procedure to derive a sliding window delta operator-based adaptive lattice filter algorithm is illustrated based on the least squares geometric projection approach in this paper. Applications of this filter to system identification[1] and parameter change detection[2] have been addressed.

What problem does this paper attempt to address?

A recursive adaptive lattice filters for impulsive signals

Sen Li,Tiang Shuang Qiu,Bin Lin,Dian W. Yu

DOI: https://doi.org/10.1109/pacrim.2005.1517289

2005-01-01

Abstract:The existence of impulsive noise with alpha-stable distributions has been addressed in many applications. Some adaptive lattice algorithms that factional lower order moments of residual errors are used to updated the filter coefficients are presented. In this paper, a new recursive adaptive lattice algorithm is proposed for adaptive filtering of alpha-stable AR processes. The performance of this algorithm is compared to that of those stochastic gradient-based algorithms. It is shown that the proposed algorithm achieves a superior convergence speed with respect to the other algorithms. © 2005 IEEE.
Lms and Frls 2-D Lattice Filters

X LIU,M NAJIM,M JANATI,H YOULAL

DOI: https://doi.org/10.1016/s1474-6670(17)50781-8

1992-01-01

IFAC Proceedings Volumes

Abstract:In this paper we examine the two-dimensional extensions of some popular adaptive lattice filters. Adaptation is based on either the normalized least mean squares "NLMS" or the fast recursive least squares "FRLS" algorithms. These algorithms can update the filter coefficients in growing-order form with a moderate computational complexity. Derivation of the 2-D adaptive lattice "TDAL-NLMS" algorithm is straightforward, ones the 2-D lattice structure has been appropriately defined. The causality is first specified by associating the past 2-D data with the region of support. Then by appropriately defining the partial order of 2-D data, order recursion relations are obtained. In case of the FRLS algorithm we also make use of the 1-D multichannel analogy to derive the order recursion relations and the shift invariance property. The corresponding 2-D prediction problem is solved using the geometrical approaches of the vector space and the orthogonal projection. To compare the performances of these algorithms we consider first an adaptive estimation problem, then the implementation of the 2-D joint process lattice "TDJPL" filters for adaptive restoration of noisy images. Performance evaluation of LMS and FRLS based noise cancelling filters was done using artificially degraded image data at different signal to noise "SNR" ratio. The results show that higher improvement with the FRLS lattice filters can be expected .
Normalized sliding window covariance lattice filter. An efficient fault detection tool

Deyun Xiao,Weihua Li,Chongzhi Fang

1995-01-01

Abstract:A new RLS lattice filter, which is based on the normalized sliding window covariance (NSWC) algorithm, is presented. And with the help of the filter, a novel fault detector is constructed. First of all, signal vector and signal matrix of Hilbert space are defined, and the normalized residual vecrtors and partial correlation coefficient are described. Then, the equations of the filter algorithm are derived by use of the orthogonal projection approach in vector space. By testing whiteness of the forward or backward prediction error, the real time fault detection is carried out. Finally, simulation example is given to justify the effectiveness of this fault detection methodology. Simulation results show that the fault detector has many advantages such as the mathmatical model needless of the monitored system, less computation and lower probability of wrongly alarming.
QR-based Least Mean Squares Algorithm Using the Delta Operator

LIU Xia,ZHANG Duan-jin,JIANG Ling-ge,TIAN Jin-peng

DOI: https://doi.org/10.3321/j.issn:1001-506x.2005.09.036

2005-01-01

Abstract:The problem of the delta operator based adaptive filtering is considered. The algorithm and the performance analysis of QR-decomposition least mean squares using delta operator (Delta-QR-LMS) are presented. Simulation examples are given to demonstrate that the Delta-QR-LMS algorithm has the better filtering performance and the faster convergence speed than that of LMS algorithm.
Modified Adaptive Lattice Notch Filter

张世平,赵永平,张绍卿,李德胜

DOI: https://doi.org/10.3321/j.issn:0367-6234.2003.08.025

2003-01-01

Abstract:The relationship between coefficients and regressor is detailed based on the theoretical analysis. Ac- cording to the deduced convergence equation, a modified algorithm is put forward by using the global error sig- nal as the regressor. This algorithm has a reduced bias of the notch frequency in comparison to the convention- al algorithm and employs the same number of multipliers and adders. Simulation results confirm the theoretical analysis.
An Adaptive L-Filter Based on Signal Local Statistics

郭炳庆,卢强,黎雄

DOI: https://doi.org/10.3321/j.issn:0372-2112.2001.07.013

2001-01-01

Abstract:In this paper,An adaptive L-filtering algorithm and its deterministic properties are discussed.Differentiating from the several proposed adaptive L-filtering algorithms based on the signal to noise ratio,the new algorithm adjusts parameters of the L-filter adaptively according to properties of time-varying signals.Theoretical analysis and simulation show that the algorithm is very efficient for edge preservation.
Adaptive Hammerstein Filtering Via Recursive Non-Convex Projection

Zhaoting Liu,Chunguang Li

DOI: https://doi.org/10.1109/tsp.2022.3180195

IF: 4.875

2022-01-01

IEEE Transactions on Signal Processing

Abstract:Hammerstein model with a static nonlinearity followed by a linear filter is commonly used in numerous applications. This paper focuses on adaptive filtering techniques for parameter identification of Hammerstein systems and output prediction of nonlinear systems. By formulating the underlying filtering problem as a recursive bilinear least-squares optimization with the non-convex feasible region constraint, we develop a recursive non-convex projected least-squares (RncPLS) algorithm based on alternating direction method of multipliers (ADMM). The RncPLS algorithm alternates between implementing ridge regression and projecting on the non-convex feasible set, which successively refines the system parameters. The convergence and accuracy properties of the proposed RncPLS algorithm are theoretically investigated. Moreover, extensive simulation results in the context of system identification, nonlinear predication, and acoustic echo cancellation, are also included to demonstrate the performance characteristics of the proposed algorithm.
A Modified Adaptive Algorithm of Lattice Notch Filter and Its Convergence Analysis

张世平,赵永平,张绍卿,李德胜

DOI: https://doi.org/10.3321/j.issn:0372-2112.2004.02.038

2004-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:The existing adaptive lattice notch filter whose regressor is got from local error signal has a bias of the notch frequency after convergence of iterative procedure, and the effectiveness of filtering is not desired. This paper discusses about adaptive algorithm of cascaded lattice notch filter. Analyzing the relationship between coefficients estimated and regressor, a modified adaptive algorithm is proposed according to the deduced expectation equation of iterative error. Without additional computation, this algorithm has a reduced bias in the estimation of notch frequency, which is exhibited in former algorithms. Simulation results confirm the theoretical analysis and demonstrate the convergence of the algorithm is better than that of former algorithms.
Lattice Form Adaptive Infinite Impulse Response Filtering Algorithm for Active Noise Control.

J Lu,CH Shen,XJ Qiu,BL Xu

DOI: https://doi.org/10.1121/1.1529665

2003-01-01

Abstract:In some situations of active noise control, infinite impulse response (IIR) filters are more suitable than finite impulse response (FIR) filters owing to the poles in the transfer function. A number of algorithms have been derived for applying IIR filters in active noise control; however, most of them use the direct form IIR filter structure, which faces the difficulties of checking stability and relatively slow convergence speed for noise composed of narrow-band components with large power disparity. To overcome these difficulties along with using the direct form IIR filters, a new adaptive algorithm is proposed in this paper, which uses and updates the lattice form adaptive IIR filter in an active noise control system. Full mathematical derivations of the proposed algorithm are presented, and the comparison between the proposed algorithm and the commonly used filtered-u LMS and filtered-v LMS algorithms shows the superiority of the proposed algorithm.
A Novel Algorithm of Adaptive IIR Lattice Notch Filter and Performance Analysis

Qin Peng,Cai Ping

DOI: https://doi.org/10.1007/s11741-007-0509-2

2007-01-01

Journal of Shanghai University (English Edition)

Abstract:A novel adaptive algorithm of IIR lattice notch filter realized by all-pass filter is presented. The time-averaged estimation of cross correlation of the present instantaneous input signal and the past output signal is used to update the step-size, leading to a considerably improved convergence rate in a low SNR situation and reduced steady-state bias and MSE. The theoretical expression for steady-state bounds on the step-size is derived, and the influence factors on the stable performance of the algorithm theoretically are analyzed. A normalized power factor is then introduced to control variation of step-size in its steady-state bounds. This technique prevents divergence due to the influence of large power input signal and improves robustness. Numerical experiments are performed to demonstrate superiority of the proposed method.
Sliding Window Iterative Identification for Nonlinear Closed‐Loop Systems Based on the Maximum Likelihood Principle

Lijuan Liu,Fu Li,Wei Liu,Huafeng Xia

DOI: https://doi.org/10.1002/rnc.7705

IF: 3.8973

2024-11-02

International Journal of Robust and Nonlinear Control

Abstract:The parameter estimation problem for the nonlinear closed‐loop systems with moving average noise is considered in this article. For purpose of overcoming the difficulty that the dynamic linear module and the static nonlinear module in nonlinear closed‐loop systems lead to identification complexity issues, the unknown parameters from both linear and nonlinear modules are included in a parameter vector by use of the key term separation technique. Furthermore, an sliding window maximum likelihood least squares iterative algorithm and an sliding window maximum likelihood gradient iterative algorithm are derived to estimate the unknown parameters. The numerical simulation indicates the efficiency of the proposed algorithms.

automation & control systems,engineering, electrical & electronic,mathematics, applied
DSP Realization of LMS Adaptive Filter

Zhang Huisheng,Yan Xuebin,Qin Yong,Huang He

DOI: https://doi.org/10.3969/j.issn.1009-8054.2006.10.037

2006-01-01

Abstract:This paper introduces the structure of the Adaptive Filter and LMS Algorithm firstly. Based on the simula- tion in matlab language, an implement scheme founded on the hardware platform composed of advanced SY-VC5402EVM is presented, and analyses the results.
Learning-Augmented Frequency Estimation in Sliding Windows

Rana Shahout,Ibrahim Sabek,Michael Mitzenmacher

2024-09-18

Abstract:We show how to utilize machine learning approaches to improve sliding window algorithms for approximate frequency estimation problems, under the ``algorithms with predictions'' framework. In this dynamic environment, previous learning-augmented algorithms are less effective, since properties in sliding window resolution can differ significantly from the properties of the entire stream. Our focus is on the benefits of predicting and filtering out items with large next arrival times -- that is, there is a large gap until their next appearance -- from the stream, which we show improves the memory-accuracy tradeoffs significantly. We provide theorems that provide insight into how and by how much our technique can improve the sliding window algorithm, as well as experimental results using real-world data sets. Our work demonstrates that predictors can be useful in the challenging sliding window setting.

Data Structures and Algorithms,Machine Learning
Fast Recursive Least Squares Adaptive Filtering by Fast Fourier Transform-Based Conjugate Gradient Iterations

Michael K. Ng,Robert J. Plemmons

DOI: https://doi.org/10.1137/0917060

IF: 2.968

1996-07-01

SIAM Journal on Scientific Computing

Abstract:Recursive least squares (RLS) estimations are used extensively in many signal processing and control applications. In this paper we consider RLS with sliding data windows involving multiple (rank k) updating and downdating computations. The least squares estimator can be found by solving a near-Toeplitz matrix system at each step. Our approach is to employ the preconditioned conjugate gradient method with circulant preconditioners to solve such systems. Here we iterate in the time domain (using Toeplitz matrix-vector multiplications) and precondition in the Fourier domain, so that the fast Fourier transform (FFT) is used throughout the computations. The circulant preconditioners are derived from the spectral properties of the given input stochastic process. When the input stochastic process is stationary, we prove that with probability 1, the spectrum of the preconditioned system is clustered around 1 and the method converges superlinearly provided that a sufficient number of data samples are taken, i.e., the length of the sliding window is sufficiently long. In the case of point-processing $(k = 1)$, our method requires $O(n\log n)$ operations per adaptive filter input where n is the number of least squares estimators. In the case of block-processing $(k \geqslant n)$, our method requires only $O(\log n)$ operations per adaptive filter input. A simple method is given for tracking the spectral condition number of the data matrix at each step, and numerical experiments are reported in order to illustrate the effectiveness of our FFT based method for fast RLS filtering.

mathematics, applied
A Sliding Window Filter for Incremental SLAM

Gabe Sibley,Larry Matthies,Gaurav Sukhatme

DOI: https://doi.org/10.1007/978-0-387-75523-6_7

2008-01-01

Abstract:This work develops a sliding window filter for incremental simultaneous localization and mapping (SLAM) that focuses computational resources on accurately estimating the immediate spatial surroundings using a sliding time window of the most recent sensor measurements. Ideally, we would like a constant time algorithm that closely approximates the all-time maximum-likelihood estimate as well as the minimum variance Cramer Rao lower bound (CRLB) - that is we would like an estimator that achieves some notion of statistical optimality (quickly converges), efficiency (quickly reduces uncertainty) and consistency (avoids over-confidence). To this end we give a derivation of the SLAM problem from the Gaussian non-linear least squares optimization perspective.We find that this results in a simple, yet general, take on the SLAM problem; we think this is a useful contribution.Our approach is inspired by the results from the photogrammetry community, dating back to the late 1950’s [1], and later derivatives like Mikhail’s least squares treatment [6], the Variable state dimension filter(VSDF) [5], visual odometry( VO) [4], modern bundle adjustment(BA) [10, 3] and of course extended Kalman filter (EKF) SLAM [9].We apply the sliding window filter to SLAM with stereo vision and inertial measurements. Experiments show that the best approximate method comes close to matching the performance of the optimal estimator while attaining constant time complexity - empirically, it is often the case that the difference in their performance is indistinguishable.
Polynomially parameter-dependent approach of robust H∞ filter for polytopic delta operator systems

Zhang Ying,Zhang Rui,Hu Chao,Dong Yongqing

DOI: https://doi.org/10.1109/WCICA.2010.5554615

2010-01-01

Abstract:The problem of robust H-infinity filtering for polytopic Delta operator systems is investigated. An enhanced linear matrix inequality (LMI) representation for H-infinity performance criterion is presented based on the bounded real lemma by introducing two slack matrices. Upon this criterion, a structured polynomially parameter-dependent approach is proposed to solve robust H-infinity filtering problem, which is realized by carefully selecting the structure of the matrices involved in the products with system matrices. An LMI condition is obtained for the existence of admissible filters, and the filter design is cast into a convex optimization problem, which can be readily solved via standard numerical software. The effectiveness of the proposed design is demonstrated in a numerical example.
A Variable Step Size LMS Adaptive Filtering Algorithm and Simulations Based on Computational Verb Theory

Li Hui Sun,Bao Yu Zheng

DOI: https://doi.org/10.4028/www.scientific.net/amr.756-759.3972

2013-01-01

Advanced Materials Research

Abstract:Based on traditional LMS algorithm, variable step LMS algorithm and the analysis for improved algorithm, a new variable step adaptive algorithm based on computational verb theory is put forward. A kind of sectorial linear functional relationship is established between step parameters and the error. The simulation results show that the algorithm has the advantage of slow change which is closely to zero. And overcome the defects of some variable step size LMS algorithm in adaptive steady state value is too large.
Window Function Design for Linear Arbitrary Arrays Via ICA-ADMM Algorithm

Wenqiang Wei,Xianxiang Yu,Ruitao Liu,Xiangrong Wang,Guolong Cui

DOI: https://doi.org/10.1109/isscs58449.2023.10190951

2023-01-01

Abstract:In this paper, we propose a novel window function design for linear arbitrary array with constrained gain loss to synthesize beampatterns. Compared with the classical adjustable window functions (CAWFs), the proposed window function can be applied to thinned/sparse array and symmetric/asymmetric beampattern synthesis for multiple steering directions. To this end, the alternating direction method of multipliers (ADMM) is embedded into the iterative convex approximation (ICA) framework to address the resultant nonconvex optimization problem. Finally, numerical results demonstrate the effectiveness of the proposed method in terms of symmetric/asymmetric beampatterns synthesis for thinned/sparse arrays.
Structural System Identification Using Least Mean Square (LMS) Adaptive Technique

ML WANG,F WU

DOI: https://doi.org/10.1016/0267-7261(95)00018-p

IF: 4

1995-01-01

Soil Dynamics and Earthquake Engineering

Abstract:This paper presents an approach to identify structural parameters using the Least Mean Square (LMS) adaptive transversal filter. This method features easy computer simulation and fast data processing. This approach is effective even in the presence of input noise when it is applied in communications; however, this advantage is not obvious when it is used in structural systems, since the signal bandwidht it deals with in communications is much wider than the bandwidth in structure systems. With a low-pass filter added to a data acquisition system, this approach functions effectively for both linear and nonlinear structural systems. Numerical examples and experimental tests have been included to demonstrate the technique for both linear and nonlinear systems.
Stable Total Least Mean Square Adaptive Filter Algorithm

孔祥玉,魏瑞轩,韩崇昭,马红光

DOI: https://doi.org/10.3321/j.issn:0253-987X.2004.08.016

2004-01-01

Abstract:Aiming at the filter problem that the input and output signal are both corrupted by noise, a stable total least mean square (LMS) adaptive algorithm was proposed. Taking the sum of Rayleigh quotient of the augmented weight vectors of the system and a constraint to the last element of the augmented weight vectors via a LaGrange multiplier as an overall cost function, using the steepest descent principle, the adaptive updating formula of the weight vector was derived, the stability of the algorithm was analyzed, and the range of the learning factor to which the stability was guaranteed was educed. The proposed algorithm is stable and its computation complexity is lower, which can be realized neither calculating the squares root, nor normalization. The simulation results show that the convergence performance, the robust against noise and the convergence precision of the proposed algorithm are remarkably higher than those of other total LMS algorithms.

Sliding Window Delta Operator-Based Adaptive Lattice Filters

A recursive adaptive lattice filters for impulsive signals

Lms and Frls 2-D Lattice Filters

Normalized sliding window covariance lattice filter. An efficient fault detection tool

QR-based Least Mean Squares Algorithm Using the Delta Operator

Modified Adaptive Lattice Notch Filter

An Adaptive L-Filter Based on Signal Local Statistics

Adaptive Hammerstein Filtering Via Recursive Non-Convex Projection

A Modified Adaptive Algorithm of Lattice Notch Filter and Its Convergence Analysis

Lattice Form Adaptive Infinite Impulse Response Filtering Algorithm for Active Noise Control.

A Novel Algorithm of Adaptive IIR Lattice Notch Filter and Performance Analysis

Sliding Window Iterative Identification for Nonlinear Closed‐Loop Systems Based on the Maximum Likelihood Principle

DSP Realization of LMS Adaptive Filter

Learning-Augmented Frequency Estimation in Sliding Windows

Fast Recursive Least Squares Adaptive Filtering by Fast Fourier Transform-Based Conjugate Gradient Iterations

A Sliding Window Filter for Incremental SLAM

Polynomially parameter-dependent approach of robust H∞ filter for polytopic delta operator systems

A Variable Step Size LMS Adaptive Filtering Algorithm and Simulations Based on Computational Verb Theory

Window Function Design for Linear Arbitrary Arrays Via ICA-ADMM Algorithm

Structural System Identification Using Least Mean Square (LMS) Adaptive Technique

Stable Total Least Mean Square Adaptive Filter Algorithm