Abstract:Recursive least squares (RLS) estimations are used extensively in many signal processing and control applications. In this paper we consider RLS with sliding data windows involving multiple (rank k) updating and downdating computations. The least squares estimator can be found by solving a near-Toeplitz matrix system at each step. Our approach is to employ the preconditioned conjugate gradient method with circulant preconditioners to solve such systems. Here we iterate in the time domain (using Toeplitz matrix-vector multiplications) and precondition in the Fourier domain, so that the fast Fourier transform (FFT) is used throughout the computations. The circulant preconditioners are derived from the spectral properties of the given input stochastic process. When the input stochastic process is stationary, we prove that with probability 1, the spectrum of the preconditioned system is clustered around 1 and the method converges superlinearly provided that a sufficient number of data samples are taken, i.e., the length of the sliding window is sufficiently long. In the case of point-processing $(k = 1)$, our method requires $O(n\log n)$ operations per adaptive filter input where n is the number of least squares estimators. In the case of block-processing $(k \geqslant n)$, our method requires only $O(\log n)$ operations per adaptive filter input. A simple method is given for tracking the spectral condition number of the data matrix at each step, and numerical experiments are reported in order to illustrate the effectiveness of our FFT based method for fast RLS filtering.

Recursive Constrained Adaptive Filtering Algorithm Based on Arctangent Framework

A recursive adaptive lattice filters for impulsive signals

Recursive Constrained Generalized Maximum Correntropy Algorithms for Adaptive Filtering

Low-complexity Recursive Constrained Maximum Versoria Criterion Adaptive Filtering Algorithm

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Constraint-Forcing Recursive Generalized Maximum Correntropy Algorithm with Forgetting Factor for Adaptive Filtering

Correntropy-based Data-Selective Adaptive Filtering Algorithms for Acoustic Feedback Cancellation

Fast Recursive Least Squares Adaptive Filtering by Fast Fourier Transform-Based Conjugate Gradient Iterations

Adaptive Hammerstein Filtering Via Recursive Non-Convex Projection

Unsupervised Robust Recursive Least-Squares Algorithm for Impulsive Noise Filtering

Recursive Least Squares for Censored Regression

Cascaded Random Fourier Filter for Robust Nonlinear Active Noise Control

Convex Regularized Recursive Maximum Correntropy Algorithm

Robust DCD-Based Recursive Adaptive Algorithms

Constrained Normalized Subband Adaptive Filter Algorithm and Its Performance Analysis

Constrained maximum correntropy adaptive filtering

A Filtering Based Recursive Extended Least Squares Identification Algorithm

Adaptive filtering based on recursive minimum error entropy criterion

Robust Diffusion Recursive Adaptive Filtering Algorithm Based on Lp-Norm

A New Penalized Recursive Least Squares Method With a Variable Regularization Factor for Adaptive Sparse Filtering.

Proportionate Recursive Maximum Correntropy Criterion Adaptive Filtering Algorithms and their Performance Analysis