Abstract:A new cost function that introduces the minimum-disturbance (MD) constraint into the conventional recursive least squares (RLS) with a sparsity-promoting penalty is first defined in this paper. Then, a variable regularization factor is employed to control the contributions of both the MD constraint and the sparsity-promoting penalty to the new cost function. Analyses show that such a regularization factor can control the forgetting factor of the RLS, which means low misalignment and fast tracking can both be achieved by adjusting the regularization factor, as when a variable forgetting factor RLS (VFF-RLS) is implemented. It is further demonstrated that the regularization factor can accelerate the convergence of the RLS, especially for sparse filtering, which means that tuning the regularization factor rather than the forgetting factor is more effective for such a case. Finally, a method for automatically determining the regularization factor, which is free of any prior knowledge, is presented. To verify the effectiveness of the analytical results via simulations, a benchmark algorithm for a VEE-RLS with a sparsity-promoting penalty is conceived, where the forgetting factor is adjusted manually according to the prophetic system changes to obtain the best performance. The proposed algorithm exhibits lower misalignment and greater robustness than those of the benchmark algorithm when a sparse system is identified, whereas the algorithms perform almost equivalently when a non-sparse system is found.

Recursive regularisation parameter selection for sparse RLS algorithm

Recursive Least Squares Support Vector Regression

A Recursive Least Squares Algorithm with ℓ 1 Regularization for Sparse Representation

A New Penalized Recursive Least Squares Method With a Variable Regularization Factor for Adaptive Sparse Filtering.

Modified recursive least squares algorithm with variable parameters and resetting for time-varying system

Recursive Least-Squares Method with Membership Functions

EM Based p-norm-like Constraint RLS Algorithm for Sparse System Identification

Robust RLS Via the Nonconvex Sparsity Prompting Penalties of Outlier Components.

Variable step-size convex regularized PRLS algorithms

Modified Recursive Least Squares Algorithm for Sparse System Identification

Recursive Least Squares for Censored Regression

Distributed Sparse Recursive Least-Squares over Networks

Fast Sparse RLS Algorithms

Convex Regularized Recursive Minimum Error Entropy Algorithm

A New Recursive Approach to Sparse Representation

Robust Sparsity-Aware RLS Algorithms with Jointly-Optimized Parameters Against Impulsive Noise

Recursive Least Squares With Minimax Concave Penalty Regularization for Adaptive System Identification

Recursive Robust Least Squares Support Vector Regression Based on Maximum Correntropy Criterion

Feature Selection with &Lt;inline-Formula> &Lt;tex-Math Notation="latex">$\ell_{2,1-2}$ &Lt;/tex-Math> &Lt;/inline-Formula> Regularization

Proportionate RLS with L1 Norm Regularization: Performance Analysis and Fast Implementation

Generalized and Robust Least Squares Regression.