Abstract:A new cost function that introduces the minimum-disturbance (MD) constraint into the conventional recursive least squares (RLS) with a sparsity-promoting penalty is first defined in this paper. Then, a variable regularization factor is employed to control the contributions of both the MD constraint and the sparsity-promoting penalty to the new cost function. Analyses show that such a regularization factor can control the forgetting factor of the RLS, which means low misalignment and fast tracking can both be achieved by adjusting the regularization factor, as when a variable forgetting factor RLS (VFF-RLS) is implemented. It is further demonstrated that the regularization factor can accelerate the convergence of the RLS, especially for sparse filtering, which means that tuning the regularization factor rather than the forgetting factor is more effective for such a case. Finally, a method for automatically determining the regularization factor, which is free of any prior knowledge, is presented. To verify the effectiveness of the analytical results via simulations, a benchmark algorithm for a VEE-RLS with a sparsity-promoting penalty is conceived, where the forgetting factor is adjusted manually according to the prophetic system changes to obtain the best performance. The proposed algorithm exhibits lower misalignment and greater robustness than those of the benchmark algorithm when a sparse system is identified, whereas the algorithms perform almost equivalently when a non-sparse system is found.

Recursive Least Squares for Censored Regression

Censored Regression with Noisy Input

Recursive Least Squares Support Vector Regression

Modified recursive least squares algorithm with variable parameters and resetting for time-varying system

Asymptotically Efficient Online Learning for Censored Regression Models Under Non-I.I.D Data

Distributed Censored Regression over Networks

On Least-Squares Regression with Censored Data

Recursive Least-Squares Method with Membership Functions

Rank Estimation in Partial Linear Model with Censored Data

One-Bit Recursive Least-Squares Algorithm with Application to Distributed Target Localization

Empirical Likelihood Based Synthetic Data Method for Censored Regression Analysis

Distributed Sparse Recursive Least-Squares over Networks

Convex Regularized Recursive Minimum Error Entropy Algorithm

Two-stage least squares with a randomly right censored outcome

A new approach to regression analysis of censored competing-risks data

Regression Analysis of Right-Censored Failure Time Data with Missing Censoring Indicators

Distributed Censored Regression Over Networks.

Recursive Least Squares With Minimax Concave Penalty Regularization for Adaptive System Identification

Generalized Forgetting Recursive Least Squares: Stability and Robustness Guarantees

Empirical likelihood and estimation in a partially linear varying coefficient model with right censored data

A New Penalized Recursive Least Squares Method With a Variable Regularization Factor for Adaptive Sparse Filtering.