Abstract:This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares estimation by adaptively adjusting the threshold. Secondly, under a possibly weakest non-persistent excited condition, we prove that the proposed algorithm can correctly identify the zero and nonzero elements of the sparse parameter vector using a finite number of observations, and further estimates of the nonzero elements almost surely converge to the true values. Compared with the related works, e.g., LASSO, our method only requires the weakest assumptions and does not require solving additional optimization problems. Besides, our theoretical results do not require any statistical assumptions on the regression signals, including independence or stationarity, which makes our results promising for application to stochastic feedback systems. Thirdly, the number of finite observations that guarantee the convergence of the zero-element set of unknown sparse parameters of the Hammerstein system is derived for the first time. Finally, numerical simulations are provided, demonstrating the effectiveness of the proposed method. Since there is no additional optimization problem, i.e., no additional numerical error, the proposed algorithm performs much better than other related algorithms.

Joint parameter and time-delay estimation for a class of Wiener models based on a new orthogonal least squares algorithm

Input and state estimation for linear systems: A least squares estimation approach

Hierarchical Least-Squares Based Iterative Identification for Multivariable Systems with Moving Average Noises

Combined Algorithm for Time-Varying Systems Based on the Robust Min-Max and the Damped Least Squares Estimation

Least-squares Based Iterative Parameter Estimation for Two-Input Multirate Sampled-Data Systems

Novel parameter identification algorithm for nonstationary stochastic system

Parameter learning for Wiener systems with time‐delay state‐space model

Parameter Estimation of Wiener Systems Based on the Particle Swarm Iteration and Gradient Search Principle

An Efficient Sparse Identification Algorithm For Stochastic Systems With General Observation Sequences

Identification of Wiener state–space models utilizing Gaussian sum smoothing

Identification of Time-Varying Joint Dynamics Using Wavelets

Joint iterative state and parameter estimation for bilinear systems with autoregressive noises via the data filtering

Iterative Parameter Identification for Time-delay Nonlinear Rational Models via L1-regularized Least Squares

Joint State Estimation and Noise Identification Based on Variational Optimization

Joint State and Parameter Estimation Using the Partial Errors-in-Variables Principle

Expectation‐maximization algorithm for bilinear state‐space models with time‐varying delays under non‐Gaussian noise

Sparse Parameter Identification for Stochastic Systems Based on [math] Regularization

Parameter estimation of multivariable Wiener nonlinear systems by the improved particle swarm optimization and coupling identification

A Recursive Identification Algorithm for Wiener Nonlinear Systems with Linear State-Space Subsystem

Parameter estimation algorithms of linear systems with time-delays based on the frequency responses and harmonic balances under the multi-frequency sinusoidal signal excitation

Application of Fractional Calculus for Parameter Estimation of Nonlinear Wiener Systems With Time Delay