Abstract:Using Artificial Neural Networks (ANN) for nonlinear system identification has proven to be a promising approach, but despite of all recent research efforts, many practical and theoretical problems still remain open. Specifically, noise handling and models, issues of consistency and reliable estimation under minimisation of the prediction error are the most severe problems. The latter comes with numerous practical challenges such as explosion of the computational cost in terms of the number of data samples and the occurrence of instabilities during optimization. In this paper, we aim to overcome these issues by proposing a method which uses a truncated prediction loss and a subspace encoder for state estimation. The truncated prediction loss is computed by selecting multiple truncated subsections from the time series and computing the average prediction loss. To obtain a computationally efficient estimation method that minimizes the truncated prediction loss, a subspace encoder represented by an artificial neural network is introduced. This encoder aims to approximate the state reconstructability map of the estimated model to provide an initial state for each truncated subsection given past inputs and outputs. By theoretical analysis, we show that, under mild conditions, the proposed method is locally consistent, increases optimization stability, and achieves increased data efficiency by allowing for overlap between the subsections. Lastly, we provide practical insights and user guidelines employing a numerical example and state-of-the-art benchmark results.

Data-reuse extended NLMS algorithm based on optimized time-varying step-size for system identification

Combined Algorithm for Time-Varying Systems Based on the Robust Min-Max and the Damped Least Squares Estimation

Parallel Nlms Filters With Stochastic Active Taps And Step-Sizes For Sparse System Identification

Novel parameter identification algorithm for nonstationary stochastic system

Modified recursive least squares algorithm with variable parameters and resetting for time-varying system

Hierarchical Least-Squares Based Iterative Identification for Multivariable Systems with Moving Average Noises

Neural network system identification based on levenberg-marquardt algorithm

Two-dimensional Incremental Recursive Least Squares Identification for Batch Processes

Study on the two-stage least square algorithm and its performance for nonstationary stochastic system

Optimal Step-Size Update Equation in Nonstationary Environment and OVS-LMSII Algorithm

A bias-compensated NLMS algorithm based on arctangent framework for system identification

A Novel Method for LTV System Modeling Based on Wavelet Network and Genetic Algorithm

Two-dimensional recursive least squares identification based on local polynomial modeling for batch processes.

l 0-norm penalised shrinkage linear and widely linear LMS algorithms for sparse system identification.

Deep Subspace Encoders for Nonlinear System Identification

Training Recurrent Neural Networks by Sequential Least Squares and the Alternating Direction Method of Multipliers

$L_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification

Modification of Recursive Least Squares Algorithm for Linear Time-Varying Systems

l0 Norm Constraint LMS Algorithm for Sparse System Identification.

Regularized Least-Mean-Square Algorithms

A Weighted Least-Squares Method for Non-Asymptotic Identification of Markov Parameters from Multiple Trajectories