Abstract:It is well-known that saturated output observations are prevalent in various practical systems and that the $\ell_1$-norm is more robust than the $\ell_2$-norm-based parameter estimation. Unfortunately, adaptive identification based on both saturated observations and the $\ell_1$-optimization turns out to be a challenging nonlinear problem, and has rarely been explored in the literature. Motivated by this and the need to fit with the $\ell_1$-based index of prediction accuracy in, e.g., judicial sentencing prediction problems, we propose a two-step weighted $\ell_1$-based adaptive identification algorithm. Under certain excitation conditions much weaker than the traditional persistent excitation (PE) condition, we will establish the global convergence of both the parameter estimators and the adaptive predictors. It is worth noting that our results do not rely on the widely used independent and identically distributed (iid) assumptions on the system signals, and thus do not exclude applications to feedback control systems. We will demonstrate the advantages of our proposed new adaptive algorithm over the existing $\ell_2$-based ones, through both a numerical example and a real-data-based sentencing prediction problem.
What problem does this paper attempt to address?
### What problem does this paper attempt to solve?
This paper aims to solve the adaptive identification problem based on weighted \(\ell_1\)-norm optimization in the presence of saturated observations. Specifically:
1. **Saturated Observation Phenomenon**: In many practical systems, due to physical limitations or other constraints, the observed values may become saturated. For example, in the fields of autonomous driving, communication systems, and judicial sentencing prediction, when the output of the system exceeds a certain range, the observed value will become a constant value, resulting in inaccurate information.
2. **Weighted \(\ell_1\)-norm Optimization**: Compared with the commonly used \(\ell_2\)-norm, the weighted \(\ell_1\)-norm is more robust in describing prediction accuracy indicators, especially in the presence of outliers. However, combining saturated observations and weighted \(\ell_1\)-norm for adaptive identification is a challenging nonlinear problem that has not been fully studied.
3. **Theoretical and Application Requirements**: To address these problems and meet the requirements of application scenarios such as judicial sentencing prediction, the paper proposes a new Two - Step Weighted Least Absolute Deviation (TSWLAD) adaptive identification algorithm. This algorithm can achieve global convergence of the parameter estimator and the adaptive predictor under weaker excitation conditions (far weaker than the traditional persistent excitation conditions).
4. **Innovation Points**:
- A new TSWLAD algorithm is proposed, which is specifically used to deal with stochastic dynamic systems with saturated observations.
- The global convergence of the new algorithm is established under general non - PE conditions, which is the first time to be achieved in the weighted \(\ell_1\)-norm optimization framework.
- The asymptotic upper bound of the average regret value of the adaptive predictor is provided without any PE conditions.
Through these contributions, the paper provides new theoretical tools and methods for the field of adaptive identification, especially in the application of processing complex data and feedback control systems.