Regularized nonlinear regression for simultaneously selecting and estimating key model parameters: Application to head-neck position tracking

Kyubaek Yoon,Hojun You,Wei-Ying Wu,Chae Young Lim,Jongeun Choi,Connor Boss,Ahmed Ramadan,John M. Popovich,Jacek Cholewicki,N. Peter Reeves,Clark J. Radcliffe
DOI: https://doi.org/10.1016/j.engappai.2022.104974
IF: 8
2022-08-01
Engineering Applications of Artificial Intelligence
Abstract:In system identification, estimating parameters of a biomechanical model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model parameters while fixing the remaining parameters to a set of typical values. The problem is formulated as a nonlinear least-squares estimator with L1-regularization on the deviation of parameters from a set of typical values. In addition, a modified optimization approach is introduced to find the solution to the formulated problem. As a result, we provided consistency and oracle properties of the proposed estimator as a theoretical foundation. To show the effectiveness of the proposed method, we conducted simulation and experimental studies. In the simulation study, the proposed Lasso performed significantly better than the ordinary L1-regularization methods in terms of the bias and variance of the parameter estimates. The experimental study presented an application identifying a biomechanical parametric model of a head position tracking task for ten human subjects from limited data. Compared with the variance of the parameter estimates from nonlinear ordinary least-squares regression, that of parameter estimates from the proposed Lasso decreased by 96% using the simulated data. Using the real-world data, the variance of estimated parameters decreased by 71%. In addition, the proposed method kept variance accounted for (VAF) at 83% and was 54 times faster than the ordinary Lasso using a standard simplex-based optimization algorithm.
automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
What problem does this paper attempt to address?