Vision-based neural predictive tracking control for multi-manipulator systems with parametric uncertainty

Jinhui Wu,Zhehao Jin,Andong Liu,Li Yu
DOI: https://doi.org/10.1016/j.isatra.2020.10.057
IF: 7.3
2021-04-01
ISA Transactions
Abstract:The kinematics and dynamics for visual servoing systems of the multi-manipulator is modelled.A two-layer control scheme is proposed to handle the coordination problem for trajectory tracking systems of the multi-manipulator.A model predictive control scheme combined with a recurrent neural network is to solve the optimization problem with the input constraint. And an extended state observer is proposed to deal with the parametric uncertainty in the dynamic level.The input-to-state practical stability of the system is analyzed and the maximal admissible bound of the uncertainty is also given.To deal with the coordination problem for multi-manipulator trajectory tracking systems with parametric uncertainties, this paper proposes a two-layer control scheme incorporating a model predictive strategy and an extended state observer. In the kinematic layer, the visual information is implemented and a visual servoing error model is derived by the image-based visual servoing strategy. A recurrent neural network model predictive control approach is proposed to obtain velocities which are regarded as the reference signals for the dynamic layer. For dynamics, a linear time-varying dynamic model of the multi-manipulator system coupled with the object is established, where the parametric uncertainty is recognized as an added disturbance. An extended state observer is sequentially designed to estimate the disturbance by using pole placement method. The input-to-state practical stability of the system is further analyzed with a bounded disturbance. Finally, simulations and comparison are given to verify the effectiveness and robustness of the proposed algorithm.
automation & control systems,instruments & instrumentation,engineering, multidisciplinary
What problem does this paper attempt to address?
The paper mainly addresses the trajectory tracking control problem of multi-robot arm systems under parameter uncertainty. Specifically, the research aims to design a two-layer control scheme based on visual servoing, which combines Model Predictive Control (MPC) strategy and Extended State Observer (ESO) to solve the coordination problem of multi-robot arm systems under parameter uncertainty. The key technical points in the paper include: 1. **Image-based visual servoing control**: Utilizing image information to construct a visual servoing error model and implementing visual information through image-based visual servoing strategy. 2. **Recurrent Neural Network Model Predictive Control (RNN-MPC)**: Proposing a Recurrent Neural Network Model Predictive Control method to obtain the velocity as a reference signal for the dynamic layer. 3. **Dynamic modeling and Extended State Observer**: Establishing a time-varying linear dynamic model of the multi-robot arm system considering object coupling, and treating parameter uncertainty as an additional disturbance; designing an Extended State Observer to estimate the disturbance. 4. **Input-to-state practical stability analysis**: Conducting further analysis on the input-to-state practical stability of the system with disturbances and providing the maximum acceptable bounds for parameter uncertainty. In summary, the goal of the paper is to reduce the impact of parameter uncertainty on system performance and improve the robustness of the system. To achieve this goal, the authors propose a control framework that integrates visual servoing, Model Predictive Control, and Extended State Observer, and validate the effectiveness and robustness of the proposed method through simulations.