Optimal Critic Learning for Robot Control in Time-Varying Environments.

Chen Wang,Yanan Li,Shuzhi Sam Ge,Tong Heng Lee
DOI: https://doi.org/10.1109/TNNLS.2014.2378812
IF: 14.255
2015-01-01
IEEE Transactions on Neural Networks and Learning Systems
Abstract:In this paper, optimal critic learning is developed for robot control in a time-varying environment. The unknown environment is described as a linear system with time-varying parameters, and impedance control is employed for the interaction control. Desired impedance parameters are obtained in the sense of an optimal realization of the composite of trajectory tracking and force regulation. Q-function-based critic learning is developed to determine the optimal impedance parameters without the knowledge of the system dynamics. The simulation results are presented and compared with existing methods, and the efficacy of the proposed method is verified.
What problem does this paper attempt to address?