Unified Human-Robot-Environment Interaction Control in Contact-Rich Collaborative Manipulation Tasks Via Model-Based Reinforcement Learning
Xing Liu,Yu Liu,Zhengxiong Liu,Panfeng Huang
DOI: https://doi.org/10.1109/tie.2022.3227279
IF: 7.7
2022-01-01
IEEE Transactions on Industrial Electronics
Abstract:Many safety-critical or performance-demanding systems are human-in-the-loop, i.e., the robot interacts with human being and environment, in which human-in-the-loop control becomes a key research topic. In this article, a unified optimal interaction control in joint space is presented for multipoint humanrobotenvironment interaction (HREI) problems, which are very common in humanrobot collaborative manipulation tasks. Specifically, model-based reinforcement learning method is leveraged for obtaining optimal interaction control. For multipoint humanrobotenvironment interaction, the interaction forces exerted on each link are isolated and estimated via the backward generalized momentum observer method. In humanrobotenvironment interaction problems, the environmental as well as the human arm's dynamics parameters are usually unknown, stochastic, and time-varying. To obviate the dependence on these parameters, the Gaussian mixture modeling / Gaussian mixture regression (GMM/GMR) method is employed to learn the unknown external dynamics. It is noteworthy the interaction forces are considered as system states, the time derivatives of which are computed based on the GMM/GMR learning results via chain-rule. Then, the iterative linear quadratic Gaussian with learned external dynamics (ILQG-LED) method is utilized to realize optimal multipoint HREI control. The validity of the proposed method is verified through experimental studies.
automation & control systems,engineering, electrical & electronic,instruments & instrumentation