Reinforcement learning-based distributed impedance control of robots for compliant operation in tight interaction tasks
Pengjie Xu,Zhenyu Li,Xun Liu,Tianrui Zhao,Lin Zhang,Yanzheng Zhao
DOI: https://doi.org/10.1016/j.engappai.2024.108913
IF: 8
2024-07-13
Engineering Applications of Artificial Intelligence
Abstract:It is challenging to achieve compliant operation in tight interaction tasks, where closed-loop constraints are formed between the robots or between a robot and the environment. Complex dynamic interactions and uncertain parameters degrade the performance of model-based controllers. In this paper, a reinforcement learning-based distributed impedance control approach is proposed for these tight interaction tasks. Two aspects are considered to ensure compliant operation for the robots. First, a distributed impedance model is established through the design of reasonable independence states and nodes networks. Second, the reinforcement learning agent is designed to make decision for adjusting impedance parameters. The trained parameters are integrated into the designed impedance model, and a model-based controller is then employed for compliant control for the robots. The effectiveness is validated under two different tight interaction scenarios via co-simulation. Compliant operation can be achieved whether between robots or between a robot and the environment.
automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary