Reinforcement Learning Based Shared Control: A Novel Teleoperation Strategy for Robotic

Ziqing Chang,Hao Cheng,Hangli Ge,Feng Duan

DOI: https://doi.org/10.1109/ICARM54641.2022.9959506

2022-01-01

Abstract:Teleoperation is widely used in industrial automation, military, space exploration, and surgery. However, traditional control of mechanical arms teleoperation has some defects, such as the lack of present sense for operators, the excessive dependence on the experience, the low precision of operators, and the heavy workload. These problems make it challenging to teleoperate mechanical arms to complete tasks efficiently and accurately. Current Reinforcement Learning's autonomous decision-making can accomplish tasks, but it cannot guarantee successful completion in all cases. We propose a novel teleoperation strategy in which both operator and well-trained agent play a big role. The operator teleoperates the robotic arm with a VR controller as dominant control. The agent trained by deep deterministic policy gradient (DDPG) provides assistance control to fix the motion trajectories. Through the proposed shared control strategy, the agent can correct the operator's operation errors in real-time and improve the accuracy and efficiency of operational tasks. To validate the proposed teleoperation strategy, we built a simulation environment using the Pybullet Module. We designed two pick-and-push tasks. The goal is to pick up the object and place it at the target location. We first trained an intelligent agent using the DDPG algorithm. Then we mix the actions with human manipulations. Ten rounds of experiments were conducted, and time comparisons were made. The final experimental results show that our proposed method reduces the time to complete the task by 13% on average. The well-trained RL agent can effectively make corrections for trajectories, proving the effectiveness of the proposed method.