Reinforcement Learning Based Control for Uncertain Robotic Manipulator Trajectory Tracking

Aohua Liu,Bo Zhang,Weiliang Chen,Yiang Luo,Shuxian Fang,Ouyang Zhang,Zhuang Liu,Zhenhuan Wang,Jianxing Liu
DOI: https://doi.org/10.1109/cac57257.2022.10055583
2022-01-01
Abstract:This paper investigates the trajectory tracking control method for a robotic manipulator with uncertainties. A compound controller combining a traditional control law with deep reinforcement learning is developed to improve tracking accuracy and adaptability. The model-based control method is able to increase sampling efficiency for learning control strategy. The introduction of deep reinforcement learning based on soft actor-critic structure and Lyapunov function constrain enables the system to compensate unknown uncertainties and remain stable. Eventually, a 3-DOF manipulator is used to show the effectiveness of the proposed controller. Comparative simulation results demonstrate that the compound controller acquires higher tracking accuracy than the pure model-based control method.
What problem does this paper attempt to address?