Cyber-Physical System Enabled Path Planning Simulation for Collaborative Industrial Robots

Zixuan Wang,Junhua Zhou,Hongwei Wang
DOI: https://doi.org/10.1109/cscwd54268.2022.9776046
2022-01-01
Abstract:Collaborative industrial robot is becoming more and more important in the manufacturing industry. Thanks for a variety of high-precision sensors integrated by the Cyber-Physical System, the collaborative industrial robot can model the working environment and know its own state in real time. Because of this, CPS enables the robot to plan a feasible path in a virtual simulation environment. In this paper, a two-dimensional working space and a three-dimensional working space is constructed and set as a virtual environment model constructed by CPS. Q-learning algorithm is used to plan a path in the working space. A feasible path is found by adjusting the number of iteration times of the algorithm. Further more, the learning rate α of the Q-learning algorithm is also adjusted and the results demonstrate that the increase of α will accelerate the convergence speed of the algorithm within the set range.
What problem does this paper attempt to address?