Research on the algorithm of constant force grinding controller based on reinforcement learning PPO

Tie Zhang,Chao Yuan,Yanbiao Zou

DOI: https://doi.org/10.1007/s00170-023-11129-2

IF: 3.563

2023-03-27

The International Journal of Advanced Manufacturing Technology

Abstract:The robot grinding process requires high real-time constant force control, but it is difficult to control the grinding force stably due to the large deformation of the robot end due to its low stiffness. To reduce the influence of low robot stiffness, positioning error and other factors on the actual grinding force instability, we proposed a constant force grinding controller algorithm based on reinforcement learning PPO. Firstly, we introduce the robot surface workpiece grinding platform and analyze the force of the grinding model. Then, a robot constant force grinding controller based on PPO was proposed to solve the grinding force instability problem of the arbitrarily curved workpiece. We described the correction of constant grinding force as a Markov decision process, and a neural network with a lightweight structure was designed to improve the response-ability of constant force control. The reward function was fitted according to prior grinding data. The actor can output displacement compensation in real-time according to the force of the sensor. Finally, we proposed a method of contour trajectory compensation method based on a single-point laser displacement sensor. We made through mobile robot sensor that scans the surface of the workpiece, using least squares to scan data fitting the polynomial can be used to represent the workpiece contour. The experimental results show that the grinding normal force is more stable and closer to the expected value, and the roughness value of the machined surface decreases. We also chose other methods for comparison; the standard deviation of grinding force is reduced by 31.9% and 58.33% respectively.

engineering, manufacturing,automation & control systems