Abstract:The robot grinding process requires a high level of real-time constant force control. However, the low stiffness of the robot makes it difficult to keep the grinding force stable due to the deformation at the end of the robot during grinding. Therefore, an online optimization method of controller parameters for constant force grinding based on the deep reinforcement learning Rainbow is proposed in this paper. The method can stabilize the convergence while optimizing the control parameters online and can solve the constant force control during the grinding process. Firstly, based on the force analysis of the grinding model, we established the relationship between the grinding force and the trajectory compensation, and the robot constant force grinding controller was established by obtaining the grinding force to adjust the grinding trajectory. Secondly, aiming at adjusting the controller parameters of robot constant force grinding, we selected Rainbow to optimize the controller parameters and designed the training environment for the reinforcement learning agent. The environment includes the state space composed of different controller parameters, the action space of state transformation, the Noisy Categorical Dueling (NCD) network mapping agent state and action reward, and the reward function with two-stage sample evaluation. The online optimization of constant force controller parameters is realized to reduce the training time cost. To improve the safety of grinding force overload during sampling and the utilization rate of sample data, an online sampling method of grinding force was proposed. Through the experiment of the robotic constant force grinding system, Rainbow can quickly converge to the stable strategy. The results show that the grinding force is more consistently close to the expected value and the roughness of the machined surface decreases. Compared with the parameters empirically adjusted and the parameters with a poor grinding performance by sampling, the roughness was reduced by 26.54% and 78.39% respectively, verifying the effectiveness and practicality of the proposed method.

Online Optimization Method of Controller Parameters for Robot Constant Force Grinding Based on Deep Reinforcement Learning Rainbow

Research on the algorithm of constant force grinding controller based on reinforcement learning PPO

Constant force grinding controller for robots based on SAC optimal parameter finding algorithm

Accelerating Reinforcement Learning with Local Data Enhancement for Process Control

A Method for Grinding Removal Control of a Robot Belt Grinding System

Research on Surface Tracking and Constant Force Control of a Grinding Robot

Online Reinforcement Learning Neural Network Controller Design for Nanomanipulation

Proxy-Based Sliding Mode Force Control for Compliant Grinding via Diagonal Recurrent Neural Network and Prandtl-Ishlinskii Hysteresis Compensation Model

Force tracking control of grinding end effector based on backstepping + PID

Intelligent Control for A Robot Belt Grinding System

Dual PID Adaptive Variable Impedance Constant Force Control for Grinding Robot

An Adaptive Modeling Method for a Robot Belt Grinding Process

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Process optimization of robotic grinding to guarantee material removal accuracy and surface quality simultaneously

Research on constant force grinding control of aero-engine blades based on extended state observer

Study on force control for robot massage with a model-based reinforcement learning algorithm

Study on the constant force control of aero-engine blade grinding robot considering time delay

Adaptive Grinding Planning of Robotic Arms With Minimal Cost

Research and application on force control of industrial robot polishing concave curved surfaces

Multi-algorithm fusion–based intelligent decision-making method for robotic belt grinding process parameters

Online Process Monitoring Based on Vibration-Surface Quality Map for Robotic Grinding