Abstract:Proportional-integral-derivative (PID) control is the most widely used in industrial control, robot control and other fields. However, traditional PID control is not competent when the system cannot be accurately modeled and the operating environment is variable in real time. To tackle these problems, we propose a self-adaptive model-free SAC-PID control approach based on reinforcement learning for automatic control of mobile robots. A new hierarchical structure is developed, which includes the upper controller based on soft actor-critic (SAC), one of the most competitive continuous control algorithms, and the lower controller based on incremental PID controller. Soft actor-critic receives the dynamic information of the mobile robot as input, and simultaneously outputs the optimal parameters of incremental PID controllers to compensate for the error between the path and the mobile robot in real time. In addition, the combination of 24-neighborhood method and polynomial fitting is developed to improve the adaptability of SAC-PID control method to complex environments. The effectiveness of the SAC-PID control method is verified with several different difficulty paths both on Gazebo and real mecanum mobile robot. Futhermore, compared with fuzzy PID control, the SAC-PID method has merits of strong robustness, generalization and real-time performance.

Motion Control of Mobile Robots Based on Fuzzy-PID

Motion Analysis and Control Realization of Omni-Directional Robot

A Fuzzy Control Method Based on Central Pattern Generator for Quadruped Robots

Hybrid fuzzy PID control of hydraulic robot

Fuzzy PID Controller Based on Yaw Angle Prediction of a Spherical Robot*

Predictive Function Control of Hydraulic Robot

A Novel Robotic Motion Control Strategy Based on Improved Fuzzy PID and Feedforward Compensation

The Application of Fuzzy-PID Controller on Servo System

Fuzzy adaptive PID control method for multi-mecanum-wheeled mobile robot

The Application Research of a Fuzzy Controller on Robot

Research on Driving Wheel Control of Cleaning Robot Based on Fuzzy Adaptive Tuning PID

A combined backstepping and adaptive fuzzy PID approach for trajectory tracking of autonomous mobile robots

Application of Fuzzy PID Position Control Algorithm in Motion Control System Design of Palletizing Robot

A New Type-3 Fuzzy Predictive Approach for Mobile Robots

A Self-adaptive SAC-PID Control Approach based on Reinforcement Learning for Mobile Robots

Adaptive PID Saturate Output Feedback Control of Robot Manipulators

Real-Time Fuzzy-PID for Mobile Robot Control and Vision-Based Obstacle Avoidance

Motion Control of Mbile Robots Based on the Fuzzy Control Algorithm with Motion Trend Analysis in Self-Adjusting Universe

Research on Self-Tracking Car Based on Fuzzy-PID Control Algorithm

Shooting Action Control of Soccer Robot Based on Genetic-fuzzy Algorithm

Research on Humanoid Robot Soccer System Based on Fuzzy Logic