Abstract:As a complex nonlinear system, the inverted pendulum (IP) system has the characteristics of asymmetry and instability. In this paper, the IP system is controlled by a learned deep neural network (DNN) that directly maps the system states to control commands in an end-to-end style. On the basis of deep reinforcement learning (DRL), the detail reward function (DRF) is designed to guide the DNN learning control strategy, which greatly enhances the pertinence and flexibility of the control. Moreover, a two-phase learning protocol (offline learning phase and online learning phase) is proposed to solve the "real gap" problem of the IP system. Firstly, the DNN learns the offline control strategy based on a simplified IP dynamic model and DRF. Then, a security controller is designed and used on the IP platform to optimize the DNN online. The experimental results demonstrate that the DNN has good robustness to model errors after secondary learning on the platform. When the length of the pendulum is reduced by 25% or increased by 25%, the steady-state error of the pendulum angle is less than 0.05 rad. The error is within the allowable range. The DNN is robust to changes in the length of the pendulum. The DRF and the two-phase learning protocol improve the adaptability of the controller to the complex and variable characteristics of the real platform and provide reference for other learning-based robot control problems.

Swing-up and Balance Control of Inverted Pendulum Based on Reinforcement Learning

Robust control based on sliding mode for a triple inverted pendulum

Control of the Double Inverted Pendulum Based on Reinforcement Learning

Design Of Reinforcement Learning Algorathm For Single Inverted Pendulum Swing Control

Design Of Reinforce Learning Control Algorithm And Verified In Inverted Pendulum

The Study of Swing Up and Balance Control for Rotary Parallel Inverted-Pendulum

Balance Controller Design for Inverted Pendulum Considering Detail Reward Function and Two-Phase Learning Protocol

Swing up Control Based on Sensory-Motor Schema for Planar Inverted Pendulum

Limit cycles in inverted pendulum system by reinforcement learning

Vague Neural Network Based Reinforcement Learning Control System For Inverted Pendulum

Swing-up and balance control of Furuta pendulum for underactuated systems

Swing-Up and Stabilization Control Design for an Underactuated Rotary Inverted Pendulum System: Theory and Experiments

Study on Swing-up and stability Control for Single Link Rotary Inverted Pendulum

Adaptive Control of an Inverted Pendulum by a Reinforcement Learning-based LQR Method

Inverted Pendulum System Control Based on Nonlinear Control Method

Switched Energy and Neural Network-Based Approach for Swing-Up and Tracking Control of Double Inverted Pendulum.

Inverted Pendulum System Based on Optimal Control

A Q-learning approach to the continuous control problem of robot inverted pendulum balancing

Experiment Design on Inverted Pendulum System

Study on Swing-Up Control of Linear Spring-Connected Double Inverted Pendulum

Active Exploration Planning in Reinforcement Learning for Inverted Pendulum System Control