Abstract:As a complex nonlinear system, the inverted pendulum (IP) system has the characteristics of asymmetry and instability. In this paper, the IP system is controlled by a learned deep neural network (DNN) that directly maps the system states to control commands in an end-to-end style. On the basis of deep reinforcement learning (DRL), the detail reward function (DRF) is designed to guide the DNN learning control strategy, which greatly enhances the pertinence and flexibility of the control. Moreover, a two-phase learning protocol (offline learning phase and online learning phase) is proposed to solve the "real gap" problem of the IP system. Firstly, the DNN learns the offline control strategy based on a simplified IP dynamic model and DRF. Then, a security controller is designed and used on the IP platform to optimize the DNN online. The experimental results demonstrate that the DNN has good robustness to model errors after secondary learning on the platform. When the length of the pendulum is reduced by 25% or increased by 25%, the steady-state error of the pendulum angle is less than 0.05 rad. The error is within the allowable range. The DNN is robust to changes in the length of the pendulum. The DRF and the two-phase learning protocol improve the adaptability of the controller to the complex and variable characteristics of the real platform and provide reference for other learning-based robot control problems.

Balance Control for the First-order Inverted Pendulum Based on the Advantage Actor-critic Algorithm

Robust control based on sliding mode for a triple inverted pendulum

A New Robust Adaptive Control of Uncertain Nonlinear Systems and Pendulum Application

Simple Multi-Pd Control Algorithm of Double Inverted Pendulum

Stabilization of the double inverted pendulum based on discrete-time model predictive control.

Stable walking control and strategy of under-actuated biped robot

Adaptive Finite-Time Optimised Impedance Control for Robotic Manipulators with State Constraints

Balance Controller Design for Inverted Pendulum Considering Detail Reward Function and Two-Phase Learning Protocol

Control strategies for inverted pendulum: A comparative analysis of linear, nonlinear, and artificial intelligence approaches

On-line Adaptive Control for Inverted Pendulum Balancing Based on Feedback-Error-learning

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

A Q-learning approach to the continuous control problem of robot inverted pendulum balancing

Inverted Pendulum Control Based on Particle Filter Neural Network

Adaptive Control of an Inverted Pendulum by a Reinforcement Learning-based LQR Method

Control of Inverted Pendulum Using Fractional Order PID Controllers Based on Particle Swarm Optimization

Combined control algorithm based on synchronous reinforcement learning for a self-balancing bicycle robot

Solve the Inverted Pendulum Problem Base on DQN Algorithm

Global Control for the Angle of Inverted Pendulum with Gain Scheduled

A Novel Recurrent Adaptive Backstepping Optimal Control Strategy for a Single Inverted Pendulum System

A reference model-based backstepping anti-interference control method and its application to inverted pendulum

Personified Intelligent Control for an Inverted Pendulum System