Abstract:As a complex nonlinear system, the inverted pendulum (IP) system has the characteristics of asymmetry and instability. In this paper, the IP system is controlled by a learned deep neural network (DNN) that directly maps the system states to control commands in an end-to-end style. On the basis of deep reinforcement learning (DRL), the detail reward function (DRF) is designed to guide the DNN learning control strategy, which greatly enhances the pertinence and flexibility of the control. Moreover, a two-phase learning protocol (offline learning phase and online learning phase) is proposed to solve the "real gap" problem of the IP system. Firstly, the DNN learns the offline control strategy based on a simplified IP dynamic model and DRF. Then, a security controller is designed and used on the IP platform to optimize the DNN online. The experimental results demonstrate that the DNN has good robustness to model errors after secondary learning on the platform. When the length of the pendulum is reduced by 25% or increased by 25%, the steady-state error of the pendulum angle is less than 0.05 rad. The error is within the allowable range. The DNN is robust to changes in the length of the pendulum. The DRF and the two-phase learning protocol improve the adaptability of the controller to the complex and variable characteristics of the real platform and provide reference for other learning-based robot control problems.

A Class of BP-component Based Learning Control System and Its Application on Inverted Pendulum Control

Robust control based on sliding mode for a triple inverted pendulum

A New Robust Adaptive Control of Uncertain Nonlinear Systems and Pendulum Application

Stabilization of the double inverted pendulum based on discrete-time model predictive control.

Simple Multi-Pd Control Algorithm of Double Inverted Pendulum

Stabilize the planar single inverted pendulum based on LQR.

Neural network model based predictive control for multivariable nonlinear systems

Experiment Design on Inverted Pendulum System

Logic-Based Switching Nested Saturation Control for Inverted Pendulum

Research on the Learning Control of Chaotic Dynamical Systems with Distal Teacher

Simulation and Robustness Studies on an Inverted Pendulum

A reference model-based backstepping anti-interference control method and its application to inverted pendulum

Personified Intelligent Control for an Inverted Pendulum System

Bumpless Switching of Inverted Pendulum Control

Balance Controller Design for Inverted Pendulum Considering Detail Reward Function and Two-Phase Learning Protocol

The Computer Simulation and Real-Time Control for the Inverted Pendulum System Based on PID

A Computer Control System for Arm-Driven Inverted Pendulum

Hybrid Internal Model Control and Proportional Control of Chaotic Dynamical Systems.

Designing and Analyzing the PID and Fuzzy Control System for an Inverted Pendulum

Modeling and Control of One-stage Inverted Pendulum Body Based on Matlab

Design, Implementation, and Control of a Wheel-Based Inverted Pendulum