Abstract:As a complex nonlinear system, the inverted pendulum (IP) system has the characteristics of asymmetry and instability. In this paper, the IP system is controlled by a learned deep neural network (DNN) that directly maps the system states to control commands in an end-to-end style. On the basis of deep reinforcement learning (DRL), the detail reward function (DRF) is designed to guide the DNN learning control strategy, which greatly enhances the pertinence and flexibility of the control. Moreover, a two-phase learning protocol (offline learning phase and online learning phase) is proposed to solve the "real gap" problem of the IP system. Firstly, the DNN learns the offline control strategy based on a simplified IP dynamic model and DRF. Then, a security controller is designed and used on the IP platform to optimize the DNN online. The experimental results demonstrate that the DNN has good robustness to model errors after secondary learning on the platform. When the length of the pendulum is reduced by 25% or increased by 25%, the steady-state error of the pendulum angle is less than 0.05 rad. The error is within the allowable range. The DNN is robust to changes in the length of the pendulum. The DRF and the two-phase learning protocol improve the adaptability of the controller to the complex and variable characteristics of the real platform and provide reference for other learning-based robot control problems.

Inverted Pendulum Control Based on Particle Filter Neural Network

Single neuron predictive pid control

Stabilization of the double inverted pendulum based on discrete-time model predictive control.

Simple Multi-Pd Control Algorithm of Double Inverted Pendulum

Strong Tracking Filter in an Inverted Pendulum System

Self-learning Fuzzy PID Controller Based on Neural Networks

Research of triple inverted pendulum based on neural network of genetic algorithm

Controlling a Double Inverted Pendulum Using Evolutionary Radial Basis Function Neural Network

Control of Inverted Pendulum Using Fractional Order PID Controllers Based on Particle Swarm Optimization

Simulation and Robustness Studies on an Inverted Pendulum

Control strategies for inverted pendulum: A comparative analysis of linear, nonlinear, and artificial intelligence approaches

The Computer Simulation and Real-Time Control for the Inverted Pendulum System Based on PID

On-line Adaptive Control for Inverted Pendulum Balancing Based on Feedback-Error-learning

Adaptive Neural Network Fuzzy Control Plane Double Inverted Pendulum

Simulation Research on Nonlinear PID Controller in Inverted Pendulum Control System

Balance Control for the First-order Inverted Pendulum Based on the Advantage Actor-critic Algorithm

A reference model-based backstepping anti-interference control method and its application to inverted pendulum

Development of inverted pendulum system and fuzzy control based on MATLAB

Personified Intelligent Control for an Inverted Pendulum System

Balance Controller Design for Inverted Pendulum Considering Detail Reward Function and Two-Phase Learning Protocol

Swing-Up Control of Double Inverted Pendulum Based on Adaptive Neuro-fuzzy Inference System