Abstract:This paper tries to demonstrate how a heuristic neural control approach can be used to solve a complex nonlinear control problem. The control task is to swing up a pendulum mounted on a cart from its stable position (vertically down) to the zero state (up right) and keep it there by applying a sequence of two opposing constant forces of equal magnitude to the mass center of the cart. In addition, the displacement of the cart itself is confined to within a preset limit during the swinging up action and it will eventually be brought to the origin of the track. This is truly a nontrivial nonlinear regulation problem and is considerably difficult compared to the pendulum balancing problem (and its variations) widely adopted as a benchmarking test system for neural controllers. Through the solution of this specific control problem, we try to illustrate a heuristic neural control approach with task decomposition, control rule extraction and neural net rule implementation as its basic elements. Specializing to the pendulum problem, the global control task is decomposed into subtasks namely pendulum positioning and cart positioning. Accordingly, three separate neural subcontrollers are designed to cater to the subtasks and their coordination, i.e., pendulum subcontroller (PSC), cart subcontroller (CSC) and the switching subcontroller (SSC). Each of the subcontrollers is designed based on the rules and guidelines obtained from the experiences of a human operator. The simulation result is included to show the actual performance of the controller.

Vague Neural Network Based Reinforcement Learning Control System For Inverted Pendulum

Control of the Double Inverted Pendulum Based on Reinforcement Learning

Solve the Inverted Pendulum Problem Base on DQN Algorithm

Learning biped locomotion based on Q-learning and neural networks

Swing-up and Balance Control of Inverted Pendulum Based on Reinforcement Learning

A Q-learning approach to the continuous control problem of robot inverted pendulum balancing

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Vague Neural Network Controller and Its Applications.

Neural-fuzzy BOXES control system with reinforcement learning and its applications to inverted pendulum

Design Of Reinforce Learning Control Algorithm And Verified In Inverted Pendulum

Balance Controller Design for Inverted Pendulum Considering Detail Reward Function and Two-Phase Learning Protocol

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Adaptive Control of an Inverted Pendulum by a Reinforcement Learning-based LQR Method

Design Of Reinforcement Learning Algorathm For Single Inverted Pendulum Swing Control

A Kernel-Based Reinforcement Learning Approach To Stochastic Pole Balancing Control Systems

Model-free Optimal Vibration Control of a Nonlinear System Based on Deep Reinforcement Learning

A Novel Adaptive Control Algorithm Based On Reinforcement Learning

Application of Adaptive Reinforcement Learning for State Space Construction

A Rule-Based Neural Controller for Inverted Pendulum System

RBF Neural Network Control Based on Inverted Pendulum Model

Active Exploration Planning in Reinforcement Learning for Inverted Pendulum System Control