Abstract:This paper tries to demonstrate how a heuristic neural control approach can be used to solve a complex nonlinear control problem. The control task is to swing up a pendulum mounted on a cart from its stable position (vertically down) to the zero state (up right) and keep it there by applying a sequence of two opposing constant forces of equal magnitude to the mass center of the cart. In addition, the displacement of the cart itself is confined to within a preset limit during the swinging up action and it will eventually be brought to the origin of the track. This is truly a nontrivial nonlinear regulation problem and is considerably difficult compared to the pendulum balancing problem (and its variations) widely adopted as a benchmarking test system for neural controllers. Through the solution of this specific control problem, we try to illustrate a heuristic neural control approach with task decomposition, control rule extraction and neural net rule implementation as its basic elements. Specializing to the pendulum problem, the global control task is decomposed into subtasks namely pendulum positioning and cart positioning. Accordingly, three separate neural subcontrollers are designed to cater to the subtasks and their coordination, i.e., pendulum subcontroller (PSC), cart subcontroller (CSC) and the switching subcontroller (SSC). Each of the subcontrollers is designed based on the rules and guidelines obtained from the experiences of a human operator. The simulation result is included to show the actual performance of the controller.

Solve the Inverted Pendulum Problem Base on DQN Algorithm

Spacecraft Attitude Maneuver Planning Based on Deep Reinforcement Learning under Complex Constraints

Stabilization of the double inverted pendulum based on discrete-time model predictive control.

Stabilize the planar single inverted pendulum based on LQR.

Learning biped locomotion based on Q-learning and neural networks

A Deep Reinforcement Learning Approach towards Pendulum Swing-up Problem based on TF-Agents

Balance Controller Design for Inverted Pendulum Considering Detail Reward Function and Two-Phase Learning Protocol

Adaptive Control of an Inverted Pendulum by a Reinforcement Learning-based LQR Method

A Q-learning approach to the continuous control problem of robot inverted pendulum balancing

Research of triple inverted pendulum based on neural network of genetic algorithm

Application of Deep Reinforcement Learning Control of an Inverted Hydraulic Pendulum

MathDQN: Solving Arithmetic Word Problems Via Deep Reinforcement Learning.

A Rule-Based Neural Controller for Inverted Pendulum System

Human-Level Control Through Directly-Trained Deep Spiking Q-Networks

Controlling a Double Inverted Pendulum Using Evolutionary Radial Basis Function Neural Network

Sim-to-Real Transfer with Action Mapping and State Prediction for Robot Motion Control

Multi‐robot path planning based on a deep reinforcement learning DQN algorithm

Balance Control for the First-order Inverted Pendulum Based on the Advantage Actor-critic Algorithm

Improved Robot Path Planning Method Based on Deep Reinforcement Learning

Motion Simulation of Flying Quadruped Robot Based on Deep Reinforcement Learning

Control strategies for inverted pendulum: A comparative analysis of linear, nonlinear, and artificial intelligence approaches