Abstract:In this paper, balance control of a bicycle robot is studied without either a trail or a mechanical regulator when the robot moves in an approximately rectilinear motion. Based on the principle of moment balance, an input nonaffine nonlinear dynamics model of the bicycle robot is established. A driving velocity condition is proposed to maintain the robot balance. The nonaffine nonlinear system is transformed into an affine nonlinear system by defining the equivalent control. Subsequently, a feedback linearization controller is designed for the equivalent control. We design a combined control algorithm of synchronous policy iteration based on the actor-critic architecture. The actor neural network (NN) is designed based on the feedback linearization control law. Weight tuning laws for the critic and actor NNs are proposed. The system closed-loop stability and convergence of the NN weights are guaranteed based on the Lyapunov analysis. The optimality of the equivalent control policy is guaranteed. To satisfy the driving velocity condition, the values of the steering angle and driving velocity are determined based on the optimal equivalent control. The effectiveness of the proposed algorithm is verified through simulations and real experiments.

Balance Control of Two-Wheeled Robot Based on Reinforcement Learning.

Learning to Control Two-Wheeled Self-Balancing Robot Using Reinforcement Learning Rules

Model Learning for Two-Wheeled Robot Self-Balance Control

Learning to Control Two-Wheeled Self-Balancing Robot Using Reinforcement Learning Rules and Fuzzy Neural Networks

Self-balance Learning of Two-wheeled Robot Based on Autonomous Operant Conditioning Automata

The Control of Two-Wheeled Self-Balancing Vehicle Based on Reinforcement Learning in a Continuous Domain

A Balance Control Method for Wheeled Bipedal Robot Based on Reinforcement Learning

Self-Balance Control of Two-Wheeled Robot Based on Skinner's Operant Conditioning

On-line NNAC for Two-Wheeled Self-Balancing Robot Based on Feedback-Error-Learning

Balance Control Of Robot With Cmac Based Q-Learning

On-line NNAC for a Balancing Two-Wheeled Robot Using Feedback-Error-Learning on the Neurophysiological Mechanism.

Application of Self-learning Algorithm Based on Parameter Optimization in Control of Two Wheeled Robot

High Maneuverability Control of Single-track Two-wheeled Robot in Narrow Terrain Based on Reinforcement Learning.

Application of Neural PID Controller to Two-wheeled Robot Control

Bionic Learning Algorithm Based on Skinner'S Operant Conditioning and Control of Robot

Learning-Based Balance Control of Wheel-Legged Robots

Dynamic model and balance control of two-wheeled robot with non-holonomic constraints

Self-Learning of Robot Based on Skinner's Operant Conditioning

The Research on Balancing Control of Two Wheel Self-balance Robot

Combined control algorithm based on synchronous reinforcement learning for a self-balancing bicycle robot

Researching of Two-Wheeled Self-Balancing Robot Base on LQR Combined with PID