Abstract:In this work, we combined the model based reinforcement learning ( MBRL ) and model free reinforcement learning ( MFRL ) to stabilize a biped robot ( NAO robot ) on a rotating platform, where the angular velocity of the platform is unknown for the proposed learning algorithm and treated as the external disturbance. Nonparametric Gaussian processes normally require a large number of training data points to deal with the discontinuity of the estimated model. Although some improved method such as probabilistic inference for learning control ( PILCO ) does not require an explicit global model as the actions are obtained by directly searching the policy space, the overfitting and lack of model complexity may still result in a large deviation between the prediction and the real system. Besides, none of these approaches consider the data error and measurement noise during the training process and test process, respectively. We propose a hierarchical Gaussian processes ( GP ) models, containing two layers of independent GPs, where the physically continuous probability transition model of the robot is obtained. Due to the physically continuous estimation, the algorithm overcomes the overfitting problem with a guaranteed model complexity, and the number of training data is also reduced. The policy for any given initial state is generated automatically by minimizing the expected cost according to the predefined cost function and the obtained probability distribution of the state. Furthermore, a novel Q ( λ ) based MFRL method scheme is employed to improve the policy. Simulation results show that the proposed RL algorithm is able to balance NAO robot on a rotating platform, and it is capable of adapting to the platform with varying angular velocity.

Learning to Control Two-Wheeled Self-Balancing Robot Using Reinforcement Learning Rules and Fuzzy Neural Networks

Balance Control of Two-Wheeled Robot Based on Reinforcement Learning.

The Control of Two-Wheeled Self-Balancing Vehicle Based on Reinforcement Learning in a Continuous Domain

Model Learning for Two-Wheeled Robot Self-Balance Control

Self-learning Fuzzy PID Controller Based on Neural Networks

A Residual Meta-Reinforcement Learning Method for Training Fault-Tolerant Policies for Quadruped Robots

High Maneuverability Control of Single-track Two-wheeled Robot in Narrow Terrain Based on Reinforcement Learning.

Balance Control of Two-Wheeled Self-Balancing Mobile Robot Based on TS Fuzzy Model

Fuzzy adaptive applied on robot walk-balancing control

Combined control algorithm based on synchronous reinforcement learning for a self-balancing bicycle robot

Fuzzy neural network-based real-time self-reaction of mobile robot in unknown environments

Learning Ball-balancing Robot Through Deep Reinforcement Learning

Continuous Reinforcement Learning Based Ramp Jump Control for Single-Track Two-Wheeled Robots

Deep Reinforcement Learning-Based Control of Bicycle Robots on Rough Terrain

Application of Neural PID Controller to Two-wheeled Robot Control

Reinforcement Learning-Based Control of Single-Track Two-Wheeled Robots in Narrow Terrain

Control of Mobile Robot Using Prediction-based FNN

Online Series-Parallel Reinforcement-Learning-Based Balancing Control for Reaction Wheel Bicycle Robots on a Curved Pavement

Balance control of a biped robot on a rotating platform based on efficient reinforcement learning

Learning-Based Balance Control of Wheel-Legged Robots

Real-time self-reaction of mobile robot with genetic fuzzy neural network in unknown environment