Abstract:In this work, we combined the model based reinforcement learning ( MBRL ) and model free reinforcement learning ( MFRL ) to stabilize a biped robot ( NAO robot ) on a rotating platform, where the angular velocity of the platform is unknown for the proposed learning algorithm and treated as the external disturbance. Nonparametric Gaussian processes normally require a large number of training data points to deal with the discontinuity of the estimated model. Although some improved method such as probabilistic inference for learning control ( PILCO ) does not require an explicit global model as the actions are obtained by directly searching the policy space, the overfitting and lack of model complexity may still result in a large deviation between the prediction and the real system. Besides, none of these approaches consider the data error and measurement noise during the training process and test process, respectively. We propose a hierarchical Gaussian processes ( GP ) models, containing two layers of independent GPs, where the physically continuous probability transition model of the robot is obtained. Due to the physically continuous estimation, the algorithm overcomes the overfitting problem with a guaranteed model complexity, and the number of training data is also reduced. The policy for any given initial state is generated automatically by minimizing the expected cost according to the predefined cost function and the obtained probability distribution of the state. Furthermore, a novel Q ( λ ) based MFRL method scheme is employed to improve the policy. Simulation results show that the proposed RL algorithm is able to balance NAO robot on a rotating platform, and it is capable of adapting to the platform with varying angular velocity.

Gaussian Process-Based Learning Control of Underactuated Balance Robots with an External and Internal Convertible Modeling Structure

Gaussian Process-Based Learning Control of Underactuated Balance Robots with an External and Internal Convertible Modeling Structure

Gaussian Process-Enhanced, External and Internal Convertible (EIC) Form-Based Control of Underactuated Balance Robots

Gaussian Processes Model-based Control of Underactuated Balance Robots

Learning-Based Trajectory Tracking and Balance Control for Bicycle Robots with a Pendulum: A Gaussian Process Approach

Active Design of Dynamic GP Models for Model Predictive Control Using Expected Improvement

Learning-Based Design of Off-Policy Gaussian Controllers: Integrating Model Predictive Control and Gaussian Process Regression

Balance control of a biped robot on a rotating platform based on efficient reinforcement learning

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Computation-Aware Learning for Stable Control with Gaussian Process

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

Safe Machine-Learning-supported Model Predictive Force and Motion Control in Robotics

Gaussian Process Based Tracking Control for Robot Manipulators with Dynamical Uncertainties

An Active Learning Based Robot Kinematic Calibration Framework Using Gaussian Processes

Attitude Takeover Control for Noncooperative Space Targets Based on Gaussian Processes with Online Model Learning

Provably Stabilizing Global-Position Tracking Control for Hybrid Models of Multi-Domain Bipedal Walking via Multiple Lyapunov Analysis

Optimizing Execution of Dynamic Goal-Directed Robot Movements with Learning Control

Gaussian Process Model Predictive Control of An Unmanned Quadrotor

Dual Control with Active Learning using Gaussian Process Regression

Bridging Reinforcement Learning and Iterative Learning Control: Autonomous Motion Learning for Unknown, Nonlinear Dynamics

Exponentially Stable Projector-based Control of Lagrangian Systems with Gaussian Processes