Abstract:The development of intelligent robots requires control policies that can handle dynamic environments and evolving tasks. Pre-training reinforcement learning has emerged as an effective approach to address these demands by enabling robots to acquire reusable motor skills. However, they often rely on large datasets or expert-designed goal spaces, limiting adaptability. Additionally, these methods need help to generate dynamic and diverse skills in high-dimensional state spaces, reducing their effectiveness for downstream tasks. In this paper, we propose CMS-PRL, a pre-training reinforcement learning method inspired by the Central Motor System (CMS). First, we introduce a fusion reward mechanism that combines the basic motor reward with mutual information reward, promoting the discovery of dynamic skills during pre-training without reliance on external data. Second, we design a skill encoding method inspired by the motor program of the basal ganglia, providing rich and continuous skill instructions during pre-training. Finally, we propose a skill activity function to regulate motor skill activity, enabling the generation of skills with different activity levels, thereby enhancing the robot's flexibility in downstream tasks. We evaluate the model on four types of robots in a challenging set of sparse-reward tasks. Experimental results demonstrate that CMS-PRL generates diverse, reusable motor skills to solve various downstream tasks and outperforms baseline methods, particularly in high-degree-of-freedom robots and complex tasks.

Robot Reinforcement Learning Based on LCS-GDM

Robot Simulation and Reinforcement Learning Training Platform Based on Distributed Architecture.

CLFR-M: Continual Learning Framework for Robots Via Human Feedback and Dynamic Memory

Learning Classifier System Ensemble for Data Mining

Pittsburgh Learning Classifier Systems for Explainable Reinforcement Learning: Comparing with XCS

Ensemble learning classifier system and compact ruleset

Research on Continuous Learning Classifier System

Deep Model-Based Reinforcement Learning for Predictive Control of Robotic Systems with Dense and Sparse Rewards

Reinforcement Learning Within the Classical Robotics Stack: A Case Study in Robot Soccer

Hybrid LMC: Hybrid Learning and Model-based Control for Wheeled Humanoid Robot via Ensemble Deep Reinforcement Learning

LMRL: a Multi-Agent Reinforcement Learning Model and Algorithm

Autonomous Learning and Navigation of Mobile Robots Based on Deep Reinforcement Learning

A Central Motor System Inspired Pre-training Reinforcement Learning for Robotic Control

Self-Refined Large Language Model as Automated Reward Function Designer for Deep Reinforcement Learning in Robotics

Learning of Long-Horizon Sparse-Reward Robotic Manipulator Tasks With Base Controllers

A Genetic Fuzzy System for Interpretable and Parsimonious Reinforcement Learning Policies

LIGS: Learnable Intrinsic-Reward Generation Selection for Multi-Agent Learning

C3F: Constant Collaboration and Communication Framework for Graph-Representation Dynamic Multi-Robotic Systems

Development of an algorithm for managing a multi-robot system for cargo transportation based on reinforcement learning in a virtual environment

Robot Control in Human Environment Using Deep Reinforcement Learning and Convolutional Neural Network.

A Two-Layered Multi-Agent Reinforcement Learning Model and Algorithm