Abstract:With the popularization of intelligence, the necessity of cooperation between intelligent machines makes the research of collaborative multi-agent reinforcement learning (MARL) more extensive. Existing approaches typically address this challenge through task decomposition of the environment or role classification of agents. However, these studies may rely on the sharing of parameters between agents, resulting in the homogeneity of agent behavior, which is not effective for complex tasks. Or training that relies on external rewards is difficult to adapt to scenarios with sparse rewards. Based on the above challenges, in this paper we propose a novel dynamic skill learning (DSL) framework for agents to learn more diverse abilities motivated by internal rewards. Specifically, the DSL has two components: (i) Dynamic skill discovery, which encourages the production of meaningful skills by exploring the environment in an unsupervised manner, using the inner product between a skill vector and a trajectory representation to generate intrinsic rewards. Meanwhile, the Lipschitz constraint of the state representation function is used to ensure the proper trajectory of the learned skills. (ii) Dynamic skill assignment, which utilizes a policy controller to assign skills to each agent based on its different trajectory latent variables. In addition, in order to avoid training instability caused by frequent changes in skill selection, we introduce a regularization term to limit skill switching between adjacent time steps. We thoroughly tested the DSL approach on two challenging benchmarks, StarCraft II and Google Research Football. Experimental results show that compared with strong benchmarks such as QMIX and RODE, DSL effectively improves performance and is more adaptable to difficult collaborative scenarios.

MT-RSL

GSC: A Graph-Based Skill Composition Framework for Robot Learning

MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale

CLFR-M: Continual Learning Framework for Robots Via Human Feedback and Dynamic Memory

RoboMatrix: A Skill-centric Hierarchical Framework for Scalable Robot Task Planning and Execution in Open-World

A learning framework for semantic reach-to-grasp tasks integrating machine learning and optimization.

Multi-Task Multi-Agent Reinforcement Learning With Interaction and Task Representations

Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition

A Task Learning Mechanism for the Telerobots

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

Combining Model-Based $Q$ -Learning with Structural Knowledge Transfer for Robot Skill Learning

Efficient Multi-Task Reinforcement Learning via Task-Specific Action Correction

Enhancing Robot Manipulation Skill Learning with Multi-task Capability Based on Transformer and Token Reduction

PRRM: An Efficient Framework for Learning Multi-step Robotic Manipulation Tasks

LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulation

Multi-Stage Decision-Making Skill Learning for Soccer Robot

ARO: Large Language Model Supervised Robotics Text2Skill Autonomous Learning

Skill Transformer: A Monolithic Policy for Mobile Manipulation

Heterogeneous Skill Learning for Multi-agent Tasks

Skill matters: Dynamic skill learning for multi-agent cooperative reinforcement learning

MHRC: Closed-loop Decentralized Multi-Heterogeneous Robot Collaboration with Large Language Models