Abstract:At present, robots typically require extensive training to successfully accomplish a single task. However, to truly enhance their usefulness in real-world scenarios, robots should possess the capability to perform multiple tasks effectively. To address this need, various multi-task reinforcement learning (RL) algorithms have been developed, including multi-task proximal policy optimization (PPO), multi-task trust region policy optimization (TRPO), and multi-task soft-actor critic (SAC). Nevertheless, these algorithms demonstrate optimal performance only when operating within an environment or observation space that exhibits a similar distribution. In reality, such conditions are often not the norm, as robots may encounter scenarios or observations that differ from those on which they were trained. Addressing this challenge, algorithms like Q-Weighted Adversarial Learning (QWALE) attempt to tackle the issue by training the base algorithm (generating prior data) solely for a particular task, rendering it unsuitable for generalization across tasks. So, the aim of this research project is to enable a robotic arm to successfully execute seven distinct tasks within the Meta World environment. To achieve this, a multi-task soft actor-critic (MT-SAC) is employed to train the robotic arm. Subsequently, the trained model will serve as a source of prior data for the single-life RL algorithm. The effectiveness of this MT-QWALE algorithm will be assessed by conducting tests on various target positions (novel positions). In the end, a comparison is provided between the trained MT-SAC and the MT-QWALE algorithm where the MT-QWALE performs better. An ablation study demonstrates that MT-QWALE successfully completes tasks with a slightly larger number of steps even after hiding the final goal position.

Efficient Multi-Task Reinforcement Learning via Task-Specific Action Correction

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

A Brain-Inspired Incremental Multi-task Reinforcement Learning Approach

Theoretical Study of Conflict-Avoidant Multi-Objective Reinforcement Learning

T3S: Improving Multi-Task Reinforcement Learning with Task-Specific Feature Selector and Scheduler.

Multi-Task Multi-Agent Reinforcement Learning With Interaction and Task Representations

Multi-Task Reinforcement Learning for Quadrotors

A Decentralized Policy Gradient Approach to Multi-task Reinforcement Learning

Enhancing Robotic Manipulation: Harnessing the Power of Multi-Task Reinforcement Learning and Single Life Reinforcement Learning in Meta-World

QMP: Q-switch Mixture of Policies for Multi-Task Behavior Sharing

Multi-Task Reinforcement Learning with Soft Modularization.

Sample Efficient Myopic Exploration Through Multitask Reinforcement Learning with Diverse Tasks

Contrastive Modules with Temporal Attention for Multi-Task Reinforcement Learning

Multi-Task Reinforcement Learning with Attention-Based Mixture of Experts.

HarmoDT: Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning

Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning

Prioritized Hindsight with Dual Buffer for Meta-Reinforcement Learning

Multi-Task Recommendations with Reinforcement Learning

Additional Planning with Multiple Objectives for Reinforcement Learning.

Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts

Multi-task Learning with Gradient Guided Policy Specialization