Abstract:Multi-agent hierarchical reinforcement learning (MAHRL) has been studied as an effective means to solve intelligent decision problems in complex and large-scale environments. However, most current MAHRL algorithms follow the traditional way of using reward functions in reinforcement learning, which limits their use to a single task. This study aims to design a multi-agent cooperative algorithm with logic reward shaping (LRS), which uses a more flexible way of setting the rewards, allowing for the effective completion of multi-tasks. LRS uses Linear Temporal Logic (LTL) to express the internal logic relation of subtasks within a complex task. Then, it evaluates whether the subformulae of the LTL expressions are satisfied based on a designed reward structure. This helps agents to learn to effectively complete tasks by adhering to the LTL expressions, thus enhancing the interpretability and credibility of their decisions. To enhance coordination and cooperation among multiple agents, a value iteration technique is designed to evaluate the actions taken by each agent. Based on this evaluation, a reward function is shaped for coordination, which enables each agent to evaluate its status and complete the remaining subtasks through experiential learning. Experiments have been conducted on various types of tasks in the Minecraft-like environment. The results demonstrate that the proposed algorithm can improve the performance of multi-agents when learning to complete multi-tasks.

Knowledge Sharing and Transfer via Centralized Reward Agent for Multi-Task Reinforcement Learning

Multiagent Reinforcement Learning for Strictly Constrained Tasks Based on Reward Recorder

Shaping in Reinforcement Learning Via Knowledge Transferred from Human-Demonstrations

Hierarchical Multi-Agent Reinforcement Learning for Cooperative Tasks with Sparse Rewards in Continuous Domain

Guiding Multi-agent Multi-task Reinforcement Learning by a Hierarchical Framework with Logical Reward Shaping

Shaping in Reinforcement Learning by Knowledge Transferred from Human-Demonstrations of a Simple Similar Task.

Selective Learning for Sample-Efficient Training in Multi-Agent Sparse Reward Tasks

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

Adaptively Shaping Reinforcement Learning Agents Via Human Reward

Reward Shaping via Meta-Learning

Learning Task-Distribution Reward Shaping with Meta-Learning.

Parallel Knowledge Transfer in Multi-Agent Reinforcement Learning

KnowRU: Knowledge Reusing via Knowledge Distillation in Multi-agent Reinforcement Learning

Efficient Exploration for Multi-Agent Reinforcement Learning Via Transferable Successor Features

Learning in Multi-Agent Systems with Sparse Interactions by Knowledge Transfer and Game Abstraction

Keeping Your Distance: Solving Sparse Reward Tasks Using Self-Balancing Shaped Rewards

Knowledge Reuse of Multi-Agent Reinforcement Learning in Cooperative Tasks

Shaping Advice in Deep Multi-Agent Reinforcement Learning

Coordinated Exploration via Intrinsic Rewards for Multi-Agent Reinforcement Learning

Sharing Knowledge in Multi-Task Deep Reinforcement Learning

KnowRU: Knowledge Reuse Via Knowledge Distillation in Multi-Agent Reinforcement Learning