Collision Avoidance for Multiple UAVs in Unknown Scenarios with Causal Representation Disentanglement

Jiafan Zhuang,Zihao Xia,Gaofei Han,Boxi Wang,Wenji Li,Dongliang Wang,Zhifeng Hao,Ruichu Cai,Zhun Fan

2024-07-15

Abstract:Deep reinforcement learning (DRL) has achieved remarkable progress in online path planning tasks for multi-UAV systems. However, existing DRL-based methods often suffer from performance degradation when tackling unseen scenarios, since the non-causal factors in visual representations adversely affect policy learning. To address this issue, we propose a novel representation learning approach, \ie, causal representation disentanglement, which can identify the causal and non-causal factors in representations. After that, we only pass causal factors for subsequent policy learning and thus explicitly eliminate the influence of non-causal factors, which effectively improves the generalization ability of DRL models. Experimental results show that our proposed method can achieve robust navigation performance and effective collision avoidance especially in unseen scenarios, which significantly outperforms existing SOTA algorithms.

Robotics

What problem does this paper attempt to address?

The paper mainly addresses the collision avoidance problem for multi-Unmanned Aerial Vehicle (multi-UAV) systems in unknown scenarios. Specifically, the research focuses on how to improve the generalization ability of Deep Reinforcement Learning (DRL)-based methods in unseen environments. The paper points out that in online path planning tasks, existing DRL methods often experience performance degradation when faced with unseen scenarios. This is because visual representations contain non-causal factors that can adversely affect policy learning. To tackle this challenge, the authors propose a new representation learning method called Causal Representation Disentanglement. This method aims to identify causal and non-causal factors in the representation and only pass the causal factors for subsequent policy learning, thereby explicitly eliminating the influence of non-causal factors. Experimental results show that the proposed method can achieve robust navigation performance and effective collision avoidance, especially in unseen scenarios, with significant performance improvement compared to existing state-of-the-art (SOTA) algorithms. In short, the problem the paper attempts to solve can be summarized as: how to improve DRL-based collision avoidance algorithms for multi-UAV systems to enhance their generalization ability in unknown scenarios.

Collision Avoidance for Multiple UAVs in Unknown Scenarios with Causal Representation Disentanglement

Robust Policy Learning for Multi-UAV Collision Avoidance with Causal Feature Selection

A Reinforcement Learning-based Decentralized Method of Avoiding Multi-UAV Collision in 3-D Airspace

Deep Reinforcement Learning Approach with Multiple Experience Pools for UAV's Autonomous Motion Planning in Complex Unknown Environments

Research on collision avoidance algorithm of unmanned surface vehicle based on deep reinforcement learning

A Hybrid Human-in-the-Loop Deep Reinforcement Learning Method for UAV Motion Planning for Long Trajectories with Unpredictable Obstacles

Integrating human experience in deep reinforcement learning for multi-UAV collision detection and avoidance

EPO-S: A Constrained RL Method to Enhance UAV Safety with Spatial Representation

Multi-UAV simultaneous target assignment and path planning based on deep reinforcement learning in dynamic multiple obstacles environments

3M-RL: Multi-Resolution, Multi-Agent, Mean-Field Reinforcement Learning for Autonomous UAV Routing

Autonomous Navigation of UAV in Multi-Obstacle Environments Based on a Deep Reinforcement Learning Approach

Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments

Representation Enhancement-Based Proximal Policy Optimization for UAV Path Planning and Obstacle Avoidance

Collision-Free Path Planning for Multiple Drones Based on Safe Reinforcement Learning

Multi-UAV Autonomous Obstacle Avoidance Based on Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for UAVs Navigation in Unknown Complex Environment

Deep-Reinforcement-Learning-Based Collision Avoidance in UAV Environment

Multiple UAVs Path Planning Based on Deep Reinforcement Learning in Communication Denial Environment

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

Dynamic Multi-Agent Deep Deterministic Policy Gradient for Autonomous Navigation of Reconfigurable Unmanned Aerial Vehicle

Collision-Avoiding Flocking With Multiple Fixed-Wing UAVs in Obstacle-Cluttered Environments: A Task-Specific Curriculum- Based MADRL Approach