Abstract:The core of multirobot collision avoidance lies in developing a decentralized policy that can guide robots from their initial positions to target locations based on the environment states perceived by the robots and ensure collision avoidance. However, the current multirobot collision avoidance policy network is challenging to simultaneously extract the global spatial state, temporal state, and reciprocity among robots, which limits its performance. In this work, we have developed a novel reciprocal velocity obstacle (RVO) spatial-temporal network and employed the proximal policy optimization algorithm to train the network parameters during interactions with amultirobot simulation environment. Specifically, a temporal state encoder module, utilized to represent the temporal characteristics of observation sequence data, is designed and achieved through the combination of the graph attention mechanism and the transformer encoding module. Furthermore, we design a reciprocal spatial state encoder module achieved through the use of a transformer encoding module to merge feature data from long short-term memory (LSTM), GRU, and bidirectional gated recurrent units (BiGRUs) branches, serving the purpose of representing spatial characteristics in RVO sequence data. Extensive simulation experiments demonstrate that our proposed method outperforms the state-of-the-art distributed policy reinforcement learning (RL)-RVO. We further conducted physical experiments using three Crazyflie quadcopter drones, illustrating its ability to effectively guide agents’ movements and avoid collisions.

Autonomous Navigation of Quadrotors in Dynamic Complex Environments

Autonomous Flights in Dynamic Environments with Onboard Vision

Quadrotor Trajectory Generation in Dynamic Complex Environments

Alternating Minimization Based Trajectory Generation for Quadrotor Aggressive Flight

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Rapid Quadrotor Navigation in Diverse Environments using an Onboard Depth Camera

Autonomous Navigation Of A Quadrotor In Unknown Environments

Real-time Quadrotor Navigation Through Planning in Depth Space in Unstructured Environments

Safe Interval Motion Planning for Quadrotors in Dynamic Environments

A Low-Cost Autonomous Navigation System for a Quadrotor in Complex Outdoor Environments

Risk-aware Trajectory Sampling for Quadrotor Obstacle Avoidance in Dynamic Environments

Quadrotor Autonomous Navigation in Semi-Known Environments Based on Deep Reinforcement Learning

Perception-Aware Baesd Quadrotor Translation and Yaw Angle Planner in Unpredictable Dynamic Situations

Obstacle-Aware Topological Planning over Polyhedral Representation for Quadrotors.

Visual Autonomous Quadrotor Navigation Using an Improved Artificial Potential Field

Flying in Narrow Spaces: Prioritizing Safety with Disturbance-Aware Control

Robust Online Obstacle Detection and Tracking for Collision-Free Navigation of Multirotor UAVs in Complex Environments.

RRT* Combined with GVO for Real-time Nonholonomic Robot Navigation in Dynamic Environment

Autonomous Mapping and Exploration Quadrotor System Using Ambient Environment Based Approach

An Approach for Multi-Objective Obstacle Avoidance Using Dynamic Occupancy Grid Map

Reciprocal Velocity Obstacle Spatial-Temporal Network for Distributed Multirobot Navigation