Abstract:Formation maintenance and collision avoidance allow multiple agents to form and maintain a specific formation in the environment and reach the final goal safely without any collisions, which are important component of the multi-agent/crowd cooperation field. We propose a two-level formation control method to simulate crowd formation. At the low level, a comprehensive group reward function is designed to train the agents to learn to collaborate to reach the goal and avoid collisions with other agents and obstacles. The Multi-Agent POsthumous Credit Assignment algorithm and curriculum learning are combined to solve the credit assignment problem in the shared group reward and the slow convergence problem of the policy in the reward-sparse environment. At the high level, we design a formation switch method to determine the compression or splitting of the formation for multiple agents passing through the narrow exit. Then the optimal reciprocal collision avoidance algorithm is adopted to compute a collision-free velocity for the team of multiple agents, on the basis of which the desired formation positions are calculated to avoid collisions between the team and the obstacles in the environment. Lastly, Hungarian algorithm is utilized to assign the formation positions to the agents as their respective target position to accelerate the process of forming. Experimental results demonstrate that our proposed approach enable multiple agents to constitute the formation shape from the starting positions quickly and maintain the shape well when moving toward the final goal. Furthermore, our model has a certain generalization ability to unseen formation shapes in the scenarios without and with obstacles.

Multi-agent Formation Maintaining RRT* (MFM-RRT*) Considering Formation Maintenance

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Multi-robot Task Plan with Optimal Path Allocation

A Multi-agent Formation Control Algorithm in Interference Environment

Optimizing Cooperative path-finding: A Scalable Multi-Agent RRT* with Dynamic Potential Fields

Path Planning for the Rapid Reconfiguration of a Multi-Robot Formation Using an Integrated Algorithm

Multi-robot Path Planning Algorithm in Dense Environments Using Particular Collision-free Traffic Rules

Reinforcement learning for multi-agent formation navigation with scalability

Optimal Multilayered Motion Planning for Multiple Differential Drive Mobile Robots with Hierarchical Prioritization (OM-MP)

The crowd cooperation approach for formation maintenance and collision avoidance using multi-agent deep reinforcement learning

A Novel Graph-Based Motion Planner of Multi-Mobile Robot Systems With Formation and Obstacle Constraints

Relative Distributed Formation and Obstacle Avoidance with Multi-agent Reinforcement Learning

Research on multi-vehicle formation control based on improved artificial potential field method

Decentralized Asynchronous Formation Planning of Multirotor Aerial Vehicles in Dynamic Environments Using Flexible Formation Graphs and Tight Trajectory Hulls

LF-ACO: an effective formation path planning for multi-mobile robot

Towards Deployment-Efficient and Collision-Free Multi-Agent Path Finding (student Abstract).

Path Planning of Multipoint Region Attraction RRT* Algorithm in Complex Environment

Automatic Leader-Follower Persistent Formation Generation With Minimum Agent-Movement in Various Switching Topologies

An Integrated Localization and Control Framework for Multi-Agent Formation

Probabilistic formation - a new idea of multi-robot formation.

Obstacle Avoidance in Multi-Agent Formation Process Based on Deep Reinforcement Learning