Abstract:Multi-robot formation control has been intensively studied in recent years. In practical applications, the multi-robot system's ability to independently change the formation to avoid collision among the robots or with obstacles is critical. In this study, a multi-robot adaptive formation control framework based on deep reinforcement learning is proposed. The framework consists of two layers, namely the execution layer and the decision-making layer. The execution layer enables the robot to approach its target position and avoid collision with other robots and obstacles through a deep network trained by a reinforcement learning method. The decision-making layer organizes all robots into a formation through a new leader–follower configuration and provides target positions to the leader and followers. The leader's target position is kept unchanged, while the follower's target position is changed according to the situation it encounters. In addition, to operate more effectively in environments with different levels of complexity, a hybrid switching control strategy is proposed. The simulation results demonstrate that our proposed formation control framework enables the robots to adjust formation independently to pass through obstacle areas and can be generalized to different scenarios with unknown obstacles and varying number of robots.

Kernel-based Multiagent Reinforcement Learning for Near-Optimal Formation Control of Mobile Robots

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

Relative Distributed Formation and Obstacle Avoidance with Multi-agent Reinforcement Learning

Distributed Robust Learning based Formation Control of Mobile Robots based on Bioinspired Neural Dynamics

Flexible Formation Control Using Hausdorff Distance: A Multi-agent Reinforcement Learning Approach.

Event-triggered cooperative robust formation control of multi-agent systems via reinforcement learning

A Multi-agent Formation Control Algorithm in Interference Environment

Reinforcement learning for multi-agent formation navigation with scalability

A Q-Learning-Based Parameters Adaptive Algorithm for Formation Tracking Control of Multi-Mobile Robot Systems

Learning-Based Multi-Robot Formation Control With Obstacle Avoidance

Reinforcement Learning Based Multi-robot Formation Control under Separation Bearing Orientation Scheme

Multi-robot formation control: a comparison between model-based and learning-based methods

Formation control of multiple wheeled mobile robots based on model predictive control

Optimal robust formation control for heterogeneous multi‐agent systems based on reinforcement learning

Obstacle Avoidance in Multi-Agent Formation Process Based on Deep Reinforcement Learning

Dynamic Formation Planning and Control for Robot Soccer Game with Multi-Agent Reinforcement Learning and Behavioral Model

Decentralized Multi-Robot Formation Control Using Reinforcement Learning

Cooperative Learning of Multi-Agent Systems Via Reinforcement Learning

Group Formation Tracking of Heterogeneous Multi-Agent Systems Using Reinforcement Learning

Adaptive Fixed-time Optimal Formation Control for Uncertain Nonlinear Multiagent Systems Using Reinforcement Learning

Distributed Cooperative Control of Heterogeneous Multiagent Systems for Air‐to‐Ground Formation