Abstract:Generating collision-free, time-efficient paths in an uncertain dynamic environment poses huge challenges for the formation control with collision avoidance (FCCA) problem in a leader-follower structure. In particular, the followers have to take both formation maintenance and collision avoidance into account simultaneously. Unfortunately, most of the existing works are simple combinations of methods dealing with the two problems separately. In this article, a new method based on deep reinforcement learning (RL) is proposed to solve the problem of FCCA. Especially, the learning-based policy is extended to the field of formation control, which involves a two-stage training framework: an imitation learning (IL) and later an RL. In the IL stage, a model-guided method consisting of a consensus theory-based formation controller and an optimal reciprocal collision avoidance strategy is designed to speed up training and increase efficiency. In the RL stage, a compound reward function is presented to guide the training. In addition, we design a formation-oriented network structure to perceive the environment. Long short-term memory is adopted to enable the network structure to perceive the information of obstacles of an uncertain number, and a transfer training approach is adopted to improve the generalization of the network in different scenarios. Numerous representative simulations are conducted, and our method is further deployed to an experimental platform based on a multiomnidirectional-wheeled car system. The effectiveness and practicability of our proposed method are validated through both the simulation and experiment results.

Improved Leader-Follower Method in Formation Transformation Based on Greedy Algorithm.

Formation Transformation Based on Leader-Follower Algorithm

Distributed Swarm Trajectory Optimization for Formation Flight in Dense Environments

Adaptive leader-follower formation control for autonomous mobile robots

Leader-following Formation Control Based on Pursuit Strategies

Distributed Fuzzy Leader-Follower Vehicular Formation Control with Appointed-Time Performances and Obstacle Avoidance

A Multi-agent Formation Control Algorithm in Interference Environment

A Hybrid Path Planning and Formation Control Strategy of Multi-Robots in a Dynamic Environment

Distributed Leader-Follower Affine Formation Maneuver Control for High-Order Multiagent Systems

Leader-Following Formation Control of Multiple Mobile Robots

Multi-Agent Formation Control With Obstacle Avoidance Based On Receding Horizon Strategy

Improved Q -Learning Method for Multirobot Formation and Path Planning with Concave Obstacles

Leader-follower Formation Control for a Multi-missile System Via Deep Reinforcement Learning

An Affection-Based Dynamic Leader Selection Model for Formation Control in Multirobot Systems

Adaptive Leader–Follower Formation Control of Underactuated Surface Vehicles with Guaranteed Performance

Integrated the Artificial Potential Field with the Leader–Follower Approach for Unmanned Aerial Vehicles Cooperative Obstacle Avoidance

Leader-Following Formation Tracking of Multiagent Systems Using Adaptive Scaling Mechanism under Spatial Constraints

Flexible leadership in obstacle environment

Study on Learning Algorithm of Transfer Reinforcement for Multi-Agent Formation Control

Formation Control With Collision Avoidance Through Deep Reinforcement Learning Using Model-Guided Demonstration

Research on synergic Control Algorithm and Collision Avoidance of unmanned aerial vehicle Formation