Abstract:Motivated by the prototypical problem of a marching band, this paper studies a class of multi-agent formation problems characterized by two features: (i) the agents attempt to complete a finite duration, coordinated formation task with high precision by repeating the task and (ii) the feedback mechanism by which the agents control their motions is based on relative differences between nearest neighbors, but the underlying graph topology can vary both during a repetition and from one repetition to the next. Adopting the framework of iterative learning control leads to the notion of multi-agent networks with switching topologies along two directions: a finite time axis and an infinite iteration axis. For such systems, we present distributed algorithms using nearest neighbor information whose exponential convergence can be demonstrated. It is shown that as the number of repetition increases, the relative formation between agents approaches the desired formation exponentially fast if and only if at each time step, the union of the interaction graphs has a spanning tree frequently enough along the iteration axis. That is, the agents can “learn to cooperate.” The remarkable point of this result is that it is not necessary to have a spanning tree at any specific time step or iteration in order for the system to converge. Two examples are given to illustrate the ideas, including a general example, where through iteration the agents can form a desired formation, and a special case of it, where an additional agent specifies a reference to regulate the formation shape simultaneously.

Learning to Cooperate: Networks of Formation Agents with Switching Topologies

Learning Intra-group Cooperation in Multi-agent Systems.

On Iterative Learning Algorithms for the Formation Control of Nonlinear Multi-Agent Systems.

Formation control of multi-agent systems with switching topologies: An ILC-based distributed algorithm design

Moving Forward in Formation: A Decentralized Hierarchical Learning Approach to Multi-Agent Moving Together

High‐precision formation control of nonlinear multi‐agent systems with switching topologies: A learning approach

Transient Bipartite Synchronization for Cooperative-Antagonistic Multiagent Systems with Switching Topologies

Robust cooperative learning control for directed networks with nonlinear dynamics.

Formation learning algorithms for mobile agents subject to 2-D dynamically changing topologies

Cooperative iterative learning for uncertain nonlinear agents in leaderless switching networks

Cooperative Learning for Switching Networks with Nonidentical Nonlinear Agents

An Iterative Learning Control Approach For Synchronization Of Multi-Agent Systems Under Iteration-Varying Graph

An Iterative Learning Approach to Formation Control of Multi-Agent Systems.

Formation Control of Multi-Agent Systems with Stochastic Switching Topology and Time-Varying Communication Delays

Formation Control of Discrete-Time Multi-Agent Systems by Iterative Learning Approach

ILC-motivated Formation Algorithm for Multi-Agent Systems with Communication Time-Delays

Distributed Formation Control with Open-Loop Nash Strategy

Time-varying formation control for general linear multi-agent systems with switching directed topologies

Formation iterative learning control for multi-agent systems with higher-order dynamics

Coordination Learning Control for Groups of Mobile Agents.

Learning and Innovation Expand Cooperative Network Topologies