Multi-Agent Model Predictive Control: A Survey

R. R. Negenborn,B. De Schutter,J. Hellendoorn

DOI: https://doi.org/10.48550/arXiv.0908.1076

2009-08-07

Multiagent Systems

Abstract:In this report we define characteristic control design elements and show how conventional single-agent MPC implements these. We survey recent literature on multi-agent MPC and discuss how this literature deals with decomposition, problem assignment, and cooperation.

What problem does this paper attempt to address?

Get the design right, the rest is automatic: Towards an adaptive MPC controller

Yucai Zhu,Zuhua Xu,Jun Zhao,Kai Han,Jixin Qian,Weixin Li

2009-01-01

Abstract:Model predictive control technology has brought huge benefit in the refining/petrochemical industry and starts to attract attention of other process industries. However, sustainability is a big challenge in MPC applications due to its technical difficulties and high cost in human resources. In order to considerably reduce the difficulties and costs of MPC deployment and maintenance, we introduce an adaptive MPC controller. The adaptive MPC consists of three modules: an MPC control module, an online identification module and a control monitor module. The three modules work together coherently in real-time. During MPC commissioning, the online identification module and the MPC control module work together and perform various steps in MPC implementation automatically. When the MPC controller is online, the control monitor module continuously monitors the MPC performance and model quality. When control performance degradation and considerable model error are detected, monitor module will start the maintenance by activating the online identification module. The identification module will re-identify the model and replace the old model. Most of the steps can be done automatically under the supervision of the operator. The scarce control expert is only needed in controller design. A prototype of the adaptive MPC controller has applied successfully to two PTA units and the results will be reported.
On the Control of Multi-Agent Systems: A Survey

Fei Chen,Wei Ren

DOI: https://doi.org/10.1561/2600000019

2019-01-01

Foundations and Trends® in Systems and Control

Abstract:Recent years have witnessed a trend to use networked multiple autonomous agents to accomplish complex tasks arising from space-based applications, smart grids, and machine learning. Such systems are referred to as multi-agent systems, where a global objective is achieved via the local interactions among the agents. The recent two decades have witnessed a rapid development of MASs in automatic control, but their root can be traced back much earlier. This paper reviews the research progress of MASs in past years. After briefly introducing the basic concepts and definitions, we discuss agents’ dynamic models, including both linear and nonlinear models, describe different cooperating tasks, such as consensus, coordinating tracking, formation control, distributed average tracking, distributed estimation, containment control, surrounding control, and distributed optimization. We introduce various research issues for MASs, including time-delays, noise or disturbance, quantization, connectivity maintenance, and event-triggered control. We present different MAS control algorithms, including proportional control, proportionalintegral control, adaptive control, model predictive control, passivity-based control, and nonsmooth control, and their applications in multi-robot systems, sensor networks, smart grid, machine learning, social networks, and many-core microprocessors.

English Else
Model predictive control: Theory and practice—A survey

Carlos E. García,David M. Prett,Manfred Morari

DOI: https://doi.org/10.1016/0005-1098(89)90002-2

IF: 6.4

1989-05-01

Automatica

Abstract:We refer to Model Predictive Control (MPC) as that family of controllers in which there is a direct use of an explicit and separately identifiable model. Control design methods based on the MPC concept have found wide acceptance in industrial applications and have been studied by academia. The reason for such popularity is the ability of MPC designs to yield high performance control systems capable of operating without expert intervention for long periods of time. In this paper the issues of importance that any control system should address are stated. MPC techniques are then reviewed in the light of these issues in order to point out their advantages in design and implementation. A number of design techniques emanating from MPC, namely Dynamic Matrix Control, Model Algorithmic Control, Inferential Control and Internal Model Control, are put in perspective with respect to each other and the relation to more traditional methods like Linear Quadratic Control is examined. The flexible constraint handling capabilities of MPC are shown to be a significant advantage in the context of the overall operating objectives of the process industries and the 1-, 2-, and ∞-norm formulations of the performance objective are discussed. The application of MPC to non-linear systems is examined and it is shown that its main attractions carry over. Finally, it is explained that though MPC is not inherently more or less robust than classical feedback, it can be adjusted more easily for robustness.

automation & control systems,engineering, electrical & electronic
Model Predictive Control for Multi-Agent Systems under Limited Communication and Time-Varying Network Topology

Danilo Saccani,Lorenzo Fagiano,Melanie N. Zeilinger,Andrea Carron

2023-04-04

Abstract:In control system networks, reconfiguration of the controller when agents are leaving or joining the network is still an open challenge, in particular when operation constraints that depend on each agent's behavior must be met. Drawing our motivation from mobile robot swarms, in this paper, we address this problem by optimizing individual agent performance while guaranteeing persistent constraint satisfaction in presence of bounded communication range and time-varying network topology. The approach we propose is a model predictive control (MPC) formulation, building on multi-trajectory MPC (mt-MPC) concepts. To enable plug and play operations when the system is in closed-loop without the need of a request, the proposed MPC scheme predicts two different state trajectories in the same finite horizon optimal control problem. One trajectory drives the system to the desired target, assuming that the network topology will not change in the prediction horizon, while the second one ensures constraint satisfaction assuming a worst-case scenario in terms of new agents joining the network in the planning horizon. Recursive feasibility and stability of the closed-loop system during plug and play operations are shown. The approach effectiveness is illustrated with a numerical simulation.

Systems and Control
Distributed Model Predictive Control: An Overview and Roadmap of Future Research Opportunities

R. R. Negenborn,J. M. Maestre

DOI: https://doi.org/10.1109/mcs.2014.2320397

2014-08-01

IEEE Control Systems

Abstract:Model-predictive control (MPC) is an optimization-based control technique that uses 1) a mathematical model of a system to predict the system's behavior over a given horizon, 2) an objective function that represents what system behavior is desirable, 3) a mathematical formalization of operational constraints that have to be satisfied, 4) measurements of the state of the system at each time step, and 5) any information regarding upcoming disturbances that may be available. This article surveyed and categorized 35 distributed MPC approaches. Subsequently, several of the insights gained from the survey were presented. This study provides a picture of what features have received more or less attention over the last years, bringing about potential research niches for new approaches.
A Survey on Manipulator Control Using Multi-Agent Method

ZHANG Chuan-qing,CHEN Ken,ZHAO Zheng-da,YAN Hua,WANG Li-qiang

DOI: https://doi.org/10.3969/j.issn.1001-3997.2011.10.057

2011-01-01

Abstract:Traditional model-based control method has encountered many difficulties when it is applied to complex manipulator system.Many scholars used MAS(Multi-Agent)technology to build behavior-based manipulator control system and satisfied results have been achieved in the past decade.The multi-agent based manipulator control theory,algorithm and the corresponding control system structure,operating platform and interactive modeling for the MAS are summarized.Then the advantages and disadvantages for manipulator control with Multi-agent technology are reviewed.Finally the future application of the Muti-agent method in manipulator system is explored.
Consensus of Sampled-Data Multi-Agent Networking Systems Via Model Predictive Control

Jingyuan Zhan,Xiang Li

DOI: https://doi.org/10.1016/j.automatica.2013.04.037

IF: 6.4

2013-01-01

Automatica

Abstract:This paper presents a theoretical framework to design and analyze the consensus of a sampled-data multi-agent networking system via model predictive control (MPC). We introduce a distributed MPC weighted-average consensus protocol for a continuous-time multi-agent network in the sampled-data setting, and prove such a sampled-data multi-agent system asymptotically reaches the weighted-average consensus via the distributed MPC protocol with both fixed and switching network topologies. Numerical examples verify the effectiveness of the distributed MPC consensus protocol, which is beneficial to the convergence of consensus and the feasible range of the sampling interval.
Active Learning-based Model Predictive Coverage Control

Rahel Rickenbach,Johannes Köhler,Anna Scampicchio,Melanie N. Zeilinger,Andrea Carron

DOI: https://doi.org/10.1109/TAC.2024.3365569

2024-03-29

Abstract:The problem of coverage control, i.e., of coordinating multiple agents to optimally cover an area, arises in various applications. However, coverage applications face two major challenges: (1) dealing with nonlinear dynamics while respecting system and safety critical constraints, and (2) performing the task in an initially unknown environment. We solve the coverage problem by using a hierarchical framework, in which references are calculated at a central server and passed to the agents' local model predictive control (MPC) tracking schemes. Furthermore, to ensure that the environment is actively explored by the agents a probabilistic exploration-exploitation trade-off is deployed. In addition, we derive a control framework that avoids the hierarchical structure by integrating the reference optimization in the MPC formulation. Active learning is then performed drawing inspiration from Upper Confidence Bound (UCB) approaches. For all developed control architectures, we guarantee closed-loop constraint satisfaction and convergence to an optimal configuration. Furthermore, all methods are tested and compared on hardware using a miniature car platform.

Systems and Control
Survey of containment control in multi-agent systems: concepts, communication, dynamics, and controller design

Mourya Thummalapeta,Yen-Chen Liu

DOI: https://doi.org/10.1080/00207721.2023.2250041

2023-08-27

International Journal of Systems Science: Operations & Logistics

Abstract:Cooperative robotics has gained considerable traction in the industrial sector with the expeditious use of multi-agent systems. Containment control is an emergent topic in cooperative multi-agent systems, with applications in areas such as warehouse robotics, inventory management, and transportation. Containment control is an amalgamation of formation and consensus control, which predominantly uses groups of multiple agents assigned as leaders and followers. This survey paper provides a comprehensive overview of key topics in containment control of multi-agent systems ranging from containment concepts to controllers. The paper discusses the role of communication and network topologies, the importance of accurate sensor measurements and agent dynamics, and various controller design and stability analysis techniques. The paper concludes by highlighting the promising research directions and challenges in the field along with real-world applications. Overall, this survey paper provides a valuable resource for researchers, practitioners, and students interested in the development of advanced multi-agent systems with containment control.
Model predictive control: past, present and future

Manfred Morari,Jay H. Lee

DOI: https://doi.org/10.1016/s0098-1354(98)00301-9

1999-05-01

Abstract:More than 15 years after model predictive control (MPC) appeared in industry as an effective means to deal with multivariable constrained control problems, a theoretical basis for this technique has started to emerge. The issues of feasibility of the on-line optimization, stability and performance are largely understood for systems described by linear models. Much progress has been made on these issues for non-linear systems but for practical applications many questions remain, including the reliability and efficiency of the on-line computation scheme. To deal with model uncertainty ‘rigorously’ an involved dynamic programming problem must be solved. The approximation techniques proposed for this purpose are largely at a conceptual stage. Among the broader research needs the following areas are identified: multivariable system identification, performance monitoring and diagnostics, non-linear state estimation, and batch system control. Many practical problems like control objective prioritization and symptom-aided diagnosis can be integrated systematically and effectively into the MPC framework by expanding the problem formulation to include integer variables yielding a mixed-integer quadratic or linear program. Efficient techniques for solving these problems are becoming available.

engineering, chemical,computer science, interdisciplinary applications
Distributed Model Predictive Control for Periodic Cooperation of Multi-Agent Systems

Matthias Köhler,Matthias A. Müller,Frank Allgöwer

2023-04-06

Abstract:We consider multi-agent systems with heterogeneous, nonlinear agents subject to individual constraints that want to achieve a periodic, dynamic cooperative control goal which can be characterised by a set and a suitable cost. We propose a sequential distributed model predictive control (MPC) scheme in which agents sequentially solve an individual optimisation problem to track an artificial periodic output trajectory. The optimisation problems are coupled through these artificial periodic output trajectories, which are communicated and penalised using the cost that characterises the cooperative goal. The agents communicate only their artificial trajectories and only once per time step. We show that under suitable assumptions, the agents can incrementally move their artificial output trajectories towards the cooperative goal, and, hence, their closed-loop output trajectories asymptotically achieve it. We illustrate the scheme with a simulation example.

Systems and Control,Optimization and Control
Automatic Configuration of Multi-Agent Model Predictive Controllers based on Semantic Graph World Models

K. de Vos,E. Torta,H. Bruyninckx,C.A. Lopez Martinez,M.J.G. van de Molengraft

2023-11-02

Abstract:We propose a shared semantic map architecture to construct and configure Model Predictive Controllers (MPC) dynamically, that solve navigation problems for multiple robotic agents sharing parts of the same environment. The navigation task is represented as a sequence of semantically labeled areas in the map, that must be traversed sequentially, i.e. a route. Each semantic label represents one or more constraints on the robots' motion behaviour in that area. The advantages of this approach are: (i) an MPC-based motion controller in each individual robot can be (re-)configured, at runtime, with the locally and temporally relevant parameters; (ii) the application can influence, also at runtime, the navigation behaviour of the robots, just by adapting the semantic labels; and (iii) the robots can reason about their need for coordination, through analyzing over which horizon in time and space their routes overlap. The paper provides simulations of various representative situations, showing that the approach of runtime configuration of the MPC drastically decreases computation time, while retaining task execution performance similar to an approach in which each robot always includes all other robots in its MPC computations.

Robotics
Surrogate Optimal Control for Strategic Multi-Agent Systems

Pedro Hespanhol,Anil Aswani

DOI: https://doi.org/10.48550/arXiv.1903.07559

2019-03-19

Abstract:This paper studies how to design a platform to optimally control constrained multi-agent systems with a single coordinator and multiple strategic agents. In our setting, the agents cannot apply control inputs and only the coordinator applies control inputs; however, the coordinator does not know the objective functions of the agents, and so must choose control actions based on information provided by the agents. One major challenge is that if the platform is not correctly designed then the agents may provide false information to the coordinator in order to achieve improved outcomes for themselves at the expense of the overall system efficiency. Here, we design an interaction mechanism between the agents and the coordinator such that the mechanism: ensures agents truthfully report their information, has low communication requirements, and leads to a control action that achieves efficiency by achieving a Nash equilibrium. In particular, we design a mechanism in which each agent does not need to posses full knowledge of the system dynamics nor the objective functions of other agents. We illustrate our proposed mechanism in a model predictive control (MPC) application involving heating, ventilation, air-conditioning (HVAC) control by a building manager of an apartment building. Our results showcase how such a mechanism can be potentially used in the context of distributed MPC.

Optimization and Control,Multiagent Systems,Systems and Control
Consensus Based Multi-Agent Control Algorithms

Miloš S. Stanković,Dušan M. Stipanović,Srdjan S. Stanković

DOI: https://doi.org/10.1007/978-1-4419-5757-3_8

2010-01-01

Abstract:Control of complex systems can be achieved via hierarchical multilayered agentbased structures benefiting from their inherent properties such as modularity, scalability, adaptability, flexibility and robustness. The agent-based structures consist of a number of simpler subsystems (or agents), each of which addresses in a coordinated manner a specific sub-objective or sub-task so as to attain the overall design objectives. The complexity of the behavior of such systems arises as a result of interactions between multiple agents and the environment in which they operate. More specifically, multi-agent control systems are fundamental parts of a wide range of safety-critical engineering systems, and are commonly found in aerospace, traffic control, chemical processes, power generation and distribution, flexible manufacturing, robotic system design and self-assembly structures. A multi-agent system can be considered as a loosely coupled network of problem-solver entities that work together to find answers to problems that are beyond the individual capabilities or knowledge of each entity, where local control law has to satisfy decentralized information structure constraints (see, e.g., [20]), and where no global system control (or supervision) is desired.
Stochastic Model Predictive Control: An Overview and Perspectives for Future Research

Ali Mesbah

DOI: https://doi.org/10.1109/mcs.2016.2602087

2016-12-01

IEEE Control Systems

Abstract:Model predictive control (MPC) has demonstrated exceptional success for the high-performance control of complex systems. The conceptual simplicity of MPC as well as its ability to effectively cope with the complex dynamics of systems with multiple inputs and outputs, input and state/output constraints, and conflicting control objectives have made it an attractive multivariable constrained control approach. This article gives an overview of the main developments in the area of stochastic model predictive control (SMPC) in the past decade and provides the reader with an impression of the different SMPC algorithms and the key theoretical challenges in stochastic predictive control without undue mathematical complexity. The general formulation of a stochastic OCP is first presented, followed by an overview of SMPC approaches for linear and nonlinear systems. Suggestions of some avenues for future research in this rapidly evolving field concludes the article.
Distributed MPC for Tracking and Formation of Homogeneous Multi‐agent System with Time‐Varying Communication Topology

baocang ding,liang ge,hongguang pan,peng wang

DOI: https://doi.org/10.1002/asjc.1186

IF: 2.4

2016-01-01

Asian Journal of Control

Abstract:The distributed model predictive control (MPC) is studied for the tracking and formation problem of multi-agent system with time-varying communication topology. At each sampling instant, each agent solves an optimization problem respecting input and state constraints, to obtain its optimal control input. In the cost function for the optimization problem of each agent, the formation weighting coefficient is properly updated so that the adverse effect of the time-varying communication topology on the closed-loop stability can be counteracted. It is shown that the overall multi-agent system can achieve the desired tracking and formation objectives. The effectiveness of the results is demonstrated through two examples.
A Survey on Explicit Model Predictive Control

Alessandro Alessio,Alberto Bemporad

DOI: https://doi.org/10.1007/978-3-642-01094-1_29

2009-01-01

Abstract:Explicit model predictive control (MPC) addresses the problem of removing one of the main drawbacks of MPC, namely the need to solve a mathematical program on line to compute the control action. This computation prevents the application of MPC in several contexts, either because the computer technology needed to solve the optimization problem within the sampling time is too expensive or simply infeasible, or because the computer code implementing the numerical solver causes software certification concerns,especially in safety critical applications.Explicit MPC allows one to solve the optimization problem off-line for a given range of operating conditions of interest. By exploiting multiparametric programming techniques, explicit MPC computes the optimal control action off line as an “explicit” function of the state and reference vectors, so that on-line operations reduce to a simple function evaluation. Such a function is piecewise affine in most cases, so that the MPC controller maps into a lookup table of linear gains.In this paper we survey the main contributions on explicit MPC appeared in the scientific literature. After recalling the basic concepts and problem formulations of MPC, we review the main approaches to solve explicit MPC problems, including a novel and simple suboptimal practical approach to reduce the complexity of the explicit form. The paper concludes with some comments on future research directions.
Model Predictive Control Design for Polytopic Uncertain Systems by Synthesising Multi-Step Prediction Scenarios.

Jianbo Lu,Yugeng Xi,Dewei Li,Yuli Xu,Zhongxue Gan

DOI: https://doi.org/10.1080/00207721.2017.1402214

IF: 2.648

2017-01-01

International Journal of Systems Science

Abstract:A common objective of model predictive control (MPC) design is the large initial feasible region, low online computational burden as well as satisfactory control performance of the resulting algorithm. It is well known that interpolation-based MPC can achieve a favourable trade-off among these different aspects. However, the existing results are usually based on fixed prediction scenarios, which inevitably limits the performance of the obtained algorithms. So by replacing the fixed prediction scenarios with the time-varying multi-step prediction scenarios, this paper provides a new insight into improvement of the existing MPC designs. The adopted control law is a combination of predetermined multi-step feedback control laws, based on which two MPC algorithms with guaranteed recursive feasibility and asymptotic stability are presented. The efficacy of the proposed algorithms is illustrated by a numerical example.
Distributed Model Predictive Control for Linear-Quadratic Performance and Consensus State Optimization of Multiagent Systems

Qishao Wang,Zhisheng Duan,Yuezu Lv,Qingyun Wang,Guanrong Chen

DOI: https://doi.org/10.1109/tcyb.2020.3001347

IF: 11.8

2020-01-01

IEEE Transactions on Cybernetics

Abstract:The optimal consensus problem of asynchronous sampling single-integrator and double-integrator multiagent systems is solved by distributed model predictive control (MPC) algorithms proposed in this article. In each predictive horizon, the finite-time linear-quadratic performance is minimized distributively by the control input with consensus state optimization. The MPC technique is then utilized to extend the optimal control sequence to the case of an infinite horizon. Conditions depending only on each agent's weighting scalar and sampling step are derived to guarantee the stability of the closed-loop system. Numerical examples of rendezvous control of multirobot systems illustrate the efficiency of the proposed algorithm.
Distributed Model Predictive Controller Design for Multi-Agent Systems

WANG Peng,DING Bao-cang,HAN Chong-zhao

DOI: https://doi.org/10.3969/j.issn.1672-3813.2012.01.014

2012-01-01

Abstract:The distributed model predictive controller design for tracking and formation of multi-agent system is studied in this paper.Considering the time-varying communication topology,we present an auxiliary constraint in the optimization problem,which guarantees the recursive feasibility of the optimization and exponential stability of the overall closed-loop system.At each sampling time,each agent solves a constrained optimization problem,respecting input,state and auxiliary constraints to obtain its input.The effectiveness of our result is verified through an illustrative example.

Multi-Agent Model Predictive Control: A Survey

Get the design right, the rest is automatic: Towards an adaptive MPC controller

On the Control of Multi-Agent Systems: A Survey

Model predictive control: Theory and practice—A survey

Model Predictive Control for Multi-Agent Systems under Limited Communication and Time-Varying Network Topology

Distributed Model Predictive Control: An Overview and Roadmap of Future Research Opportunities

A Survey on Manipulator Control Using Multi-Agent Method

Consensus of Sampled-Data Multi-Agent Networking Systems Via Model Predictive Control

Active Learning-based Model Predictive Coverage Control

Survey of containment control in multi-agent systems: concepts, communication, dynamics, and controller design

Model predictive control: past, present and future

Distributed Model Predictive Control for Periodic Cooperation of Multi-Agent Systems

Automatic Configuration of Multi-Agent Model Predictive Controllers based on Semantic Graph World Models

Surrogate Optimal Control for Strategic Multi-Agent Systems

Consensus Based Multi-Agent Control Algorithms

Stochastic Model Predictive Control: An Overview and Perspectives for Future Research

Distributed MPC for Tracking and Formation of Homogeneous Multi‐agent System with Time‐Varying Communication Topology

A Survey on Explicit Model Predictive Control

Model Predictive Control Design for Polytopic Uncertain Systems by Synthesising Multi-Step Prediction Scenarios.

Distributed Model Predictive Control for Linear-Quadratic Performance and Consensus State Optimization of Multiagent Systems

Distributed Model Predictive Controller Design for Multi-Agent Systems