Game-theoretical approach to decentralized multi-drone conflict resolution and emergent traffic flow operations

Serge Hoogendoorn,Victor Knoop,Hani Mahmassani,Sascha Hoogendoorn-Lanser
2023-08-02
Abstract:This paper introduces decentralized control concepts for drones using differential game theory. The approach optimizes the behavior of an ego drone, assuming the anticipated behavior of the opponent drones using a receding horizon approach. For each control instant, the scheme computes the Nash equilibrium control signal which is applied for the control period. This results in a multi-drone conflict resolution scheme that is applied to all drones considered. The paper discusses the approach and presents the numerical algorithm, showing several examples that illustrate the performance of the model. We examine at the behavior of the ego drone, and the resulting collective drone flow operations. The latter shows that while the approach aims to optimize the operation cost of the ego drone, the experiments provide evidence that resulting flow operations are very efficient due to the self-organization of various flow patterns. The presented work contributes to the state of the art in providing a generic approach to multi-drone conflict resolution with good macroscopic flow performance characteristics. The approach enables relatively straightforward inclusion of error due to sensing and communication. The approach also allows for including different risk levels (e.g., for malfunctioning of sensor and communication technology), priority rules, regulations, and higher-level control signals (e.g., routing, dynamic speed limits).
Systems and Control,Adaptation and Self-Organizing Systems
What problem does this paper attempt to address?
The paper primarily addresses the issues of multi-UAV conflict resolution and air traffic flow operations, specifically covering the following aspects: 1. **Research Background and Motivation**: - With the development of UAV technology and its widespread application in areas such as delivery, disaster relief, surveillance, and personal travel, multi-UAV conflict resolution has become increasingly important. - Airspace resources are limited and demand is growing, thus efficient utilization of airspace and resolution of conflicts between multiple UAVs are necessary. 2. **Problem-Solving Method**: - A decentralized control concept based on differential game theory is proposed, aiming to optimize the behavior of individual (self) UAVs while considering the anticipated behavior of opponent UAVs. - The receding horizon method is used to compute Nash equilibrium control signals to achieve multi-UAV conflict resolution. - The control scheme can adapt to sensing and communication errors and allows for different levels of risk, priority rules, regulations, and high-level control signals (such as route planning, dynamic speed limits, etc.). 3. **Technical Details**: - The paper introduces a mathematical model to describe the dynamics and cost functions of UAVs, considering the cost of deviating from the desired direction and speed, the risk cost of approaching other UAVs, and the acceleration cost. - Pontryagin's minimum principle is used to determine the optimal solution, and iterative numerical methods are employed to solve the differential game problem. 4. **Experimental Validation**: - A series of experiments demonstrate the effectiveness of the proposed method, including one-on-one UAV interactions, self-organizing phenomena in bidirectional UAV flows, and multi-UAV conflict resolution in bottleneck scenarios. - Experimental results show that even in high-density UAV interactions, the method can effectively form self-organizing patterns, improve overall efficiency, and ensure safe distances. In summary, the paper effectively addresses the multi-UAV conflict problem by proposing a decentralized control strategy based on differential game theory and demonstrates its application in various scenarios.