DQN based coverage control for multi‐agent system in line intersection region

Zuo Lei,Zhang Tengfei,Zhang Jinqi,Yan Maode
DOI: https://doi.org/10.1049/cth2.12670
IF: 2.67
2024-04-24
IET Control Theory and Applications
Abstract:This paper investigates the multi‐agent coverage control problems in a line intersection region, where the agents can only move along the given lines. A novel coverage model and DQN‐based coverage control algorithm are proposed to drive the agents to the optimal distribution. Comparing with the traditional coverage control methods, the proposed algorithm can avoid the requirement of convex property in coverage control and improve the computation efficiency of the solving process. Generally, the coverage control is studied in a convex region, in which the agent kinematics and the coverage environment both have strong limitations. It is difficult to directly apply these results to practical scenarios, such as the road environment or indoor environment. In this study, the multi‐agent coverage control problems in a line intersection region is investigated, where the agents can only move along the given lines. To present the agents motion in this line intersection region, the moving directions and velocities of the agents are analyzed in the first part. Then, the coverage control model for the multi‐agent system in line intersection region is presented, in which the cost function is provided based on the agent's minimum moving distance and the agent motions are used as the constraints. To solve this constrained coverage problem, the deep Q‐learning network (DQN) is employed to find the optimal positions for each agent in the line intersection region. In final, numerical simulations are presented to validate the feasibility and effectiveness of proposed approaches.
automation & control systems,engineering, electrical & electronic,instruments & instrumentation
What problem does this paper attempt to address?