Ant Colony Optimization for Cooperative Inspection Path Planning Using Multiple Unmanned Aerial Vehicles

Duy Nam Bui,Thuy Ngan Duong,Manh Duong Phung

DOI: https://doi.org/10.1109/SII58957.2024.10417512

2024-02-13

Abstract:This paper presents a new swarm intelligence-based approach to deal with the cooperative path planning problem of unmanned aerial vehicles (UAVs), which is essential for the automatic inspection of infrastructure. The approach uses a 3D model of the structure to generate viewpoints for the UAVs. The calculation of the viewpoints considers the constraints related to the UAV formation model, camera parameters, and requirements for data post-processing. The viewpoints are then used as input to formulate the path planning as an extended traveling salesman problem and the definition of a new cost function. Ant colony optimization is finally used to solve the problem to yield optimal inspection paths. Experiments with 3D models of real structures have been conducted to evaluate the performance of the proposed approach. The results show that our system is not only capable of generating feasible inspection paths for UAVs but also reducing the path length by 29.47\% for complex structures when compared with another heuristic approach. The source code of the algorithm can be found at

Systems and Control,Artificial Intelligence

What problem does this paper attempt to address?

This paper attempts to address the problem of collaborative inspection path planning (C-IPP) using multiple unmanned aerial vehicles (UAVs) in structural health monitoring (SHM). Specifically, the goal of the paper is to generate optimal inspection paths to reduce inspection time and improve inspection efficiency. Existing methods often struggle to generate optimal paths when dealing with complex 3D structures, and this paper proposes a new method based on ant colony optimization (ACO) to solve this problem.

### Main Research Content
1. **Generating Viewpoint Positions**: Calculate the viewpoint positions that UAVs need to fly over using effective sampling methods. These viewpoints are used to collect visual data of the structure.
2. **Path Planning Modeling**: Model the inspection path planning problem as an extended traveling salesman problem (TSP) and define a new cost function.
3. **Ant Colony Optimization Algorithm**: Use the ant colony optimization algorithm to solve the extended TSP problem and generate the optimal inspection path.

### Method Steps
1. **3D Model Preprocessing**: Input the 3D model of the structure (e.g., STL or PLY files) and perform denoising and filtering processing.
2. **Viewpoint Generation**: Calculate the viewpoint positions based on the UAVs' formation model, camera parameters, and image stitching requirements.
3. **Path Optimization**: Use the viewpoints as nodes and apply the ant colony optimization algorithm to generate the optimal inspection path.

### Experimental Results
- **Experimental Setup**: Use 4 3DR Solo drones equipped with IMX-100 cameras. The experimental subjects include scaled models of two real structures.
- **Performance Evaluation**: Compared to the traditional back-and-forth (BAF) algorithm, the proposed method performs better on complex structures, reducing the path length by 29.47%.

### Conclusion
The proposed method performs excellently in generating inspection paths for complex 3D structures, significantly reducing path length and improving inspection efficiency. The experimental results validate the effectiveness and practicality of this method.