A New Clustering-based View Planning Method for Building Inspection with Drone

Yongshuai Zheng,Guoliang Liu,Yan Ding,Guohui Tian
2024-07-19
Abstract:With the rapid development of drone technology, the application of drones equipped with visual sensors for building inspection and surveillance has attracted much attention. View planning aims to find a set of near-optimal viewpoints for vision-related tasks to achieve the vision coverage goal. This paper proposes a new clustering-based two-step computational method using spectral clustering, local potential field method, and hyper-heuristic algorithm to find near-optimal views to cover the target building surface. In the first step, the proposed method generates candidate viewpoints based on spectral clustering and corrects the positions of candidate viewpoints based on our newly proposed local potential field method. In the second step, the optimization problem is converted into a Set Covering Problem (SCP), and the optimal viewpoint subset is solved using our proposed hyper-heuristic algorithm. Experimental results show that the proposed method is able to obtain better solutions with fewer viewpoints and higher coverage.
Computer Vision and Pattern Recognition,Robotics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: how to plan a set of approximately optimal viewpoints through the visual sensors carried by drones for building surface detection and monitoring tasks, so as to achieve efficient target coverage. Specifically, the research aims to use a model - based method to improve the coverage rate of the target building surface by generating a small number of but efficient viewpoints, while reducing the number of required viewpoints. ### Problem Background With the rapid development of drone technology, the application of using drones equipped with visual sensors for building detection and monitoring has received extensive attention. The goal of view planning is to find a set of viewpoints (including position and direction) from the visual sensors carried by the robot to cover the required surface area of the target object. Common optimization goals include increasing the surface coverage rate of the target area and reducing the number of viewpoints. ### Research Methods To achieve this goal, the paper proposes a new two - step calculation method based on clustering. The specific steps are as follows: 1. **Generate Candidate Viewpoints**: - Use the spectral clustering algorithm to cluster the triangular mesh model of the target object according to the weighted distance and normal vector. - Generate high - quality candidate viewpoints based on the clustering results, and use the newly proposed local potential field method to correct the positions of the candidate viewpoints. 2. **Combinatorial Optimization**: - Transform the problem into a set covering problem (SCP), and use the newly proposed hyper - heuristic algorithm to search for the optimal subset from the candidate viewpoints. ### Main Contributions - A new method for generating candidate viewpoints based on spectral clustering is proposed. This method is robust to the clustering of non - convex shapes, can better consider complex geometric features, and generate high - quality candidate viewpoints. - A new local potential field method is proposed to correct the positions of candidate viewpoints, which solves the problem of unreasonable viewpoint positions generated by the clustering algorithm. - A new hyper - heuristic algorithm is proposed to solve the combinatorial optimization problem, which is more effective and robust than traditional heuristic methods. ### Experimental Results The experimental results show that this method can obtain a higher coverage rate with fewer viewpoints, verifying its effectiveness in practical applications. Compared with the random sampling method, this method reduces the number of viewpoints by about 20.65% and does not significantly increase the computational cost. Through these improvements, this method performs well in drone building detection and monitoring tasks and has high practical value.