Offsite aerial path planning for efficient urban scene reconstruction

Xiaohui Zhou,Ke Xie,Kai Huang,Yilin Liu,Yang Zhou,Minglun Gong,Hui Huang

DOI: https://doi.org/10.1145/3414685.3417791

IF: 6.2

2020-12-31

ACM Transactions on Graphics

Abstract:With rapid development in UAV technologies, it is now possible to reconstruct large-scale outdoor scenes using only images captured by low-cost drones. The problem, however, becomes how to plan the aerial path for a drone to capture images so that two conflicting goals are optimized: maximizing the reconstruction quality and minimizing mid-air image acquisition effort. Existing approaches either resort to pre-defined dense and thus inefficient view sampling strategy, or plan the path adaptively but require two onsite flight passes and intensive computation in-between. Hence, using these methods to capture and reconstruct large-scale scenes can be tedious. In this paper, we present an adaptive aerial path planning algorithm that can be done before the site visit. Using only a 2D map and a satellite image of the to-be-reconstructed area, we first compute a coarse 2.5D model for the scene based on the relationship between buildings and their shadows. A novel Max-Min optimization is then proposed to select a minimal set of viewpoints that maximizes the reconstructability under the the same number of viewpoints. Experimental results on benchmark show that our planning approach can effectively reduce the number of viewpoints needed than the previous state-of-the-art method, while maintaining comparable reconstruction quality. Since no field computation or a second visit is needed, and the view number is also minimized, our approach significantly reduces the time required in the field as well as the off-line computation cost for multi-view stereo reconstruction, making it possible to reconstruct a large-scale urban scene in a short time with moderate effort.

computer science, software engineering

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to minimize the workload of aerial image collection while ensuring the reconstruction quality in UAV aerial photography path planning. Specifically, existing methods either adopt predefined dense sampling strategies, resulting in inefficiency; or use adaptive path - planning methods, but require two on - site flights and a large amount of intermediate calculations, which makes the reconstruction of large - scale scenes cumbersome. This paper proposes a new adaptive aerial photography path - planning algorithm that can be completed before on - site access. By using only the 2D map of the area to be reconstructed and satellite images, first calculate a rough 2.5D model of the scene, and then propose a novel max - min optimization method to select the minimum number of viewpoints to maximize the reconstruction ability. Experimental results show that compared with the existing state - of - the - art methods, this method can significantly reduce the number of required viewpoints while maintaining comparable reconstruction quality, and does not require additional on - site flights or complex on - site calculations, thereby greatly reducing the time required on - site and the off - line calculation cost, making the rapid reconstruction of large - scale urban scenes possible.