Abstract:Real 3D building models have become indispensable data sources for building spatial information bases for smart cities by leveraging structural correlations and rich semantic expressions of real-world scene entities. The essential prerequisite for real 3D reconstruction is real-time and dynamic detailed-level observations. Low-altitude multicopter UAV platforms are optimal for automatic and periodic building scene observations. However, there are still several challenges in UAV-based path planning for real 3D data capture while maintaining the overall fidelity of architectural details due to observational scale variations, surrounding uncertainties, structural complexity, and topological delicacy. We propose a scene information guided aerial photogrammetric mission recomposition method in response to this challenge. Depending on the architectural complexity, the two proposed observation patterns, parallel inspection and surface enveloping, can be recomposed to achieve UAV obstacle avoidance and complete coverage of individual buildings in a restricted space, capturing global surface detail with millimeter resolution and low texture distortion. The virtual simulation environment, which is constructed based on the semantics and elevation values of the surroundings, provides a basis for selecting the observation pattern and optimal flight parameters based on the reconstruction requirements of the building. In order to achieve quality control of 3D reconstruction models, this paper introduces a reconstruction quality assessment scheme consisting of four quantitative evaluation metrics, namely coverage, resolution distribution, texture distortion score, and geometric accuracy, which effectively establishes a close relationship between mission planning and 3D reconstruction. The observation capability of the proposed method is better than other typical observation patterns, obtaining a model of globally homogeneous resolution distribution over the main body of the building, reaching an average level of 7.01 mm and the highest level of 2.12 mm (façade region), which can provide high-quality data for the semantic extraction and instantiation of multiple surface elements of buildings.

Semantic-Driven Informed Planning and 3D Reconstruction for the Quadrotor Unmanned Aerial Vehicle

3D Path Planning of Quadrotor Aerial Robots Using Numerical Optimization

Real-Time Semantic Plane Reconstruction on a Monocular Drone Using Sparse Fusion

Semantic Information Based Path Planning for Cooperative UAV Systems

Geometric Primitive-Guided UAV Path Planning for High-Quality Image-Based Reconstruction

Semantic 3D Reconstruction with Learning MVS and 2D Segmentation of Aerial Images

Multi-robot autonomous 3D reconstruction using Gaussian splatting with Semantic guidance

Virtual Reality Aided High-Quality 3D Reconstruction by Remote Drones

PredRecon: A Prediction-boosted Planning Framework for Fast and High-quality Autonomous Aerial Reconstruction

Multi-UAV Cooperative and Continuous Path Planning for High-Resolution 3D Scene Reconstruction

FGIP: A Frontier-Guided Informative Planner for UAV Exploration and Reconstruction

Offsite aerial path planning for efficient urban scene reconstruction

Real-Time UAV Path Planning for Autonomous Urban Scene Reconstruction

Near-Optimal 3-D Visual Coverage for Quadrotor Unmanned Aerial Vehicles Under Photogrammetric Constraints

Autonomous Implicit Indoor Scene Reconstruction with Frontier Exploration

Integrated design-sense-plan architecture for autonomous geometric-semantic mapping with UAVs

Object-Aware View Planning for Autonomous 3-D Model Reconstruction of Buildings Using a Mobile Robot

A Novel Informative Autonomous Exploration Strategy with Uniform Sampling for Quadrotors

Three Dimensional Reconstruction Algorithm of Unmanned Aerial Vehicle Images Based on Parallel Processing

A Fast Reconstruction Method Based on Real-time Terrain Following

Scene Information Guided Aerial Photogrammetric Mission Recomposition Towards Detailed Level Building Reconstruction