Abstract:This study presents a novel reconstruction enhancement method that utilises ground panoramic videos to address the modelling defects in oblique photogrammetry. The method employs an adaptive viewpoint selection and optimisation strategy that generates optimal multiview images for reconstruction targets, thus maximising the scene reconstructability. The experimental results demonstrate that this approach can accurately reconstruct geometric structures and texture details, significantly improving the quality of the 3D model. This method offers a valuable solution for 3D reconstruction in complex urban scenes. The widely used unmanned aerial vehicle oblique photogrammetry often suffers from information loss in complex urban environments, leading to geometric and textural defects in the resulting models. In this study, a close‐range panoramic optimal viewpoint selection assisted 3D urban scene reconstruction enhancement method is proposed for areas prone to defects. We first introduce the ground panoramic data acquisition equipment and strategy, which are different from those of the single‐lens supplementary photography method. Data acquisition is accomplished through a single and continuous surround‐style collection approach. The full coverage of the panoramic video in the space–time dimension enables the acquisition of texture details without considering camera station planning. Then, a panoramic multiview image generation approach is proposed. Adaptive viewpoint selection is achieved using unbiased sampling points from the rough scene model, and viewpoint optimisation is adopted to ensure sufficient image overlap and intersection effects, thus improving the scene reconstructability. Finally, the 3D model is generated by photogrammetric processing of the panoramic multiview images, resulting in an enhanced modelling effect. To validate the proposed method, we conducted experiments using real data from Qingdao, China. Both the qualitative and quantitative results demonstrate a significant improvement in the quality of geometric and textural reconstruction. The tie‐point reprojection errors are less than 1 pixel, and the registration accuracy with the model from oblique photogrammetry is comparable to that of optimised‐view photography. By eliminating the need for on‐site camera station planning or manual flight operations and effectively minimising the redundancy of panoramic videos, our approach significantly reduces the photography and computation costs associated with reconstruction enhancement. Thus, it presents a feasible technical solution for the generation of urban 3D fine models.

Ground 3D Object Reconstruction Based on Multi-View 3D Occupancy Network using Satellite Remote Sensing Image

3-D Map Reconstruction in Cross-country Environment

Visual Odometry Based 3D-Reconstruction

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

3D Virtual Urban Scene Reconstruction from a Single Optical Remote Sensing Image.

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Robust 3D Reconstruction with an RGB-D Camera

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

Highly Applicable Iterative Network for 3-D Reconstruction Based on Multiview Satellite Images

Three-Dimensional Reconstruction from Single Image Base on Combination of CNN and Multi-Spectral Photometric Stereo

A general deep learning based framework for 3D reconstruction from multi-view stereo satellite images

3D Reconstruction of Remote Sensing Mountain Areas with TSDF-Based Neural Networks

A review of 3D reconstruction from high-resolution urban satellite images

Deep learning based multi-view stereo matching and 3D scene reconstruction from oblique aerial images

3D Model Extraction Network Based on RFM Constrained Deformation Inference and Self-Similar Convolution for Satellite Stereo Images

Robust Fusion of Multi-Source Images for Accurate 3D Reconstruction of Complex Urban Scenes

Weakly Supervised 3-D Building Reconstruction From Monocular Remote Sensing Images

3D Building Reconstruction from Monocular Remote Sensing Images with Multi-level Supervisions

A 3D urban scene reconstruction enhancement approach based on adaptive viewpoint selection of panoramic videos

3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction

Hybrid Iteration and Optimization-based Three-dimensional Reconstruction for Space Non-Cooperative Targets with Monocular Vision and Sparse Lidar Fusion