Abstract:This study presents a novel reconstruction enhancement method that utilises ground panoramic videos to address the modelling defects in oblique photogrammetry. The method employs an adaptive viewpoint selection and optimisation strategy that generates optimal multiview images for reconstruction targets, thus maximising the scene reconstructability. The experimental results demonstrate that this approach can accurately reconstruct geometric structures and texture details, significantly improving the quality of the 3D model. This method offers a valuable solution for 3D reconstruction in complex urban scenes. The widely used unmanned aerial vehicle oblique photogrammetry often suffers from information loss in complex urban environments, leading to geometric and textural defects in the resulting models. In this study, a close‐range panoramic optimal viewpoint selection assisted 3D urban scene reconstruction enhancement method is proposed for areas prone to defects. We first introduce the ground panoramic data acquisition equipment and strategy, which are different from those of the single‐lens supplementary photography method. Data acquisition is accomplished through a single and continuous surround‐style collection approach. The full coverage of the panoramic video in the space–time dimension enables the acquisition of texture details without considering camera station planning. Then, a panoramic multiview image generation approach is proposed. Adaptive viewpoint selection is achieved using unbiased sampling points from the rough scene model, and viewpoint optimisation is adopted to ensure sufficient image overlap and intersection effects, thus improving the scene reconstructability. Finally, the 3D model is generated by photogrammetric processing of the panoramic multiview images, resulting in an enhanced modelling effect. To validate the proposed method, we conducted experiments using real data from Qingdao, China. Both the qualitative and quantitative results demonstrate a significant improvement in the quality of geometric and textural reconstruction. The tie‐point reprojection errors are less than 1 pixel, and the registration accuracy with the model from oblique photogrammetry is comparable to that of optimised‐view photography. By eliminating the need for on‐site camera station planning or manual flight operations and effectively minimising the redundancy of panoramic videos, our approach significantly reduces the photography and computation costs associated with reconstruction enhancement. Thus, it presents a feasible technical solution for the generation of urban 3D fine models.

Real-Time 3D Reconstruction for the Conservation of the Great Wall’s Cultural Heritage Using Depth Cameras

Benchmarking Large-Scale Multi-View 3D Reconstruction Using Realistic Synthetic Images

High-Resolution Ground-Penetrating Radar Imaging Of Buried Culture Heritage

Dunhuang Cave Virtual Rebuilding and Mural Restoration Simulating

Stereo Mapping of Ming Great Wall with Remote Sensing

Tridimensional Reconstruction Applied to Cultural Heritage with the Use of Camera-Equipped UAV and Terrestrial Laser Scanner

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Real 3D Digital Method for Large-Scale Cultural Heritage Sites

3D LiDAR and multi-technology collaboration for preservation of built heritage in China: A review

A METHOD OF 3D MEASUREMENT AND RECONSTRUCTION FOR CULTURAL RELICS IN MUSEUMS

A Deep Learning-based Method of Investigating Rammed-earth Wall Damage on the Ming Great Wall Military Defense System

Reconstructing the local structures of Chinese ancient architecture using unsupervised depth estimation

A Digital Survey Approach for Large-Scale Landscape Heritage Resource Exploration: Auxiliary Beacons, the Uncharted Signal Structure of the Great Wall in China

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

3D Reconstruction of Ancient Buildings Using UAV Images and Neural Radiation Field with Depth Supervision

Using LiDAR for digital documentation of ancient city walls

Deformation monitoring and thematic mapping of the Badaling Great Wall using very high-resolution interferometric synthetic aperture radar data

Real-time 3D Reconstruction on Construction Site using Visual SLAM and UAV

Three-Dimensional Reconstruction of Structural Surface Model of Heritage Bridges Using UAV-Based Photogrammetric Point Clouds

Enhancing the Sustainability of Intangible Cultural Heritage Projects: Obtaining Efficient Digital Skills Preservation through Binocular Half Panoramic VR Maps

A 3D urban scene reconstruction enhancement approach based on adaptive viewpoint selection of panoramic videos