Abstract:This study presents a novel reconstruction enhancement method that utilises ground panoramic videos to address the modelling defects in oblique photogrammetry. The method employs an adaptive viewpoint selection and optimisation strategy that generates optimal multiview images for reconstruction targets, thus maximising the scene reconstructability. The experimental results demonstrate that this approach can accurately reconstruct geometric structures and texture details, significantly improving the quality of the 3D model. This method offers a valuable solution for 3D reconstruction in complex urban scenes. The widely used unmanned aerial vehicle oblique photogrammetry often suffers from information loss in complex urban environments, leading to geometric and textural defects in the resulting models. In this study, a close‐range panoramic optimal viewpoint selection assisted 3D urban scene reconstruction enhancement method is proposed for areas prone to defects. We first introduce the ground panoramic data acquisition equipment and strategy, which are different from those of the single‐lens supplementary photography method. Data acquisition is accomplished through a single and continuous surround‐style collection approach. The full coverage of the panoramic video in the space–time dimension enables the acquisition of texture details without considering camera station planning. Then, a panoramic multiview image generation approach is proposed. Adaptive viewpoint selection is achieved using unbiased sampling points from the rough scene model, and viewpoint optimisation is adopted to ensure sufficient image overlap and intersection effects, thus improving the scene reconstructability. Finally, the 3D model is generated by photogrammetric processing of the panoramic multiview images, resulting in an enhanced modelling effect. To validate the proposed method, we conducted experiments using real data from Qingdao, China. Both the qualitative and quantitative results demonstrate a significant improvement in the quality of geometric and textural reconstruction. The tie‐point reprojection errors are less than 1 pixel, and the registration accuracy with the model from oblique photogrammetry is comparable to that of optimised‐view photography. By eliminating the need for on‐site camera station planning or manual flight operations and effectively minimising the redundancy of panoramic videos, our approach significantly reduces the photography and computation costs associated with reconstruction enhancement. Thus, it presents a feasible technical solution for the generation of urban 3D fine models.

Monocular Video Frame Optimization Through Feature-Based Parallax Analysis for 3D Pipe Reconstruction

3D Reconstruction of Small-diameter Pipes Inner Surface Based on Structural Light

Two-Stage Multi-Camera Constrain Mapping Pipeline for Large-Scale 3D Reconstruction

A 3D Reconstruction Pipeline of Urban Drainage Pipes Based on MultiviewImage Matching Using Low-Cost Panoramic Video Cameras

A Multiscale-Contour-based Interpolation Framework for Generating a Time-Varying Quasi-Dense Point Cloud Sequence.

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

3D Pipe Network Reconstruction Based on Structure from Motion with Incremental Conic Shape Detection and Cylindrical Constraint

Sewer defect instance segmentation, localization, and 3D reconstruction for sewer floating capsule robots

3D Reconstruction Approach for Outdoor Scene Based on Multiple Point Cloud Fusion

Robust Metric Reconstruction from Challenging Video Sequences

Depth-Guided Sparse Structure-from-Motion for Movies and TV Shows

A Scaled Monocular 3D Reconstruction Based on Structure from Motion and Multi-View Stereo

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

Towards 3D Scene Reconstruction from Locally Scale-Aligned Monocular Video Depth

A 3D urban scene reconstruction enhancement approach based on adaptive viewpoint selection of panoramic videos

Defect Detection and 3D Reconstruction of Complex Urban Underground Pipeline Scenes for Sewer Robots

3D Reconstruction from public webcams

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame

Three-Dimensional-Scanning of Pipe Inner Walls Based on Line Laser

Detection of morphology defects in pipeline based on 3D active stereo omnidirectional vision sensor