Abstract:<p>Integration of aerial and ground images has been proved as an efficient approach to enhance the surface reconstruction in urban environments. However, as the first step, the feature point matching between aerial and ground images is remarkably difficult, due to the large differences in viewpoint and illumination conditions. Previous studies based on geometry-aware image rectification have alleviated this problem, but the performance and convenience of this strategy are still limited by several flaws, <em>e.g.</em> quadratic image pairs, segregated extraction of descriptors and occlusions. To address these problems, we propose a novel approach: leveraging photogrammetric mesh models for aerial-ground image matching. The methods have linear time complexity with regard to the number of images. It explicitly handles low overlap using multi-view images. The proposed methods can be directly injected into off-the-shelf structure-from-motion (SFM) and multi-view stereo (MVS) solutions. First, aerial and ground images are reconstructed separately and initially co-registered through weak georeferencing data. Second, aerial models are rendered to the initial ground views, in which color, depth and normal images are obtained. Then, feature matching between synthesized and ground images are conducted through descriptor searching and geometry-constrained outlier removal. Finally, oriented 3D patches are formulated using the synthesized depth and normal images and the correspondences are propagated to the aerial views through patch-based matching. Experimental evaluations using five datasets reveal satisfactory performance of the proposed methods in aerial-ground image matching, which succeeds in all of the ten challenging pairs compared to only three for the second best. In addition, incorporation of existing SFM and MVS solutions enables more complete reconstruction results, with better internal stability.</p>

Hybrid Scene Reconstruction by Integrating Scan Data and Stereo Image Pairs

A Simple 3D Reconstruction Method Based on Single Camera

Prior surface model guided dense reconstruction via graph-cuts

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

From Stereo Pair to 3D Face Model

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

Complete Scene Reconstruction by Merging Images and Laser Scans

Studies on Object Reconstruction from Space Using Three-Line Scanner Imagery

Robust 3D Reconstruction with an RGB-D Camera

Object segmentation using stereo images

3D Scene Reconstruction from Multi-Aperture Images

3D Reconstruction Approach for Outdoor Scene Based on Multiple Point Cloud Fusion

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

Leveraging photogrammetric mesh models for aerial-ground feature point matching toward integrated 3D reconstruction

Hybrid 3D Reconstruction of Indoor Scenes Integrating Object Recognition

3D Reconstruction of Outdoor Scenes from Synchronized Laser Range Data and Visual Image Data

Hybrid Method of Connection Evaluation and Framework Optimization for Building Surface Reconstruction

Stereo Matching by Incorporating Depth Cues

Planar Reconstruction of Indoor Scenes from Sparse Views and Relative Camera Poses

3D Model Reconstruction Based on Multi-baseline Stereo Matching