Abstract:<p>Integration of aerial and ground images has been proved as an efficient approach to enhance the surface reconstruction in urban environments. However, as the first step, the feature point matching between aerial and ground images is remarkably difficult, due to the large differences in viewpoint and illumination conditions. Previous studies based on geometry-aware image rectification have alleviated this problem, but the performance and convenience of this strategy are still limited by several flaws, <em>e.g.</em> quadratic image pairs, segregated extraction of descriptors and occlusions. To address these problems, we propose a novel approach: leveraging photogrammetric mesh models for aerial-ground image matching. The methods have linear time complexity with regard to the number of images. It explicitly handles low overlap using multi-view images. The proposed methods can be directly injected into off-the-shelf structure-from-motion (SFM) and multi-view stereo (MVS) solutions. First, aerial and ground images are reconstructed separately and initially co-registered through weak georeferencing data. Second, aerial models are rendered to the initial ground views, in which color, depth and normal images are obtained. Then, feature matching between synthesized and ground images are conducted through descriptor searching and geometry-constrained outlier removal. Finally, oriented 3D patches are formulated using the synthesized depth and normal images and the correspondences are propagated to the aerial views through patch-based matching. Experimental evaluations using five datasets reveal satisfactory performance of the proposed methods in aerial-ground image matching, which succeeds in all of the ten challenging pairs compared to only three for the second best. In addition, incorporation of existing SFM and MVS solutions enables more complete reconstruction results, with better internal stability.</p>

A Robust Ground‐to‐Image Transformation Algorithm and Its Applications in the Geometric Processing of Linear Pushbroom Images

Unified Optical Distortion Correction Method for Imaging Systems Using A Concise Geometrical Transformation Model

Real-time and High Precision Feature Matching Between Blur Aerial Images

Robustness of Projection Algorithm for Under-Exposured Images

Near-Real-Time Long-Strip Geometric Processing without GCPs for Agile Push-Frame Imaging of LuoJia3-01 Satellite

A Linear Regression Approach for Best Scanline Determination in the Object to Image Space Transformation Using Pushbroom Images

Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching

Fast Georeferenced Aerial Image Stitching With Absolute Rotation Averaging and Planar- Restricted Pose Graph

Autonomous Mobile Ground Control Point Improves Accuracy of Agricultural Remote Sensing through Collaboration with UAV

Leveraging photogrammetric mesh models for aerial-ground feature point matching toward integrated 3D reconstruction

GCPs Extraction With Geometric Texture Pattern for Thermal Infrared Remote Sensing Images

Real-Time Orthophoto Mosaicing on Mobile Devices for Sequential Aerial Images with Low Overlap

Automatic Registration of Images with Inconsistent Content Through Line-Support Region Segmentation and Geometrical Outlier Removal

Application of Domestic Satellite Image Fast Ortho-Rectification Method in Dynamic Remote Sensing Monitoring of Sea Area

Geometric Transformation of Images and LiDAR Point Clouds under Quadratic Constraint

GPU-Accelerated PCG Method for the Block Adjustment of Large-Scale High-Resolution Optical Satellite Imagery Without GCPs

Feature-based geometric registration of high spatial resolution satellite imagery

Ground–Satellite Coupling for Cross-View Geolocation Combined With Multiscale Fusion of Spatial Features

Ground-Based SAR Wide View Angle Full-Field Imaging Algorithm Based on Keystone Formatting

A QUANTITATIVE EVALUATION METHOD OF GROUND CONTROL POINTS FOR REMOTE SENSING IMAGE REGISTRATION

A method to align POS data and linear push-broom imaging data