Abstract:Orthoimage mosaicking with obvious parallax caused by geometric misalignment is a challenging problem in the field of remote sensing. Because the obvious objects are not included in the digital terrain model (DTM), large parallax exists in these objects. A common strategy is to search an optimal seamline between orthoimages, avoiding the majority of obvious objects. However, stitching artifacts may remain because (1) the seamline may still cross several obvious objects and (2) the orthoimages may not be precisely aligned in geometry when the accuracy of the DTM is low. While applying general image warping methods to orthoimages can improve the local geometric consistency of adjacent images, these methods usually significantly modify the geometric properties of orthophoto maps. To the best of our knowledge, no approach has been proposed in the field of remote sensing to solve the problem of local geometric misalignments after orthoimage mosaicking with obvious parallax. In this paper, we creatively propose a method to optimize local alignment along the seamline after seamline detection. It consists of the following main processes. First, we locate regions with geometric misalignments along the seamline based on the similarity measure. Second, for any one region, we find one-dimensional (1D) feature matches along the seamline using a semi-global matching approach. The deformation vectors are calculated for these matches. Third, these deformation vectors are robustly and smoothly propagated into the buffer region centered on the seamline by minimizing the associated energy function. Finally, we directly warp the orthoimages to eliminate the local parallax under the guidance of dense deformation vectors. The experimental results on several groups of orthoimages show that our proposed approach is capable of eliminating the local parallax existing in the seamline while preserving most geometric properties of digital orthophoto maps, and that it outperforms state-of-the-art approaches in terms of both visual quality and quantitative metrics.

Seagull: Seam-Guided Local Alignment For Parallax-Tolerant Image Stitching

Seam-guided local alignment and stitching for large parallax images

Structure Preservation and Seam Optimization for Parallax-Tolerant Image Stitching

Multimodel Fore-/Background Alignment for Seam-Based Parallax-Tolerant Image Stitching

Parallax-tolerant Image Stitching Based on Mesh Optimization

Optimizing Local Alignment along the Seamline for Parallax-Tolerant Orthoimage Mosaicking

Parallax-Tolerant Image Stitching Based on Robust Elastic Warping.

Parallax-tolerant Image Stitching via Segmentation-guided Multi-homography Warping

Parallax Handling of Image Stitching Using Dominant-Plane Homography

Misalignment-eliminated warping image stitching method with grid-based motion statistics matching

Image stitching by line-guided local warping with global similarity constraint

Parallax-Tolerant Unsupervised Deep Image Stitching

Parallax-Tolerant Image Stitching with Epipolar Displacement Field

Learning Thin-Plate Spline Motion and Seamless Composition for Parallax-Tolerant Unsupervised Deep Image Stitching

Leveraging Line-point Consistence to Preserve Structures for Wide Parallax Image Stitching

Local facet approximation for image stitching

Learning Pixel-wise Alignment for Unsupervised Image Stitching

Locally Aligned Image Stitching Based on Multi-Feature and Super-Pixel Segmentation With Plane Protection

Research on seamless image stitching based on fast marching method

Efficient Image Stitching in the Presence of Dynamic Objects and Structure Misalignment.

Image stitching algorithm based on semantics-preserving warps