Abstract:Image stitching aims at stitching the images taken from different viewpoints into an image with a wider field of view. Existing methods warp the target image to the reference image using the estimated warp function, and a homography is one of the most commonly used warping functions. However, when images have large parallax due to non-planar scenes and translational motion of a camera, the homography cannot fully describe the mapping between two images. Existing approaches based on global or local homography estimation are not free from this problem and suffer from undesired artifacts due to parallax. In this paper, instead of relying on the homography-based warp, we propose a novel deep image stitching framework exploiting the pixel-wise warp field to handle the large-parallax problem. The proposed deep image stitching framework consists of two modules: Pixel-wise Warping Module (PWM) and Stitched Image Generating Module (SIGMo). PWM employs an optical flow estimation model to obtain pixel-wise warp of the whole image, and relocates the pixels of the target image with the obtained warp field. SIGMo blends the warped target image and the reference image while eliminating unwanted artifacts such as misalignments, seams, and holes that harm the plausibility of the stitched result. For training and evaluating the proposed framework, we build a large-scale dataset that includes image pairs with corresponding pixel-wise ground truth warp and sample stitched result images. We show that the results of the proposed framework are qualitatively superior to those of the conventional methods, especially when the images have large parallax. The code and the proposed dataset will be publicly available soon.

Parallax-tolerant Image Stitching Based on Mesh Optimization

Remote Sensing Image Stitch Using Modified Structure Deformation

Structure Preservation and Seam Optimization for Parallax-Tolerant Image Stitching

Parallax-tolerant Image Stitching via Segmentation-guided Multi-homography Warping

Parallax-Tolerant Image Stitching with Epipolar Displacement Field

Parallax-Tolerant Unsupervised Deep Image Stitching

A Robust Image Stitching Based on Solution Set Smoothing

Parallax-Robust Hexahedral Panoramic Video Stitching

Studies on Image Stitching Algorithms in Machine Vision Inspection of Solar Panel

Seam-guided local alignment and stitching for large parallax images

Natural Image Stitching With Layered Warping Constraint

Multiple Combined Constraints for Image Stitching

Image stitching algorithm based on semantics-preserving warps

Image stitching by line-guided local warping with global similarity constraint

SC-AOF: A Sliding Camera and Asymmetric Optical-Flow-Based Blending Method for Image Stitching

An improved adaptive triangular mesh-based image warping method

Learning Thin-Plate Spline Motion and Seamless Composition for Parallax-Tolerant Unsupervised Deep Image Stitching

Parallax Tolerant Light Field Stitching for Hand-Held Plenoptic Cameras

Pixel-wise Deep Image Stitching

Pixel-Wise Warping for Deep Image Stitching

Research on Image Stitching Algorithm Based on Point-Line Consistency and Local Edge Feature Constraints