Abstract:It is of vital importance to stitch the two images into a panorama in many computer vision applications of motion detection and tracking and virtual reality, panoramic photography, and virtual tours. To preserve more local details and with few artifacts in panoramas, this article presents an improved mesh-based joint optimization image stitching model. Since the uniform vertices are usually used in mesh-based warps, we consider the matched feature points and uniform points as grid vertices to strengthen constraints on deformed vertices. Simultaneously, we define an improved energy function and add a color similarity term to perform the alignment. In addition to good alignment and minimal local distortion, a regularization parameter strategy of combining our method with an as-projective-as-possible (APAP) warp is introduced. Then, controlling the proportion of each part by calculating the distance between the vertex and the nearest matched feature point to the vertex. This ensures a more natural stitching effect in non-overlapping areas. A comprehensive evaluation shows that the proposed method achieves more accurate image stitching, with significantly reduced ghosting effects in the overlapping regions and more natural results in the other areas. The comparative experiments demonstrate that the proposed method outperforms the state-of-the-art image stitching warps and achieves higher precision panorama stitching and less distortion in the overlapping. The proposed algorithm illustrates great application potential in image stitching, which can achieve higher precision panoramic image stitching.

Shape-optimizing Mesh Warping Method for Stereoscopic Panorama Stitching

Remote Sensing Image Stitch Using Modified Structure Deformation

A Natural Shape-Preserving Stereoscopic Image Stitching.

Spatially-varying Warping for Panoramic Image Stitching

A Robust Image Stitching Based on Solution Set Smoothing

Parallax-Tolerant Image Stitching Based on Robust Elastic Warping.

An improved adaptive triangular mesh-based image warping method

Image stitching with perspective-preserving warping

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

Semantic Aware Stitching for Panorama

Structure Preservation and Seam Optimization for Parallax-Tolerant Image Stitching

Multiperspective Image Stitching and Regularization Via Hybrid Structure Warping

Multi-objective Content Preserving Warping for Image Stitching

Misalignment-eliminated warping image stitching method with grid-based motion statistics matching

Ratio-Preserving Half-Cylindrical Warps for Natural Image Stitching

Single-Perspective Warps in Natural Image Stitching

Stitching Videos From Unstructured Camera Arrays With Rectangular Boundaries

Parallax-tolerant Image Stitching Based on Mesh Optimization

Seamless Stitching of Stereo Images for Generating Infinite Panoramas

Parallax-tolerant Image Stitching via Segmentation-guided Multi-homography Warping

Parallax-Robust Hexahedral Panoramic Video Stitching