Abstract:Irregular boundaries in image stitching naturally occur due to freely moving cameras. To deal with this problem, existing methods focus on optimizing mesh warping to make boundaries regular using the traditional explicit solution. However, previous methods always depend on hand-crafted features (e.g., keypoints and line segments). Thus, failures often happen in overlapping regions without distinctive features. In this paper, we address this problem by proposing RecStitchNet, a reasonable and effective network for image stitching with rectangular boundaries. Considering that both stitching and imposing rectangularity are non-trivial tasks in the learning-based framework, we propose a three-step progressive learning based strategy, which not only simplifies this task, but gradually achieves a good balance between stitching and imposing rectangularity. In the first step, we perform initial stitching by a pre-trained state-of-the-art image stitching model, to produce initially warped stitching results without considering the boundary constraint. Then, we use a regression network with a comprehensive objective regarding mesh, perception, and shape to further encourage the stitched meshes to have rectangular boundaries with high content fidelity. Finally, we propose an unsupervised instance-wise optimization strategy to refine the stitched meshes iteratively, which can effectively improve the stitching results in terms of feature alignment, as well as boundary and structure preservation. Due to the lack of stitching datasets and the difficulty of label generation, we propose to generate a stitching dataset with rectangular stitched images as pseudo-ground-truth labels, and the performance upper bound induced from the it can be broken by our unsupervised refinement. Qualitative and quantitative results and evaluations demonstrate the advantages of our method over the state-of-the-art.

3D Mesh Merging and Stitching with Large Overlaps

3D mesh segmentation using a two-stage merging strategy

Approximate Merging of 4 Neighbouring Triangular Bézier Surfaces with Boundary Constraints

RecStitchNet: Learning to Stitch Images with Rectangular Boundaries

Real-Time Mesh Editing Using Extended Mean Value Coordinates

Feature-preserving Mesh Completion

Automatic hexahedral mesh generation for many-to-one sweep volumes

A Novel Mesh Quad-segmentation Algorithm

Computing Overlaps of Two Quadrilateral Mesh Of the Same Connectivity

Research on Image Stitching Algorithm Based on Point-Line Consistency and Local Edge Feature Constraints

A Divide-and-Conquer Approach to Quad Remeshing

City-Scale Point Cloud Stitching Using 2D/3D Registration for Large Geographical Coverage

Interactive Mesh Cloning Driven by Boundary Loop

Image Stitching of Scenes with Large Misregistration

Seam-guided local alignment and stitching for large parallax images

Feature-preserving Quadrilateral Mesh Boolean Operation with Cross-Field Guided Layout Blending

An improved adaptive triangular mesh-based image warping method

Simultaneous Smoothing and Untangling of 2D Meshes Based on Explicit Element Geometric Transformation and Element Stitching

3D Multi-Angle Point Cloud Stitching Using Iterative Closest-point Stitching and K-Nearest-Neighbors

Scalable point cloud meshing for image-based large-scale 3D modeling

Learning Pixel-wise Alignment for Unsupervised Image Stitching