Abstract:This paper presents a complete system for constructing panoramic image mosaics from sequences of images. Our mosaic representation associates a transformation matrix with each input image, rather than explicitly projecting all of the images onto a common surface (e.g., a cylinder). In particular, to construct a full view panorama, we introduce a rotational mosaic representation that associates a rotation matrix (and optionally a focal length) with each input image. A patch-based alignment algorithm is developed to quickly align two images given motion models. Techniques for estimating and refining camera focal lengths are also presented. In order to reduce accumulated registration errors, we apply global alignment (block adjustment) to the whole sequence of images, which results in an optimally registered image mosaic. To compensate for small amounts of motion parallax introduced by translations of the camera and other unmodeled distortions, we use a local alignment (deghosting) technique which warps each image based on the results of pairwise local image registrations. By combining both global and local alignment, we significantly improve the quality of our image mosaics, thereby enabling the creation of full view panoramic mosaics with hand-held cameras. We also present an inverse texture mapping algorithm for efficiently extracting environment maps from our panoramic image mosaics. By mapping the mosaic onto an arbitrary texture-mapped polyhedron surrounding the origin, we can explore the virtual environment using standard 3D graphics viewers and hardware without requiring special-purpose players.

Image Mosaicking for Oversized Documents with a Multi-Camera Rig

Image mosaic with relaxed motion

A Robust Method for Automatic Panoramic UAV Image Mosaic

Robust Multi-homography Method for Image Stitching under Large Viewpoint Changes

Warped Document Image Mosaicing Method Based on Inflection Point Detection and Registration

Image Stitching of Scenes with Large Misregistration

A robust image mosaicing technique capable of creating integrated panoramas

Research on Image Fully Automatic Mosaic Method with Large Rotation Angle from Unmanned Aerial Vehicle

New Multi-Resolution Image Stitching with Local and Global Alignment

Image Mosaicing Based on Binocular Cameras

Mosaicing of Fisheye Images Through Conformal Projection and Sphere Matching

A Warped Document Image Mosaicing Method Based on Registration and TRS Transform

Automatic Panoramic Stitching Of Omni-Directional Remote Sensing Images

Fast Video Mosaic Construction for Observation of Large Static Scenes.

Image Mosaic Algorithm of Sequential Images Based on Voronoi

Seamless Video Stitching from Hand-held Camera Inputs.

A Fast And Robust Image Stitching Algorithm

Image Mosaics of Big Moving Object based on Characteristics

Image panoramic mosaicing with global and local registration

Parallax-tolerant Image Stitching via Segmentation-guided Multi-homography Warping

Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment