Abstract:Planar homography (collineation) is an image-to-image mapping that could be used to pinpoint stereo correspondences, but its usage has been limited to only planar scenes. This paper describes a mechanism that generalizes the use of planar homography for establishing stereo correspondences over curved scenes. Piecewise-linear approximation is used to describe curved scene, so that stereo correspondences over images of the scene are captured by a collection of local homographies. Unlike the classical approaches, the mechanism does not employ the smoothness heuristic in establishing correspondences, but is instead based upon the interplay of two processes in an iterative manner: (1) partitioning of the scene into local planar patches based upon the most current set of confirmed stereo correspondences; and (2) prediction of new stereo correspondences by the use of the local homographies defined by the partitions, plus confirmation of such predictions by the image data, thereby enlarging the set of confirmed correspondences in every iteration until no more improvement could be obtained. A key step of the mechanism is to decide what local planar homography, and thereby what planar patch, is to be used for correspondence prediction of any given unmatched feature in any given iteration of the mechanism. With knowledge of the epipolar geometry, homography could be defined by any 3 non-collinear feature correspondences. Thus for any given unmatched feature, there are choices of the aforementioned local homography as defined by any set of three non-collinear matched features in the vicinity of the feature. In this paper, we explore what criteria are to be used to decide which of such triplet sets of matched features should be used. We analyze what errors in correspondence prediction could come with a planar homography. In particular, we classify the errors into scene-related geometric error and computation-related algebraic error. We examine their effects by simulated data experiments, and propose two ways of deciding which local homography to adopt for any given unmatched feature point. Real image experiments show that the methods could lead to promising results.

Homography from Coplanar Ellipses with Application to Forensic Blood Splatter Reconstruction

Area of origin estimation from multiple arbitrarily oriented surfaces using marker-guided structure from motion

Homography-based Correspondence in Weakly Calibrated Curved Surface Environment and Its Error Analysis

Homography estimation from planar contours in image sequence

Linear algorithm for camera self-calibration, motion and structure recovery for multi-planar scenes from two perspective images

A Versatile Homography Computation Method Based on Two Real Points.

Homography Decomposition Networks for Planar Object Tracking

A Crime Scene Reconstruction Method Based on Omni-Directional Catadioptric Cameras

Fast and Interpretable 2D Homography Decomposition: Similarity-Kernel-Similarity and Affine-Core-Affine Transformations

Segmentation of a Piece-Wise Planar Scene from Perspective Images

Homography-based Partitioning of Curved Surface for Stereo Correspondence Establishment

3D RECONSTRUCTION OF EVENTS: SEARCH FOR A SPATIAL CORRELATION BETWEEN INJURIES AND THE GEOMETRY OF THE BODY DISCOVERY SITE

Spherical Panoramic Photo Shooting and Virtual Reality Demonstration of a Crime Scene

A highly accurate dense approach for homography estimation using modified differential evolution.

Detecting and Extracting the Photo Composites Using Planar Homography and Graph Cut

A Solution for Crime Scene Reconstruction using Time-of-Flight Cameras

A new algorithm for 3D projective reconstruction based on infinite homography

Contour Model Based Homography Estimation of Texture-Less Planar Objects in Uncalibrated Images

Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic Scenes

Recovering the position and orientation of free-form objects from image contours using 3D distance maps

Virtual reality and 3D animation in forensic visualization