Abstract:Geometric relationships governing multiple images of points and lines and associated algorithms have been studied to a large extent separately in multiple-view geometry. The previous studies led to a characterization based on multilinear constraints, which have been extensively used for structure and motion recovery, feature matching and image transfer. In this paper we present a universal rank condition on the so-called multiple-view matrix M for arbitrarily combined point and line features across multiple views. The condition gives rise to a complete set of constraints among multiple images. All previously known multilinear constraints become simple instantiations of the new condition. In particular, the relationship between bilinear, trilinear and quadrilinear constraints can be clearly revealed from this new approach. The theory enables us to carry out global geometric analysis for multiple images, as well as systematically characterize all degenerate configurations, without breaking image sequence into pairwise or triple-wise sets of views. This global treatment allows us to utilize all incidence conditions governing all features in all images simultaneously for a consistent recovery of motion and structure from multiple views. In particular, a rank-based multiple-view factorization algorithm for motion and structure recovery is derived from the rank condition. Simulation results are presented to validate the multiple-view matrix based approach.

Generalized Rank Conditions In Multiple View Geometry With Applications To Dynamical Scenes

Rank Conditions on the Multiple-View Matrix

Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

Direct Alignment with Generalized Correspondences: A Unified Framework for Structure-Based Visual Pose Estimation.

A Differential Geometric Approach to Multiple View Geometry in Spaces of Constant Curvature

Projections of Higher Dimensional Subspaces and Generalized Multiview Varieties

Condition numbers in multiview geometry, instability in relative pose estimation, and RANSAC

Multiple-view geometry for image-based modeling.

Lines, Quadrics, and Cremona Transformations in Two-View Geometry

Geometric Principles of Multiple Visual Sensors

Euclidean Reconstruction and Reprojection Up to Subgroups

Single-View's 3D Explanation Based on Prior Knowledge and Constraint Satisfaction

Mixed-Projection Conic Optimization: A New Paradigm for Modeling Rank Constraints

PLMP -- Point-Line Minimal Problems in Complete Multi-View Visibility

On Symmetry and Multiple-View Geometry: Structure, Pose, and Calibration from a Single Image

A Classification of Critical Configurations for any Number of Projective Views

Problems and related results in Algebraic Vision and Multiview Geometry

Multi-view Geometry: Correspondences Refinement Based on Algebraic Properties

A Lie Theoretic Approach to Structure and Motion in Computer Vision 1

Two-View Multibody Structure from Motion

Self-supervised Learning of Monocular 3D Geometry Understanding with Two- and Three-View Geometric Constraints