Abstract:Geometric relationships governing multiple images of points and lines and associated algorithms have been studied to a large extent separately in multiple-view geometry. The previous studies led to a characterization based on multilinear constraints, which have been extensively used for structure and motion recovery, feature matching and image transfer. In this paper we present a universal rank condition on the so-called multiple-view matrix M for arbitrarily combined point and line features across multiple views. The condition gives rise to a complete set of constraints among multiple images. All previously known multilinear constraints become simple instantiations of the new condition. In particular, the relationship between bilinear, trilinear and quadrilinear constraints can be clearly revealed from this new approach. The theory enables us to carry out global geometric analysis for multiple images, as well as systematically characterize all degenerate configurations, without breaking image sequence into pairwise or triple-wise sets of views. This global treatment allows us to utilize all incidence conditions governing all features in all images simultaneously for a consistent recovery of motion and structure from multiple views. In particular, a rank-based multiple-view factorization algorithm for motion and structure recovery is derived from the rank condition. Simulation results are presented to validate the multiple-view matrix based approach.

Line Multiview Ideals

Line multiview ideals

Problems and related results in Algebraic Vision and Multiview Geometry

Projections of Curves and Conic Multiview Varieties

Projections of Higher Dimensional Subspaces and Generalized Multiview Varieties

Lines, Quadrics, and Cremona Transformations in Two-View Geometry

PLMP -- Point-Line Minimal Problems in Complete Multi-View Visibility

Algebra and Geometry of Camera Resectioning

Metric Multiview Geometry -- a Catalogue in Low Dimensions

Birational geometry of critical loci in Algebraic Vision

PL P: Point-Line Minimal Problems under Partial Visibility in Three Views

PL${}_{1}$P -- Point-line Minimal Problems under Partial Visibility in Three Views

Rank Conditions on the Multiple-View Matrix

The multidegree of the multi-image variety

A study of nonlinear multiview varieties

Euclidean distance degree of the multiview variety

A Clifford algebraic Approach to Line Geometry

Generalized Rank Conditions In Multiple View Geometry With Applications To Dynamical Scenes

Linearly presented perfect ideals of codimension $2$ in three variables

Mult-Projective Models for Jacobian Varieties of Genus Two Curves

Critical configurations for two projective views, a new approach