Abstract:The field of multiple view geometry has seen tremendous progress in reconstruction and calibration due to methods for extracting reliable point features and key developments in projective geometry. Point features, however, are not available in certain applications and result in unstructured point cloud reconstructions. General image curves provide a complementary feature when keypoints are scarce, and result in 3D curve geometry, but face challenges not addressed by the usual projective geometry of points and algebraic curves. We address these challenges by laying the theoretical foundations of a framework based on the differential geometry of general curves, including stationary curves, occluding contours, and non-rigid curves, aiming at stereo correspondence, camera estimation (including calibration, pose, and multiview epipolar geometry), and 3D reconstruction given measured image curves. By gathering previous results into a cohesive theory, novel results were made possible, yielding three contributions. First, we derive the differential geometry of an image curve (tangent, curvature, curvature derivative) from that of the underlying space curve (tangent, curvature, curvature derivative, torsion). Second, we derive the differential geometry of a space curve from that of two corresponding image curves. Third, the differential motion of an image curve is derived from camera motion and the differential geometry and motion of the space curve. The availability of such a theory enables novel curve-based multiview reconstruction and camera estimation systems to augment existing point-based approaches. This theory has been used to reconstruct a “3D curve sketch”, to determine camera pose from local curve geometry, and tracking; other developments are underway.

Projections of Curves and Conic Multiview Varieties

Projections of Higher Dimensional Subspaces and Generalized Multiview Varieties

Line Multiview Ideals

Multiview Differential Geometry of Curves

Mult-Projective Models for Jacobian Varieties of Genus Two Curves

Projection pencil of quadrics and Ivory theorem

Syzygies of general projections of canonical and paracanonical curves

Algebra and Geometry of Camera Resectioning

Syzygies of Curves in Products of Projective Spaces

A Furstenberg-type problem for circles, and a Kaufman-type restricted projection theorem in $\mathbb{R}^3$

Separating Cones defined by Toric Varieties: Some Properties and Open Problems

A Classification of Critical Configurations for any Number of Projective Views

Metric Multiview Geometry -- a Catalogue in Low Dimensions

Problems and related results in Algebraic Vision and Multiview Geometry

Geometry of the conics on the Minkowski plane

Injective linear series of algebraic curves on quadrics

A Note on Projectivized Tangent Cone Quadrics of a Prym Canonical Curve

Conic bundle threefolds differing by a constant Brauer class and connections to rationality

Stratification of Projection Maps From Toric Varieties

Restricted Projections to Lines in $\mathbb{R}^{n+1}$