Abstract:In computer vision, camera pose estimation from correspondences between 3D geometric entities and their projections into the image has been a widely investigated problem. Although most state-of-the-art methods exploit low-level primitives such as points or lines, the emergence of very effective CNN-based object detectors in the recent years has paved the way to the use of higher-level features carrying semantically meaningful information. Pioneering works in that direction have shown that modelling 3D objects by ellipsoids and 2D detections by ellipses offers a convenient manner to link 2D and 3D data. However, the mathematical formalism most often used in the related litterature does not enable to easily distinguish ellipsoids and ellipses from other quadrics and conics, leading to a loss of specificity potentially detrimental in some developments. Moreover, the linearization process of the projection equation creates an over-representation of the camera parameters, also possibly causing an efficiency loss. In this paper, we therefore introduce an ellipsoid-specific theoretical framework and demonstrate its beneficial properties in the context of pose estimation. More precisely, we first show that the proposed formalism enables to reduce the pose estimation problem to a position or orientation-only estimation problem in which the remaining unknowns can be derived in closed-form. Then, we demonstrate that it can be further reduced to a 1 Degree-of-Freedom (1DoF) problem and provide the analytical derivations of the pose as a function of that unique scalar unknown. We illustrate our theoretical considerations by visual examples and include a discussion on the practical aspects. Finally, we release this paper along with the corresponding source code in order to contribute towards more efficient resolutions of ellipsoid-related pose estimation problems.

Ellipsoid-constrained robust fitting of quadrics with application to the 3D morphological characterization of articular surfaces

Direct least square fitting of ellipsoids

Spectral Quadrangulation with Orientation and Alignment Control.

Quadric surface reconstruction based on segmentation and constrained optimization

A Recursive Fitting-and-Splitting Algorithm for 3-D Object Modeling Based on Superquadrics

A Fast Algorithm for Multidimensional Ellipsoid-Specific Fitting by Minimizing a New Defined Vector Norm of Residuals Using Semidefinite Programming

Constrained Fitting for 2D Profile-Based Reverse Modeling

A Recursive Fitting-And-Splitting Algorithm For 3-D Object Modeling Using Superquadrics

Statistical deformable bone models for robust 3D surface extrapolation from sparse data

Nonrigid Object Motion and Deformation Estimation from Three‐dimensional Data

Curvature estimation for meshes via algebraic quadric fitting

Robust Ellipsoid-specific Fitting via Expectation Maximization.

A Unified Approach for Least-Squares Surface Fitting

Deformable modeling using a 3D boundary representation with quadratic constraints on the branching structure of the Blum skeleton

Mobility Fitting Using 4d Ransac

Computer-Aided Modeling of Hip Joint and Geometric Morphological Analysis

The Shape of the Acetabular Cartilage Surface: A Geometric Morphometric Study Using Three-Dimensional Scanning

Superquadric-Based Object Modeling by an Iterative Segmentation-And-Recovery Algorithm

Gaussian mixture models based 2D–3D registration of bone shapes for orthopedic surgery planning

Perspective-1-Ellipsoid: Formulation, Analysis and Solutions of the Camera Pose Estimation Problem from One Ellipse-Ellipsoid Correspondence

Robust and Accurate Superquadric Recovery: a Probabilistic Approach