Abstract:Prevailing efforts to study the standard formulation of motion and structure recovery have recently been focused on issues of sensitivity and robustness of existing techniques. While many cogent observations have been made and verified experimentally, many statements do not hold in general settings and make a comparison of existing techniques difficult. With an ultimate goal of clarifying these issues, we study the main aspects of motion and structure recovery: the choice of objective function, optimization techniques and sensitivity and robustness issues in the presence of noise. We clearly reveal the relationship among different objective functions, such as “(normalized) epipolar constraints,” “reprojection error” or “triangulation,” all of which can be unified in a new “optimal triangulation” procedure. Regardless of various choices of the objective function, the optimization problems all inherit the same unknown parameter space, the so-called “essential manifold.” Based on recent developments of optimization techniques on Riemannian manifolds, in particular on Stiefel or Grassmann manifolds, we propose a Riemannian Newton algorithm to solve the motion and structure recovery problem, making use of the natural differential geometric structure of the essential manifold. We provide a clear account of sensitivity and robustness of the proposed linear and nonlinear optimization techniques and study the analytical and practical equivalence of different objective functions. The geometric characterization of critical points and the simulation results clarify the difference between the effect of bas-relief ambiguity, rotation and translation confounding and other types of local minima. This leads to consistent interpretations of simulation results over a large range of signal-to-noise ratio and variety of configurations.

Roto-translated Local Coordinate Frames For Interacting Dynamical Systems

Frame-by-frame Motion Retargeting with Self-Collision Avoidance from Diverse Human Demonstrations

Toward Consistent Drift-free Visual Inertial Localization on Keyframe Based Map

A COROTATIONAL UPDATED LAGRANGIAN FORMULATION FOR GEOMETRICALLY NONLINEAR ANALYSIS OF 2D FRAMES

Local Optimized and Scalable Frame-to-model SLAM

The Importance of Coordinate Frames in Dynamic SLAM

Tensor Frames -- How To Make Any Message Passing Network Equivariant

Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling

Physics meets Topology: Physics-informed topological neural networks for learning rigid body dynamics

SE(3) Equivariant Graph Neural Networks with Complete Local Frames

Dynamic Inference on Graphs using Structured Transition Models

Learning Kinematic Structure Correspondences Using Multi-Order Similarities

Learning Generalizable Physical Dynamics of 3D Rigid Objects.

Learning Interpretable Dynamics from Images of a Freely Rotating 3D Rigid Body

A Riemannian Take on Distance Fields and Geodesic Flows in Robotics

Invariant-based Mapping of Space During General Motion of an Observer

Learning Generalizable Final-State Dynamics of 3D Rigid Objects.

Spatio-temporal and geometry constrained network for automobile visual odometry

Optimization Criteria and Geometric Algorithms for Motion and Structure Estimation

Spectral Sparsification for Communication-Efficient Collaborative Rotation and Translation Estimation

l-dyno: framework to learn consistent visual features using robot's motion