Abstract:This paper studies segmentation of multiple rigid-body motions in a 3-D dynamic scene under perspective camera projection. We consider dynamic scenes that contain both 3-D rigid-body structures and 2-D planar structures. Based on the well-known epipolar and homography constraints between two views, we propose a hybrid perspective constraint (HPC) to unify the representation of rigid-body and planar motions. Given a mixture of K hybrid perspective constraints, we propose an algebraic process to partition image correspondences to the individual 3-D motions, called Robust Algebraic Segmentation (RAS). Particularly, we prove that the joint distribution of image correspondences is uniquely determined by a set of (2 K )-th degree polynomials, a global signature for the union of K motions of possibly mixed type. The first and second derivatives of these polynomials provide a means to recover the association of the individual image samples to their respective motions. Finally, using robust statistics, we show that the polynomials can be robustly estimated in the presence of moderate image noise and outliers. We conduct extensive simulations and real experiments to validate the performance of the new algorithm. The results demonstrate that RAS achieves notably higher accuracy than most existing robust motion-segmentation methods, including random sample consensus (RANSAC) and its variations. The implementation of the algorithm is also two to three times faster than the existing methods. The implementation of the algorithm and the benchmark scripts are available at http://perception.csl.illinois.edu/ras/ .

Motion Segmentation of Multiple Translating Objects Using Line Correspondences

Motionobject segmentation algorithm based on spatial-temporal information

Global Pose Estimation Iterative Algorithm for Multi-camera from Point and Line Correspondences

Two-View Multibody Structure from Motion

Tracking Multiple People under Occlusion and Across Cameras Using Probabilistic Models

Motion Objects Segmentation Using a New Level Set Based Method

Robust Algebraic Segmentation of Mixed Rigid-Body and Planar Motions from Two Views

Motion Segmentation Via Robust Subspace Separation in the Presence of Outlying, Incomplete, or Corrupted Trajectories

TC-SfM: Robust Track-Community-Based Structure-from-Motion

Motion Segmentation in the Presence of Outlying, Incomplete, or Corrupted Trajectories

SEGMENTING AND ESTIMATING MULTIPLE 3 D RIGID MOTIONS FROM 2 D POINT CORRESPONDENCES

A Unified Algebraic Approach to 2-D and 3-D Motion Segmentation and Estimation

An Accurate and Real-time Relative Pose Estimation from Triple Point-line Images by Decoupling Rotation and Translation

Matching and Estimating Motion of Line Model Using Geometric Algebra

Motion Segmentation from a Moving Monocular Camera

Multiresolution Segmentation of Video Objects in the Compression Domain

Human motion segmentation using collaborative representations of 3D skeletal sequences.

A Multi-cut Formulation for Joint Segmentation and Tracking of Multiple Objects

Motion Segmentation via Synchronization

Multi-Motion Segmentation: Combining Geometric Model-Fitting and Optical Flow for RGB Sensors

On Multiple Objects Tracking Based on Linear Fitting