Abstract:This paper studies segmentation of multiple rigid-body motions in a 3-D dynamic scene under perspective camera projection. We consider dynamic scenes that contain both 3-D rigid-body structures and 2-D planar structures. Based on the well-known epipolar and homography constraints between two views, we propose a hybrid perspective constraint (HPC) to unify the representation of rigid-body and planar motions. Given a mixture of K hybrid perspective constraints, we propose an algebraic process to partition image correspondences to the individual 3-D motions, called Robust Algebraic Segmentation (RAS). Particularly, we prove that the joint distribution of image correspondences is uniquely determined by a set of (2 K )-th degree polynomials, a global signature for the union of K motions of possibly mixed type. The first and second derivatives of these polynomials provide a means to recover the association of the individual image samples to their respective motions. Finally, using robust statistics, we show that the polynomials can be robustly estimated in the presence of moderate image noise and outliers. We conduct extensive simulations and real experiments to validate the performance of the new algorithm. The results demonstrate that RAS achieves notably higher accuracy than most existing robust motion-segmentation methods, including random sample consensus (RANSAC) and its variations. The implementation of the algorithm is also two to three times faster than the existing methods. The implementation of the algorithm and the benchmark scripts are available at http://perception.csl.illinois.edu/ras/ .

Robust Motion Segmentation Via Refined Sparse Subspace Clustering

Robust Trajectory Clustering for Motion Segmentation

Motion Segmentation Via Robust Subspace Separation in the Presence of Outlying, Incomplete, or Corrupted Trajectories

Human Motion Segmentation Via Robust Kernel Sparse Subspace Clustering.

Tracking in Multimedia Data Via Robust Reweighted Local Multi-Task Sparse Representation for Transportation Surveillance

Motion Segmentation in the Presence of Outlying, Incomplete, or Corrupted Trajectories

Robust Structured Sparse Subspace Clustering with Neighborhood Preserving Projection.

Correntropy Metric-Based Robust Low-Rank Subspace Clustering for Motion Segmentation.

The Ordered Residual Kernel for Robust Motion Subspace Clustering.

Online Hierarchical Sparse Representation of Multifeature for Robust Object Tracking

Motion Segmentation Via a Sparsity Constraint

Robust Multi-Body Motion Segmentation Based on Fuzzy K-Subspace Clustering

Robust human body tracking using sparse representation

Robust Self-Sparse Fuzzy Clustering for Image Segmentation

Robust Motion Segmentation with Unknown Correspondences.

A Subspace Clustering Algorithm Based on Simultaneously Sparse and Low-Rank Representation

Robust Algebraic Segmentation of Mixed Rigid-Body and Planar Motions from Two Views

Robust Visual Tracking Using Sparse Discriminative Graph Embedding.

Video object segmentation by motion-based sequential feature clustering.

Rigidly Self-Expressive Sparse Subspace Clustering.

Robust Object Tracking Based on Sparse Representation.