Abstract:Recently, subspace constraints have been widely exploited in many computer vision problems such as multibody grouping. Under linear projection models, feature points associated with multiple bodies reside in multiple subspaces. Most existing factorization-based algorithms can segment objects undergoing independent motions. However, intersections among the correlated motion subspaces will lead most previous factorization-based algorithms to erroneous segmentation. To overcome this limitation, in this paper, we formulate the problem of multibody grouping as inference of multiple subspaces from a high-dimensional data space. A novel and robust algorithm is proposed to capture the configuration of the multiple subspace structure and to find the segmentation of objects by clustering the feature points into these inferred subspaces, no matter whether they are independent or correlated. In the proposed method, an Oriented-Frame (OF), which is a multidimensional coordinate frame, is associated with each data point indicating the point's preferred subspace configuration. Based on the similarity between the subspaces, novel mechanisms of subspace evolution and voting are developed. By filtering the outliers due to their structural incompatibility, the subspace configurations will emerge. Compared with most existing factorization-based algorithms that cannot correctly segment correlated motions, such as motions of articulated objects, the proposed method has a robust performance in both independent and correlated motion segmentation. A number of controlled and real experiments show the effectiveness of the proposed method. However, the current approach does not deal with transparent motions and motion subspaces of different dimensions.

Motion Segmentation by Multibody Trifocal Tensor Using Line Correspondence

Two-View Multibody Structure from Motion

Tracking Multiple People under Occlusion and Across Cameras Using Probabilistic Models

Motion Objects Segmentation Using a New Level Set Based Method

TC-SfM: Robust Track-Community-Based Structure-from-Motion

Motion Segmentation Via Robust Subspace Separation in the Presence of Outlying, Incomplete, or Corrupted Trajectories

Motion Segmentation in the Presence of Outlying, Incomplete, or Corrupted Trajectories

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Motion Segmentation from a Moving Monocular Camera

Trifocal Relative Pose from Lines at Points and its Efficient Solution

Simultaneous multi-body stereo and segmentation

Multibody Grouping by Inference of Multiple Subspaces from High-Dimensional Data Using Oriented-Frames

Dense Scene Multiple Object Tracking with Box-Plane Matching

Spatiotemporal Strategies for Joint Segmentation and Motion Tracking from Cardiac Image Sequences

Adaptive Visual Trajectory Tracking of Nonholonomic Mobile Robots Based on Trifocal Tensor

Motion Segmentation via Synchronization

MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronization

Video-object segmentation and 3D-trajectory estimation for monocular video sequences

Multi-Motion Segmentation: Combining Geometric Model-Fitting and Optical Flow for RGB Sensors

A new geometric approach for three view line reconstruction and motion estimation in Manhattan Scenes

Video Object Segmentation Via Dense Trajectories