Abstract:Recently, subspace constraints have been widely exploited in many computer vision problems such as multibody grouping. Under linear projection models, feature points associated with multiple bodies reside in multiple subspaces. Most existing factorization-based algorithms can segment objects undergoing independent motions. However, intersections among the correlated motion subspaces will lead most previous factorization-based algorithms to erroneous segmentation. To overcome this limitation, in this paper, we formulate the problem of multibody grouping as inference of multiple subspaces from a high-dimensional data space. A novel and robust algorithm is proposed to capture the configuration of the multiple subspace structure and to find the segmentation of objects by clustering the feature points into these inferred subspaces, no matter whether they are independent or correlated. In the proposed method, an Oriented-Frame (OF), which is a multidimensional coordinate frame, is associated with each data point indicating the point's preferred subspace configuration. Based on the similarity between the subspaces, novel mechanisms of subspace evolution and voting are developed. By filtering the outliers due to their structural incompatibility, the subspace configurations will emerge. Compared with most existing factorization-based algorithms that cannot correctly segment correlated motions, such as motions of articulated objects, the proposed method has a robust performance in both independent and correlated motion segmentation. A number of controlled and real experiments show the effectiveness of the proposed method. However, the current approach does not deal with transparent motions and motion subspaces of different dimensions.

Proximal Robust Factorization for Piecewise Planar Reconstruction

Prior surface model guided dense reconstruction via graph-cuts

3d Orthographic Reconstruction Based On Robust Factorization Method With Outliers

Projective Reconstruction with Missing Data on Factorization Algorithm

Projective Reconstruction with Missing Data Combining 2D Reprojection Error and Subspace Method

Robust 3D Reconstruction with an RGB-D Camera

Factorization for Projective and Metric Reconstruction Via Truncated Nuclear Norm.

CRF-Based Reconstruction from Narrow-Baseline Image Sequences.

A Unified Framework for Piecewise Semantic Reconstruction in Dynamic Scenes Via Exploiting Superpixel Relations.

3d Reconstruction With Multi-View Texture Mapping

Dynamic Spect Reconstruction from Few Projections: A Sparsity Enforced Matrix Factorization Approach

Planar Reconstruction of Indoor Scenes from Sparse Views and Relative Camera Poses

Image reconstruction from limited-angle projections using sparsifying operators

Sparse moving factorization for subspace video stabilization

Robust dense reconstruction by range merging based on confidence estimation

Robust Algebraic Segmentation of Mixed Rigid-Body and Planar Motions from Two Views

Real-time dense 3D reconstruction and camera tracking via embedded planes representation

RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream

Robust Manifold Matrix Factorization for Joint Clustering and Feature Extraction.

Multibody Grouping by Inference of Multiple Subspaces from High-Dimensional Data Using Oriented-Frames

A Robust and Fast 3D Face Reconstruction Method Using Realsense Camera