Abstract:Recently, subspace constraints have been widely exploited in many computer vision problems such as multibody grouping. Under linear projection models, feature points associated with multiple bodies reside in multiple subspaces. Most existing factorization-based algorithms can segment objects undergoing independent motions. However, intersections among the correlated motion subspaces will lead most previous factorization-based algorithms to erroneous segmentation. To overcome this limitation, in this paper, we formulate the problem of multibody grouping as inference of multiple subspaces from a high-dimensional data space. A novel and robust algorithm is proposed to capture the configuration of the multiple subspace structure and to find the segmentation of objects by clustering the feature points into these inferred subspaces, no matter whether they are independent or correlated. In the proposed method, an Oriented-Frame (OF), which is a multidimensional coordinate frame, is associated with each data point indicating the point's preferred subspace configuration. Based on the similarity between the subspaces, novel mechanisms of subspace evolution and voting are developed. By filtering the outliers due to their structural incompatibility, the subspace configurations will emerge. Compared with most existing factorization-based algorithms that cannot correctly segment correlated motions, such as motions of articulated objects, the proposed method has a robust performance in both independent and correlated motion segmentation. A number of controlled and real experiments show the effectiveness of the proposed method. However, the current approach does not deal with transparent motions and motion subspaces of different dimensions.

A Structure Constraint Matrix Factorization Framework for Human Behavior Segmentation

Based on network probabilistic graph human pose segmentation algorithm

Human Motion Segmentation Based on Structure Constraint Matrix Factorization

A novel method for automated human behavior segmentation

Real-Time Human Segmentation Using Pose Skeleton Map

Structural Constraint Deep Matrix Factorization for Sequential Data Clustering

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Robust Human Body Segmentation Based on Part Appearance and Spatial Constraint

A Spatial-Temporal Topic Segmentation Model For Human Mobile Behavior

Human Posture Segmentation by Constrained Spectral Clustering

Research on Multi-Scale Spatio-Temporal Graph Convolutional Human Behavior Recognition Method Incorporating Multi-Granularity Features

Multibody Grouping by Inference of Multiple Subspaces from High-Dimensional Data Using Oriented-Frames

Structure constrained nonnegative matrix factorization for pattern clustering and classification

Human behavior segmentation and recognition using Continuous Linear Dynamic System

3D Human pose estimation from video via multi-scale multi-level spatial temporal features

A Semi-supervised Clustering-based Segmentation Algorithm of 3D Reconstructed Human Body Parts

3D Human Posture Segmentation by Spectral Clustering with Surface Normal Constraint

Fine-Grained Human-Centric Tracklet Segmentation with Single Frame Supervision

Adaptive Selection of Reference Frames for Video Object Segmentation.

A Structural-Constraint 3D Point Clouds Segmentation Adversarial Method