Abstract:Analysis and reuse of human motion capture (mocap) data play an important role in animation, games and medical rehabilitation. In various mocap-based animation techniques, motion segmentation is regarded as one of the fundamental functions. Many proposed segmentation methods utilize little or no prior knowledge. However, human motion has its own regularities, so reasonable prior assumptions on these regularities will lead to better performance. In this paper, we focus on the learning of intrinsic regularities of mocap data based on a small set of training data which only contain daily-life motions. By utilizing these learnt motion regularities, we can successfully segment long motion sequences containing motion types that not even include in the training data. First, by assuming that most types of motions can be composed of a small number of typical poses, the motion vocabulary (mo-vocabulary) can be obtained using key pose extraction and clustering analysis, which are regarded as the low-level motion regularity. By replacing each frame with the most similar pose in the mo-vocabulary, mocap data can be transformed into text-like documents. Second, we use latent Dirichlet allocation to capture the patterns of pose combinations that frequently occur in human motions, namely the motion topics (mo-topics), which are regarded as the high-level motion regularities. By representing the target motion as the distribution over the learnt mo-topics, the segmentation task can be naturally turned into a problem of detecting notable changes of this distribution. Finally, we propose local semantic coherence curve to segment motion sequences. Since mo-topics are semantically meaningful and significantly increase the abstraction-level of motion representation, logically correct results can be obtained. The experiments demonstrate that the proposed approach outperforms the available methods on CMU and Bonn mocap database.

Automated human motion segmentation via motion regularities

Human motion segmentation using collaborative representations of 3D skeletal sequences.

Motion Objects Segmentation Using a New Level Set Based Method

Segmentation of Human Motion Capture Data Based on Laplasse Eigenmaps.

A group of novel approaches and a toolkit for motion capture data reusing

Unsupervised Categorization of Human Motion Sequences

Motion Retrieval Based On Movement Notation Language

Automatic And Robust Classification Of Independent Motions In Video Sequences

Motion retrieval based on movement notation language: Motion Capture and Retrieval

Human Motion Capture Data Retrieval and Segmentation Technology for Professional Sports Training

Unsupervised Temporal Segmentation of Repetitive Human Actions Based on Kinematic Modeling and Frequency Analysis

Motionlets: Mid-level 3D Parts for Human Motion Recognition

RoMo: A Robust Solver for Full-body Unlabeled Optical Motion Capture

A Human Motion Feature Based on Semi-Supervised Learning of GMM

Efficient motion capture data recovery via relationship-aggregated graph network and temporal pattern reasoning

Human Motion Estimation from a Reduced Marker Set.

FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models

Fine-Grained Semantic Segmentation of Motion Capture Data using Dilated Temporal Fully-Convolutional Networks

A novel method for automated human behavior segmentation

Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections

Motion Segmentation from a Moving Monocular Camera