Survey on human mocap data feature extraction and retrieval

XIAO Bo-xiang,ZHANG Qiang,WEI Xiao-peng

DOI: https://doi.org/10.3969/j.issn.1001-3695.2010.01.003

2010-01-01

Abstract:This paper introduced the developments in this research field,analyzed several main approaches including motion templates-based,content-based,and other representative technologies.Finally,discussed the main limitation of existing methods and the prospects on this field.

What problem does this paper attempt to address?

A group of novel approaches and a toolkit for motion capture data reusing

Jun Xiao,Yueting Zhuang,Fei Wu,Tongqiang Guo,Zhang Liang

DOI: https://doi.org/10.1007/s11042-009-0329-1

IF: 2.577

2009-01-01

Multimedia Tools and Applications

Abstract:Now more and more motion capture (MoCap) systems are used to acquire realistic and highly detailed motion data which are widely used for producing animations of human-like characters in a variety of applications, such as simulations, video games and animation films. And recently large MoCap databases are available. As a kind of emerging multimedia data, 3D human motion has its own specific data form and standard format. But to the best of our knowledge, only a few approaches have been explored for 3D MoCap data feature representation and reusing. This paper proposes a group of novel approaches for posture feature representation, motion sequence segmentation, key-frame extraction and content-based motion retrieval, which are all very important for MoCap data reusing and benefit to the efficient animation production. To validate these approaches, we set up a MoCap database and implemented a prototype toolkit. The experiments show that the proposed algorithms could achieve the approvable results.
Survey on Reuse of Human Motion Capture Data

Huaijiang Sun,Guiyu Xia,Guoqing Zhang,Lei Feng

DOI: https://doi.org/10.16337/j.1004-9037.2017.01.001

2017-01-01

Abstract:Human motion capture data,as a new type of multimedia data,is widely used in many areas because of its high fidelity,but the expensive motion capture equipment yields the high cost of the use of motion capture data.Therefore,the technologies of motion capture data reuse become the effective means to solve the problem.However,the complex structure and characteristics of motion capture data make the motion capture data reuse challenging.Even it has been researched for many years,there are still many problems to be solved and more attentions and research efforts are needed.In this paper,in terms of the important technologies used in the process of motion capture data reuse,we give introductions on the research significance,difficulties,strategy and used models of current methods and so on.And we give a detailed description on some representative methods.Finally,we conclude the research advances of motion capture data reuse and discuss the possible directions for future works.This aims to cause the deep thinking of this field and provides a valuable reference for the future research.
A Survey on Motion Capture Data Retrieval

Na Lv,Yan Huang,Zhiquan Feng,Jingliang Peng

DOI: https://doi.org/10.4028/www.scientific.net/amm.556-562.2944

2014-01-01

Applied Mechanics and Materials

Abstract:With the rapid development of motion capture technology, large motion capture databases are established. How to effectively retrieve the motions from huge amounts of motion data has become a hot topic in computer animation. In this paper, we give a survey on current motion capture data retrieval methods and point out some still existing problems at the end.
A Retrieval Method for Human Mocap Data Based on Biomimetic Pattern Recognition

Xiaopeng Wei,Boxiang Xiao,Qiang Zhang

DOI: https://doi.org/10.2298/csis1001099w

2010-01-01

Computer Science and Information Systems

Abstract:A retrieval method for human Mocap (Motion Capture) data based on biomimetic pattern recognition is presented in this paper. BVH rotation channels are extracted as features of motion for both the retrieval instance and the motion data. Several hyper sausage neurons are constructed according to the retrieval instance, and the trained domain covered by these hyper sausage neurons can be considered as the distribution range of a same kind of motions. By use of CMU free motion database, the retrieval algorithm has been implemented and examined, and the experimental results are illustrated. At the same time, the main contributions and limitations are discussed.
Survey of human motion data reconstruction methods

FANG Xiao-yong,WEI Xiao-peng,ZHANG Qiang,ZHOU Dong-sheng

DOI: https://doi.org/10.3969/j.issn.1001-3695.2008.11.008

2008-01-01

Abstract:Human motion data created from motion capture system are marker position data of motion sequence,and these data drive virtual human model to form an authentic animation.Based on the recent literatures of human motion data reconstruction,this paper attempted to make a survey of human motion data reconstruction methods.First,described human motion data reconstruction.Then summarizd and analyzed the research works about the unavoidable noise and feature point missing problem during the reconstruction of human motion data respectively.Subsequently,discussed the explorations of original optical capture system for capturing human motion data.Then reviewed the research findings about driving human geometrical model with human motion data.At the end,brought forward the future works for the next study.
Video-Based Human Motion Capture Data Retrieval Via MotionSet Network

Tingxin Ren,Wei Li,Zifei Jiang,Xueqing Li,Yan Huang,Jingliang Peng

DOI: https://doi.org/10.1109/access.2020.3030258

IF: 3.9

2020-01-01

IEEE Access

Abstract:Content-based human motion capture (MoCap) data retrieval facilitates reusing motion data that have already been captured and stored in a database. For a MoCap data retrieval system to get practically deployed, both high precision and natural interface are demanded. Targeting both, we propose a video-based human MoCap data retrieval solution in this work. It lets users to specify a query via a video clip, addresses the representational gap between video and MoCap clips and extracts discriminative motion features for precise retrieval. Specifically, the proposed scheme firstly converts each video clip or MoCap clip at a certain viewpoint to a binary silhouette sequence. Regarding a video or MoCap clip as a set of silhouette images, the proposed scheme uses a convolutional neural network, named MotionSet, to extract the discriminative motion feature of the clip. The extracted motion features are used to match a query to repository MoCap clips for the retrieval. Besides the algorithmic solution, we also contribute a human MoCap dataset and a human motion video dataset in couple that contain various action classes. Experiments show that our proposed scheme achieves an increase of around 0.25 in average MAP and costs about 1/26 time for online retrieval, when compared with the benchmark algorithm.
Vector Space Modeling and Retrieval of Human Motion Capture Data

Lan Rongyi,Sun Huaijiang,Lian Heqing,Zhu Mingyang,Li Bin

2011-01-01

Journal of Computer-Aided Design & Computer Graphics

Abstract:For the sake of efficiency and accuracy in retrieving human motions,we model human motion capture data in the form of textual documents and propose a content-based motion retrieval method based on vector space model.In the approach,motion-vocabulary,substantially the most representative human poses,is firstly obtained by applying affinity propagation on the key-pose set which is extracted in advance from database according to upper and lower body respectively.Then motion clips can be represented as motion-documents by replacing each original pose with its closest pose in the motion-vocabulary.Finally we use Bigram vector space model to measure similarities among motions.The approach can automatically index pre-segmented motion clips without human involvement.Experimental results demonstrate the advantages of our approach,both in retrieval accuracy and recall.
A Survey of Video Based Human Motion Capture

Haojie Li,Shouxun Lin,Yongdong Zhang

DOI: https://doi.org/10.3321/j.issn:1003-9775.2006.11.003

2006-01-01

Abstract:A comprehensive survey of the research and recent developments of video based human motion capture (HMC) is presented. The various approaches of HMC are classified into two categories: Top-down category and Bottom-up category. The approaches in each category are described and their principles and technical characteristics are summarized. Finally, the open issues and technical trends of HMC are discussed.
A Survey of Visual Analysis of Human Motion and Its Applications

Qifei Wang

DOI: https://doi.org/10.48550/arXiv.1608.00700

2016-08-23

Abstract:This paper summarizes the recent progress in human motion analysis and its applications. In the beginning, we reviewed the motion capture systems and the representation model of human's motion data. Next, we sketched the advanced human motion data processing technologies, including motion data filtering, temporal alignment, and segmentation. The following parts overview the state-of-the-art approaches of action recognition and dynamics measuring since these two are the most active research areas in human motion analysis. The last part discusses some emerging applications of the human motion analysis in healthcare, human robot interaction, security surveillance, virtual reality and animation. The promising research topics of human motion analysis in the future is also summarized in the last part.

Computer Vision and Pattern Recognition,Artificial Intelligence
A Survey on the Vision-Based Human Motion Recognition

DU You-tian,CHEN Feng,XU Wen-li,LI Yong-bin

DOI: https://doi.org/10.3321/j.issn:0372-2112.2007.01.017

2007-01-01

Abstract:Vision-based human motion analysis is currently one of the most active research fields,and the human motion recognition is a challenging research topic in this field.Human motion recognition has many promising applications such as intelligent surveillance,perceptual interface and content-based video retrieval.In this paper,the improvements of this topic in the last several years are discussed in detail from three aspects:the category of human motions,motion representation methods and motion recognition methods.At the end of the survey,some vital problems of human motion recognition are presented and analyzed.
An efficient algorithm for content-based human motion retrieval

Yan Gao,Lizhuang Ma,Junfa Liu,Xiaomao Wu,Zhihua Chen

DOI: https://doi.org/10.1007/11736639_119

2006-01-01

Abstract:With the development of motion capture techniques; more and more 3D motion libraries become available. The growing amount of motion capture data requires more efficient and effective methods for indexing, searching and retrieving. In many cases, the user will only have a sketchy idea of which kind of motion to look for in the motion database. In consequence, the description about the query movement is a bottleneck for motion retrieval system. This paper presents a framework that can describe and handle the query scenes effectively. Our content-based retrieval system supports two kinds of query modes: textual query mode and query-by-example mode. By using various kinds of qualitative features and adaptive segments of motion capture data stream, our indexing and retrieval methods are carried out at the segment level rather than at the frame level, making them quite efficient. Some experimental examples are given to demonstrate the effectiveness and efficiency of proposed algorithms.
Text-Like motion representation for human motion retrieval

Rongyi Lan,Huaijiang Sun,Mingyang Zhu

DOI: https://doi.org/10.1007/978-3-642-36669-7_10

2013-01-01

Abstract:Human motion capture (mo-cap) data has been increasingly applied in animation, movies and games in recent years due to its visual realism, and large amounts of them were accumulated. How to effectively search logically similar motions from large data repositories is a new challenge. The major limitation of existing methods is the semantic level of the features is not high enough to well distinguish different motion categories. In this paper, we propose a text-like motion representation based on key-pose extraction and hierarchical clustering (HC). This motion representation is easy to be extended or combined with topic models to obtain higher semantic-level features for motion retrieval. Our experiments demonstrate its scalability and performance in several applications, including motion retrieval and motion segmentation.
A Method Of Hyper-Sphere Cover In Multidimensional Space For Human Mocap Data Retrieval

Xiaopeng Wei,Boxiang Xiao,Qiang Zhang,Rui Liu

DOI: https://doi.org/10.2478/v10078-011-0030-0

2011-01-01

Journal of Human Kinetics

Abstract:A method of hyper-sphere cover in multidimensional space for human Mocap (Motion Capture) data retrieval is presented in this paper. After normalization and feature extraction, both the retrieval instance and the motion data are mapping into a multidimensional space. Several hyper-spheres are constructed according to the retrieval instance, and the domain covered by these hyper-spheres can be considered as the distribution range of a same kind of motions. By use of CMU free motion database, the retrieval algorithm has been implemented and examined and the experimental results are illustrated. At the same. tithe, the main contributions and limitations are discussed.
Review of Techniques for Motion Capture Data Processing

Wei Xiaopeng,Liu Rul,and Zhang Qiang

DOI: https://doi.org/10.19583/j.1003-4951.2012.01.001

2012-01-01

Abstract:In order to high reality and efficiency, the technique computer animation. With the development of motion capture, a of motion capture （MoCap） has been widely used in the field of large amount of motion capture databases are available and this is significant for the reuse of motion data. But due to the high degree of freedoms and high capture frequency, the dimension of the mo- tion capture data is usually very high and this will lead to a low efficiency in data processing. So how to process the high dimension data and design an efficient and effective retrieval approach has become a challenge which we can＇t ignore. In this paper, first we lay out some problems about the key techniques in motion capture data processing. Then the existing approaches are analyzed and sum- marized. At last, some future work is proposed.
Intelligent Techniques for Processing and Management of Motion Data

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:Motion Capture (MoCap) systems are widely used in computer animations, simulations and video games. Recently, a large commercial MoCap database is available and it will be of great importance to the reusability of motion data as well as the efficiency of computer animations.
Approach of Scattered Data Processing for Optical Motion Capture

Bo-xiang XIAO,Xiao-peng WEI,Qiang ZHANG,Chang-jun ZHOU

2008-01-01

Abstract:An approach of scattered data processing for passive optical motion capture was proposed. The approach is based on the principle of model matching. Based on rigid construct matching, tracking and topology checking, the parameters of motion could be obtained and the topologic model of human could be constructed according to character markers, local rigid structure and global topologic relation. This method avoids the error of tracking method when two or more markers overlap. Due to the ability of checking and rectifying error, the data processing is in real time and needs no manual works.
Research on Technologies of Motion Capture Data Reuse

ZHU Yong-feng,FEI Guang-zheng,HUANG Zan-zhen,ZHANG Yan

DOI: https://doi.org/10.3969/j.issn.1673-4793.2007.04.010

2007-01-01

Abstract:With advantages of realism and accurcy,the Motion Capture technology achieves great rapid promotion.Since it has been introduced to computer animation,and we can see Motion Capture technology in many field of people's life.However,the technology also has some shortcomings,the most important one of Motion Capture is the high cost.So how to effciently reuse existing motion capture data has become a major focus in computer graphics research.This paper will analysis and compare the reuse technology of motion capture data in detailed.The reuse technology we talking about here refers to reusing motion data which only need much less artiflcial interactive.According to the principles and processing methods,we will divide the motion reusing into three major categories:the direct reuse of Motion Capture data;the indirect reuse Motion Capture data and the hybrid methods of the former two.we will mainly emphasize on various representative techniqes,and analyze their performance or possible improvements.
Automated human motion segmentation via motion regularities

Rongyi Lan,Huaijiang Sun

DOI: https://doi.org/10.1007/s00371-013-0902-5

IF: 2.835

2013-01-01

The Visual Computer

Abstract:Analysis and reuse of human motion capture (mocap) data play an important role in animation, games and medical rehabilitation. In various mocap-based animation techniques, motion segmentation is regarded as one of the fundamental functions. Many proposed segmentation methods utilize little or no prior knowledge. However, human motion has its own regularities, so reasonable prior assumptions on these regularities will lead to better performance. In this paper, we focus on the learning of intrinsic regularities of mocap data based on a small set of training data which only contain daily-life motions. By utilizing these learnt motion regularities, we can successfully segment long motion sequences containing motion types that not even include in the training data. First, by assuming that most types of motions can be composed of a small number of typical poses, the motion vocabulary (mo-vocabulary) can be obtained using key pose extraction and clustering analysis, which are regarded as the low-level motion regularity. By replacing each frame with the most similar pose in the mo-vocabulary, mocap data can be transformed into text-like documents. Second, we use latent Dirichlet allocation to capture the patterns of pose combinations that frequently occur in human motions, namely the motion topics (mo-topics), which are regarded as the high-level motion regularities. By representing the target motion as the distribution over the learnt mo-topics, the segmentation task can be naturally turned into a problem of detecting notable changes of this distribution. Finally, we propose local semantic coherence curve to segment motion sequences. Since mo-topics are semantically meaningful and significantly increase the abstraction-level of motion representation, logically correct results can be obtained. The experiments demonstrate that the proposed approach outperforms the available methods on CMU and Bonn mocap database.
Human Motion Retrieval Using Topic Model.

Mingyang Zhu,Huaijiang Sun,Rongyi Lan,Bin Li

DOI: https://doi.org/10.1002/cav.432

IF: 1.01

2011-01-01

Computer Animation and Virtual Worlds

Abstract:ABSTRACTContent‐based human motion retrieval is important for animators with the development of motion editing and synthesis, which need to search similar motions in large databases. Obtaining text‐based representation from quantization of mocap data turned out to be efficient. It becomes a fundamental step of many researches in human motion analysis. Geometric features are one of these techniques, which involve much prior knowledge and reduce data redundancy of numerical data. We describe geometric features as basic unit to define human motions (also called mo‐words) and view a human motion as a generative process. Therefore, we obtain topic motions, which possess more semantic information using latent Dirichlet allocation by learning from massive training examples in order to understand motions better. We combine probabilistic model with human motion retrieval and come up with a new representation of human motions and a new retrieval framework. Our experiments demonstrate its advantages, both for understanding motions and retrieval. Copyright © 2011 John Wiley & Sons, Ltd.
Motion Capture Technology in Sports Scenarios: A Survey

Xiang Suo,Weidi Tang,Zhen Li

DOI: https://doi.org/10.3390/s24092947

IF: 3.9

2024-05-06

Sensors

Abstract:Motion capture technology plays a crucial role in optimizing athletes' skills, techniques, and strategies by providing detailed feedback on motion data. This article presents a comprehensive survey aimed at guiding researchers in selecting the most suitable motion capture technology for sports science investigations. By comparing and analyzing the characters and applications of different motion capture technologies in sports scenarios, it is observed that cinematography motion capture technology remains the gold standard in biomechanical analysis and continues to dominate sports research applications. Wearable sensor-based motion capture technology has gained significant traction in specialized areas such as winter sports, owing to its reliable system performance. Computer vision-based motion capture technology has made significant advancements in recognition accuracy and system reliability, enabling its application in various sports scenarios, from single-person technique analysis to multi-person tactical analysis. Moreover, the emerging field of multimodal motion capture technology, which harmonizes data from various sources with the integration of artificial intelligence, has proven to be a robust research method for complex scenarios. A comprehensive review of the literature from the past 10 years underscores the increasing significance of motion capture technology in sports, with a notable shift from laboratory research to practical training applications on sports fields. Future developments in this field should prioritize research and technological advancements that cater to practical sports scenarios, addressing challenges such as occlusion, outdoor capture, and real-time feedback.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

Survey on human mocap data feature extraction and retrieval

A group of novel approaches and a toolkit for motion capture data reusing

Survey on Reuse of Human Motion Capture Data

A Survey on Motion Capture Data Retrieval

A Retrieval Method for Human Mocap Data Based on Biomimetic Pattern Recognition

Survey of human motion data reconstruction methods

Video-Based Human Motion Capture Data Retrieval Via MotionSet Network

Vector Space Modeling and Retrieval of Human Motion Capture Data

A Survey of Video Based Human Motion Capture

A Survey of Visual Analysis of Human Motion and Its Applications

A Survey on the Vision-Based Human Motion Recognition

An efficient algorithm for content-based human motion retrieval

Text-Like motion representation for human motion retrieval

A Method Of Hyper-Sphere Cover In Multidimensional Space For Human Mocap Data Retrieval

Review of Techniques for Motion Capture Data Processing

Intelligent Techniques for Processing and Management of Motion Data

Approach of Scattered Data Processing for Optical Motion Capture

Research on Technologies of Motion Capture Data Reuse

Automated human motion segmentation via motion regularities

Human Motion Retrieval Using Topic Model.

Motion Capture Technology in Sports Scenarios: A Survey