Intelligent Motion Data Reusing Techniques

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:In order to reuse the existing 3D human motion data to create animation and improve the efficiency of animation creation, the motion reusing technique is becoming a hotspot in research. Generally, the motion reusing includes motion editing, motion synthesis and motion retargeting, etc.

What problem does this paper attempt to address?

Reuse of Motion Capture Data in Animation: A Review

Weidong Geng,Gino Yu

DOI: https://doi.org/10.1007/3-540-44842-X_63

2003-01-01

Abstract:The reuse of motion capture data is receiving increasing attention in computer animation. This interest is motivated by a wide spectrum of time-critical applications, such as video game development and animation production. This paper gives an overview of various tasks and techniques involved in the reuse of motion capture data in terms of motion authoring pipeline. We assume that whenever the user is asked to build motions, he/she will at first go to retrieve/browse the pre-recorded motions in the motion database, look for the best-fit candidate motion segments/pieces/clips, and manage to adapt them to fit the specified requirements. The two core issues in motion reuse, motion adaptation techniques and motion library construction, are the focus of this review.
Research on Technologies of Motion Capture Data Reuse

ZHU Yong-feng,FEI Guang-zheng,HUANG Zan-zhen,ZHANG Yan

DOI: https://doi.org/10.3969/j.issn.1673-4793.2007.04.010

2007-01-01

Abstract:With advantages of realism and accurcy,the Motion Capture technology achieves great rapid promotion.Since it has been introduced to computer animation,and we can see Motion Capture technology in many field of people's life.However,the technology also has some shortcomings,the most important one of Motion Capture is the high cost.So how to effciently reuse existing motion capture data has become a major focus in computer graphics research.This paper will analysis and compare the reuse technology of motion capture data in detailed.The reuse technology we talking about here refers to reusing motion data which only need much less artiflcial interactive.According to the principles and processing methods,we will divide the motion reusing into three major categories:the direct reuse of Motion Capture data;the indirect reuse Motion Capture data and the hybrid methods of the former two.we will mainly emphasize on various representative techniqes,and analyze their performance or possible improvements.
Learning a Deep Motion Interpolation Network for Human Skeleton Animations

Qiaorui Chen,Shuai Zhang,Yao Zheng

DOI: https://doi.org/10.1002/cav.2003

IF: 1.01

2021-01-01

Computer Animation and Virtual Worlds

Abstract:Motion interpolation technology produces transition motion frames between two discrete movements. It is wildly used in video games, virtual reality and augmented reality. In the fields of computer graphics and animations, our data-driven method generates transition motions of two arbitrary animations without additional control signals. In this work, we propose a novel carefully designed deep learning framework, named deep motion interpolation network (DMIN), to learn human movement habits from a real dataset and then to perform the interpolation function specific for human motions. It is a data-driven approach to capture overall rhythm of two given discrete movements and generate natural in-between motion frames. The sequence-by-sequence architecture allows completing all missing frames within single forward inference, which reduces computation time for interpolation. Experiments on human motion datasets show that our network achieves promising interpolation performance. The ablation study demonstrates the effectiveness of the carefully designed DMIN.(1)
Intelligent Techniques for Character Animation

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:Motion capture based animation has become one of the most promising areas in computer animation. But the motion capture equipment is expensive. To be able to reuse the data and make new movements, we need to modify or edit the motion capture data before retargeting it to animated characters.
Survey on Reuse of Human Motion Capture Data

Huaijiang Sun,Guiyu Xia,Guoqing Zhang,Lei Feng

DOI: https://doi.org/10.16337/j.1004-9037.2017.01.001

2017-01-01

Abstract:Human motion capture data,as a new type of multimedia data,is widely used in many areas because of its high fidelity,but the expensive motion capture equipment yields the high cost of the use of motion capture data.Therefore,the technologies of motion capture data reuse become the effective means to solve the problem.However,the complex structure and characteristics of motion capture data make the motion capture data reuse challenging.Even it has been researched for many years,there are still many problems to be solved and more attentions and research efforts are needed.In this paper,in terms of the important technologies used in the process of motion capture data reuse,we give introductions on the research significance,difficulties,strategy and used models of current methods and so on.And we give a detailed description on some representative methods.Finally,we conclude the research advances of motion capture data reuse and discuss the possible directions for future works.This aims to cause the deep thinking of this field and provides a valuable reference for the future research.
A group of novel approaches and a toolkit for motion capture data reusing

Jun Xiao,Yueting Zhuang,Fei Wu,Tongqiang Guo,Zhang Liang

DOI: https://doi.org/10.1007/s11042-009-0329-1

IF: 2.577

2009-01-01

Multimedia Tools and Applications

Abstract:Now more and more motion capture (MoCap) systems are used to acquire realistic and highly detailed motion data which are widely used for producing animations of human-like characters in a variety of applications, such as simulations, video games and animation films. And recently large MoCap databases are available. As a kind of emerging multimedia data, 3D human motion has its own specific data form and standard format. But to the best of our knowledge, only a few approaches have been explored for 3D MoCap data feature representation and reusing. This paper proposes a group of novel approaches for posture feature representation, motion sequence segmentation, key-frame extraction and content-based motion retrieval, which are all very important for MoCap data reusing and benefit to the efficient animation production. To validate these approaches, we set up a MoCap database and implemented a prototype toolkit. The experiments show that the proposed algorithms could achieve the approvable results.
Performance-Driven Motion Retrieval and its Usability Evaluation

Zhang Shun,Liang Xiubo,Li Qilei,Geng Weidong

2009-01-01

Journal of Computer-Aided Design & Computer Graphics

Abstract:With the increased amount of motion capture data,motion reuse plays a significant role in animation production,and motion retrieval in an intuitive and natural way is always preferred by animators. In this paper,we present a novel approach to retrieving motion with live performance. In the retrieval process,motion sensors are employed to capture the preformed movements as the query motion,and the matched motion clips are chosen by the classical DTW algorithm. A series of experiments are designed and conducted to evaluate its usability. The experimental results show that the retrieval scenario may allow the animators to intuitively locate the desired motion from the motion database and improves the user experience for content-based motion retrieval.
Intelligent Techniques for Processing and Management of Motion Data

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:Motion Capture (MoCap) systems are widely used in computer animations, simulations and video games. Recently, a large commercial MoCap database is available and it will be of great importance to the reusability of motion data as well as the efficiency of computer animations.
Motion retargeting based on physical constraint

Mei Jin,Liguo Zhang,Ju Jin,Guohui Yu,Huilian Liu

DOI: https://doi.org/10.3772/j.issn.10020470.2014.10.010

2014-01-01

Abstract:A study on the data reusability of motion capture, the most promising technology in character animation, was conducted, and a motion retargeting method based on physical constraint was proposed to improve the quality of the new motions created by using the captured data. The method adopts the technology of displacement mapping to set the target motion trajectory, and keeps original motion details. To guarantee the physical authenticity of character motions, it uses the UKF algorithm to solve nonlinear constraints. The experimental results demonstrate that the proposed method can create natural motions under the premise of keeping original motion characteristics to enhance the reusability of the captured motion data.
Natural Video-based Human Motion Capture

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:The ability to extract human motion data from video is very important in intelligent animation. Videos are abundant in our daily life and the cost to make videos is becoming lower. If the 2D/3D human motion data required for producing animations can be easily and rapidly extracted from existing videos, the cost will be reduced and the efficiency will be improved significantly.
Approach of Motion Capture Data Reuse

WU Ling-da,QU Shi,WEI Ying-mei,YU Rong-huan

DOI: https://doi.org/10.3969/j.issn.1000-1220.2012.11.042

2012-01-01

Abstract:Present a technique of human motion extension to reuse existing motion capture data,which contains lengthways extension and transverse extension.Lengthways extension extends motion along time axis,generating new motion containing more frames;transverse extension extends motion along characters,which generates group motion,similar but not same each other,from single motion.Both lengthways extension and transverse extension are based on dynamic model for motion which describes the changing rule of motion posture from the angle of probability.Motion extension can reuse existing motion capture data to make motion generation simpler and extend application range of existing motion capture data.Experiments show that our method can generate customized fames amount motion and group motion from existing motion.
Morphology Independent Motion Retrieval and Control

Nicolas Pronost,Franck Multon,Qilei Li,Weidong Geng,Richard Kulpa,Georges Dumont

DOI: https://doi.org/10.20870/ijvr.2009.8.4.2744

2009-01-01

International Journal of Virtual Reality

Abstract:This paper addresses the problem of selecting and adapting a motion in order to make a virtual human interact with a user in real-time. We describe a method that is able to retrieve the most appropriate motion in interactive environments where both the constraints and the character's morphology are not known in advance. The method described here is based on a morphology-independent representation of motion to perform fast motion retargetting and retrieval. Because the size of the database is not infinite, even the best candidate motion may not satisfy precisely all the imposed constraints. As a second step of the algorithm, the selected motion is locally adapted in order to accurately satisfy these constraints. This adaptation allows dealing with a large set of possible movements even if no candidate in the database exactly fits the constraints.
Several Methods of Smoothing Motion Capture Data

Jingjing Qi,Zhenjiang Miao,Zhifei Wang,Shujun Zhang

DOI: https://doi.org/10.1117/12.896512

2011-01-01

Abstract:Human motion capture and editing technologies are widely used in computer animation production. We can acquire original motion data by human motion capture system, and then process it by motion editing system. However, noise embed in original motion data maybe introduced by extracting the target, three-dimensional reconstruction process, optimizing algorithm and devices itself in human motion capture system. The motion data must be modified before used to make videos, otherwise the animation figures will be jerky and their behavior is unnatural. Therefore, motion smoothing is essential. In this paper, we compare and summarize three methods of smoothing original motion capture data.
From Keyframing to Motion Capture : The Evolution of Human Motion Synthesis

Lizhuang Ma,Yan Gao,Xiaomao Wu,Zhihua Chen

2005-01-01

Abstract:A survey is given for the techniques of human motion synthesis from the viewpoint of human computer interaction. The focus is on an overview based on the interaction of these animation systems between human and computer. To design a good interactive system, we concern the underlying structure of such a system more than the concrete interface that the system will adopt. Therefore, we first analyze the tasks of animators for designing a human motion synthesis system. After reviewing the evolution of the techniques of human motion synthesis, we try to reveal how such evolution improves interaction between human and computer. Finally, we demonstrate our motion synthesis system and give some suggestions for future research directions.
A Video-driven Approach to 3D Human Animation Synthesis

WANG Rong-rong,QIU Xian-jie,WANG Wen-zhong,WANG Zhao-qi

DOI: https://doi.org/10.3969/j.issn.1004-731x.2007.08.011

2007-01-01

Abstract:The generation of 3D human animation is a popular issue in the area of computer animation. Although the motion capture method can provide highly detailed motion data, it is too expensive and cumbersome for commercial use. A video-driven approach to 3D human animation with motion data was proposed. By building probability and statistical model of motion database, the spatio-temporal structure underlying the motion database is explored with the guidance of which 3D human animation that meets the content of video is synthesized. This method can make previous captured motion data reusable, thus reduce the cost of animation production greatly. The effectiveness of this method is verified by sport exercise video.
An Overview of 3D Human Motion Editing and Synthesis

王鑫,孙守迁,柴春雷

DOI: https://doi.org/10.11834/jig.20090208

2009-01-01

Journal of Image and Graphics

Abstract:We present a comprehensive survey on state of art of 3D human motion editing and synthesis techniques.Firstly,four types of methods for generating 3D human motion were introduced and compared.Secondly,techniques of motion capturing data representation,motion editing and motion synthesis were reviewed.Finally,some open problems and future directions were discussed.
Human Motion Capture Using Wireless Inertial Sensors

LI Qi-lei,JIN Wen-guang,GENG Wei-dong

DOI: https://doi.org/10.3785/j.issn.1008-973x.2012.02.016

2012-01-01

Abstract:Human motion capture is an important technology in the three-dimensional character animation production.Since the motion capture process is very expensive and complex,in this paper we introduce a new method that captures the human motion data from the inertial motion sensors attached to the user's limbs.The user wears multiple wireless inertial motion sensors with accelerometer and magnetometer,and the sensor data are sent to the computer using the wireless sensor network.Levenberg-Marquardt based optimization algorithm is applied to estimate the three-dimensional orientation of the inertial sensor and then bind the obtained orientation quaternion to the skeleton of the animation character.The root position of the animation character is modified inversely from the relative status of the supporting leg and the ground in order to make the walking motion more realistic.The experimental results show that our method can capture the user's motion effectively and produce accurate and realistic motion capture data.
From Keyframing To Motion Capture

Yan Gao,Lizhuang Ma,Xiaomao Wu,Zhihua Chen

DOI: https://doi.org/10.1007/1-4020-4043-1_4

2006-01-01

Abstract:A survey is given for human motion synthesis techniques from the viewpoint of human computer interaction. The focus is on an overview based on the interaction of animation systems between human and computer. To design a good interactive system, we concern the underlying structure of such a system more than the concrete interface that the system will adopt. Therefore, we first analyze the tasks of animators for designing a human motion synthesis system. After reviewing the evolution of human motion synthesis, we try to reveal how such evolution improves interaction between human and computer. Finally, we demonstrate our motion synthesis system and give some suggestions for future research directions.
Review of Techniques for Motion Capture Data Processing

Wei Xiaopeng,Liu Rul,and Zhang Qiang

DOI: https://doi.org/10.19583/j.1003-4951.2012.01.001

2012-01-01

Abstract:In order to high reality and efficiency, the technique computer animation. With the development of motion capture, a of motion capture （MoCap） has been widely used in the field of large amount of motion capture databases are available and this is significant for the reuse of motion data. But due to the high degree of freedoms and high capture frequency, the dimension of the mo- tion capture data is usually very high and this will lead to a low efficiency in data processing. So how to process the high dimension data and design an efficient and effective retrieval approach has become a challenge which we can＇t ignore. In this paper, first we lay out some problems about the key techniques in motion capture data processing. Then the existing approaches are analyzed and sum- marized. At last, some future work is proposed.
Space-Time Constraints Based Motion Editing and Motion Retargeting

罗忠祥,庄越挺,刘丰,潘云鹤

DOI: https://doi.org/10.3321/j.issn:1003-9775.2002.12.010

2002-01-01

Abstract:Motion capture is one of the most promising technologies in character animation in recent years. However, the available motion capture approaches usually suffer from expensive motion capture hardware and monotonous captured motion style. To enhance the reusability of the captured motion data and produce various character animations harmonious with complex scenes, motion edition and retargeting are prerequisite. A space-time constraints based motion editing and motion-retargeting method is presented. After specifying the space-time constraints and objective functions of intended motion, we get satisfactory motion gesticulation by approaches of inverse kinematics and numerical optimization. Experimental results demonstrate that by our method, it is convenient to produce realistic motions, which coordinate with different scenes and raise the reusability of existing captured motion data.

Intelligent Motion Data Reusing Techniques

Reuse of Motion Capture Data in Animation: A Review

Research on Technologies of Motion Capture Data Reuse

Learning a Deep Motion Interpolation Network for Human Skeleton Animations

Intelligent Techniques for Character Animation

Survey on Reuse of Human Motion Capture Data

A group of novel approaches and a toolkit for motion capture data reusing

Performance-Driven Motion Retrieval and its Usability Evaluation

Intelligent Techniques for Processing and Management of Motion Data

Motion retargeting based on physical constraint

Natural Video-based Human Motion Capture

Approach of Motion Capture Data Reuse

Morphology Independent Motion Retrieval and Control

Several Methods of Smoothing Motion Capture Data

From Keyframing to Motion Capture : The Evolution of Human Motion Synthesis

A Video-driven Approach to 3D Human Animation Synthesis

An Overview of 3D Human Motion Editing and Synthesis

Human Motion Capture Using Wireless Inertial Sensors

From Keyframing To Motion Capture

Review of Techniques for Motion Capture Data Processing

Space-Time Constraints Based Motion Editing and Motion Retargeting