Intelligent Techniques for Character Animation

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:Motion capture based animation has become one of the most promising areas in computer animation. But the motion capture equipment is expensive. To be able to reuse the data and make new movements, we need to modify or edit the motion capture data before retargeting it to animated characters.

What problem does this paper attempt to address?

Intelligent Motion Data Reusing Techniques

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:In order to reuse the existing 3D human motion data to create animation and improve the efficiency of animation creation, the motion reusing technique is becoming a hotspot in research. Generally, the motion reusing includes motion editing, motion synthesis and motion retargeting, etc.
Intelligent Techniques for Processing and Management of Motion Data

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:Motion Capture (MoCap) systems are widely used in computer animations, simulations and video games. Recently, a large commercial MoCap database is available and it will be of great importance to the reusability of motion data as well as the efficiency of computer animations.
Multiple Animated Characters Motion Fusion

ZX Luo,YT Zhuang,F Liu,YH Pan

DOI: https://doi.org/10.1002/vis.298

2002-01-01

Abstract:One of the major problems of the motion capture-based computer animation technique is the relatively high cost of equipment and low reuse rate of data. To overcome this problem, many motion-editing methods have been developed. However, most of them can only handle one character whose motions are preset, and hence cannot interact with its environment automatically. In this paper, we construct a new architecture of multiple animated character motion fusion, which not only enables the characters to perceive and respond to the virtual environment, but also allows them to interact with each other. We will also discuss in detail the key issues, such as motion planning, coordination of multiple animated characters and generation of vivid continuous motions. Our experimental results will further testify to the effectiveness of the new methodology. Copyright (C) 2002 John Wiley Sons, Ltd.
Space-Time Constraints Based Motion Editing and Motion Retargeting

罗忠祥,庄越挺,刘丰,潘云鹤

DOI: https://doi.org/10.3321/j.issn:1003-9775.2002.12.010

2002-01-01

Abstract:Motion capture is one of the most promising technologies in character animation in recent years. However, the available motion capture approaches usually suffer from expensive motion capture hardware and monotonous captured motion style. To enhance the reusability of the captured motion data and produce various character animations harmonious with complex scenes, motion edition and retargeting are prerequisite. A space-time constraints based motion editing and motion-retargeting method is presented. After specifying the space-time constraints and objective functions of intended motion, we get satisfactory motion gesticulation by approaches of inverse kinematics and numerical optimization. Experimental results demonstrate that by our method, it is convenient to produce realistic motions, which coordinate with different scenes and raise the reusability of existing captured motion data.
Motion Processing in Tight-Clothing Based Motion Capture

Ke Zheng,Qiang Zhu,Yueting Zhuang,Yuehe Pan

2001-01-01

Abstract:Human animation is a challenging domain in computer animation. To aim at any shortcomings of conventional techniques, we propose a new tight-clothing based motion capture technique that is able to recover high-qualified human motion information. In the video based human animation system, given a clip of video of the model dressed in tight-clothing, we can track human joints with the support of the extraction of boundary algorithm based on Robert operator and clustering algorithm based on self-adaptation in the image sequence. Then corresponding sequence of 3D human motion skeleton is constructed, turning into standard motion information. Moreover, after editing and filtering the raw motion, we are able to retarget the motion to new character. This approach has the characteristic of rich source material, low computing cost, efficient production, and creative animation result. We demonstrate this on …
Character Animation and Retargeting from Video Streams

Gongbin Chen,Lei Wang,Xun-Yu Liu,Long-Hua Hu,Jun Cheng

DOI: https://doi.org/10.1109/smc53654.2022.9945115

2022-01-01

Abstract:Virtual character animation is widely used in 3D games and virtual reality. Traditional character animation can be achieved through key-frame animation or motion capture technology. These methods have limited applications due to expensive equipments or sophisticated operations. Aiming at a lower-cost solution for this issue, in this paper we propose a method of virtual character animations and retargeting from RGB video streams based on human pose reconstruction. We conduct extensive experiments with different videos and virtual characters, and the resulting character animation is well represented in the virtual scene. The proposed method greatly has reduced the production cost of character animation, which has potential applications in virtual reality.
Human Motion Capture Using Wireless Inertial Sensors

LI Qi-lei,JIN Wen-guang,GENG Wei-dong

DOI: https://doi.org/10.3785/j.issn.1008-973x.2012.02.016

2012-01-01

Abstract:Human motion capture is an important technology in the three-dimensional character animation production.Since the motion capture process is very expensive and complex,in this paper we introduce a new method that captures the human motion data from the inertial motion sensors attached to the user's limbs.The user wears multiple wireless inertial motion sensors with accelerometer and magnetometer,and the sensor data are sent to the computer using the wireless sensor network.Levenberg-Marquardt based optimization algorithm is applied to estimate the three-dimensional orientation of the inertial sensor and then bind the obtained orientation quaternion to the skeleton of the animation character.The root position of the animation character is modified inversely from the relative status of the supporting leg and the ground in order to make the walking motion more realistic.The experimental results show that our method can capture the user's motion effectively and produce accurate and realistic motion capture data.
Reuse of Motion Capture Data in Animation: A Review

Weidong Geng,Gino Yu

DOI: https://doi.org/10.1007/3-540-44842-X_63

2003-01-01

Abstract:The reuse of motion capture data is receiving increasing attention in computer animation. This interest is motivated by a wide spectrum of time-critical applications, such as video game development and animation production. This paper gives an overview of various tasks and techniques involved in the reuse of motion capture data in terms of motion authoring pipeline. We assume that whenever the user is asked to build motions, he/she will at first go to retrieve/browse the pre-recorded motions in the motion database, look for the best-fit candidate motion segments/pieces/clips, and manage to adapt them to fit the specified requirements. The two core issues in motion reuse, motion adaptation techniques and motion library construction, are the focus of this review.
Natural Video-based Human Motion Capture

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:The ability to extract human motion data from video is very important in intelligent animation. Videos are abundant in our daily life and the cost to make videos is becoming lower. If the 2D/3D human motion data required for producing animations can be easily and rapidly extracted from existing videos, the cost will be reduced and the efficiency will be improved significantly.
Real Time Falling Animation with Active and Protective Responses

Zhigeng Pan,Xi Cheng,Wenzhi Chen,Gengdai Liu,Bing Tang

DOI: https://doi.org/10.1007/s00371-009-0321-9

IF: 2.835

2009-01-01

The Visual Computer

Abstract:Combined with motion capture and dynamic simulation, characters in animation have realistic motion details and can respond to unexpected contact forces. This paper proposes a novel and real-time character motion generation approach which introduces a parallel process, and uses an approximate nearest neighbor optimization search method. Besides, we employ a support vector machine (SVM), which is trained on a set of samples and predicts a subset of our ‘return-to’ motion capture (mocap) database in order to reduce the search time. In the dynamic simulation process, we focus on designing a biomechanics based controller which detects the balance of the characters in locomotion and drives them to take several active and protective responses when they fall to the ground in order to reduce the injuries to their bodies. Finally, we show the time costs in synthesis and the visual results of our approach. The experimental results indicate that our motion generation approach is suitable for interactive games or other real-time applications.
Deep-Learning-Based Motion Capture Technology in Film and Television Animation Production

Yating Wei

DOI: https://doi.org/10.1155/2022/6040371

IF: 1.968

2022-02-11

Security and Communication Networks

Abstract:With the popularity of King Kong, Pirates of the Caribbean 2, Avatar, and other films, the virtual characters in these films have become popular and well loved by audiences. The creation of these virtual characters is different from traditional 3D animation but is based on real character movements and expressions. An overview of several mainstream motion capture systems in the field of motion capture is presented, and the application of motion capture technology in film and animation is explained in detail. The current motion capture technology is mainly based on complex human markers and sensors, which are costly, while deep-learning-based human pose estimation is becoming a new option. However, most existing methods are based on a single person or picture estimation, and there are many challenges for video multiperson estimation. The experimental results show that a simple design of the human motion capture system is achieved.

computer science, information systems,telecommunications
A Modern Approach To Intelligent Animation Theory And Practice Introduction

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:Part of the new series, Advanced Topics in Science and Technology in China, this book discusses concepts, theory, and core technologies of intelligent theory and human animation, including video based human animation, and intelligent technology of motion data management and reusing. It introduces systems developed to demonstrate the technologies of video based animation. Each chapter is independent. Lively pictures and demos will be presented to make the theory and technologies more understandable. For researchers, this is a reference book and an update on the current status of human animation. For professionals, this is a guide for application development using human animation technologies. Yueting Zhuang received his PhD in Computer Science from Zhejiang University (1998). From 1997 to 1998, he was a visiting scholar at Beckman Institute, U. of Illinois, Urbana-Champaign. Now he is a full professor of the College of Computer Science at Zhejiang University. His research area is intelligent animation, multimedia technologies. Yunhe Pan was the President of Zhejiang University from 1995 to 2006. Now he is the Vice-President of the Chinese Academy of Engineering. His current research area includes intelligent human animation, digital library, and other related topics.
Performance-Driven Two-Dimensional Vector Expression Animation

Wang Xiangyu,Xiao Jun,Pan Hong

DOI: https://doi.org/10.3969/j.issn.1003-9775.2012.05.005

2012-01-01

Journal of Computer-Aided Design & Computer Graphics

Abstract:To produce vivid expression animation quickly and conveniently,we present a new algorithm to retarget the motion capture data onto the cartoon face.The algorithm allows users mark the cartoon face with the same topology as the expression data,and compares the first frame of the expression data with the marked control points.The resulting ratio is used to retarget the rest of the expression data onto the cartoon face,yielding the right expression data.The experimental results show that our approach is practical to generate vivid expression animation.
Interactive Animation of Virtual Characters: Application to Virtual Kung-Fu Fighting

Nicolas Pronost,Franck Multon,Qilei Li,Weidong Geng,Richard Kulpa,Georges Dumont

DOI: https://doi.org/10.1109/cw.2008.33

2008-01-01

Abstract:This paper aims at proposing a framework for animating virtual humans that can efficiently interact with real users in virtual reality (VR). If the user's order can be modeled as targets and commands, the system searches a database for the most convenient behavior. In order to avoid using a huge database that can deal with any kind of situation, we propose to associate this searching process to an adaptation module. Hence, even if the selected motion is not perfectly suited with the situation, it can be adapted in order to reach accurately the target specified by the user. This framework is illustrated with a kung-fu fighter example. Two people are involved in this example: the user and the supervisor. The user is displacing in the real environment while the position of his head is tracked in real-time thanks to reflective markers. The virtual opponent follows the displacement of the user to stay close to him. At any time, the supervisor can ask the virtual character to kick or punch the user. Our system automatically searches for the convenient motion in an average-size database (75 motions compared to hundreds of motions required for motion graphs) and adapts it to the current situation.
A Motion Retargeting Algorithm Based on Model Simplification

Guihai Chen,Zhihua,Siwei Ma,Li-zhuang,Kan Wu,Xiao-mao,Peng Gao,Victoria C. Yan

2005-01-01

Abstract:A new motion retargeting algorithm is presented, which adapts the motion capture data to a new character. To make the resulting motion realistic, the physically-based optimization method is adopted. However, the optimization process is difficult to converge to the optimal value because of high complexity of the physical human model. In order to address this problem, an appropriate simplified model automatically determined by a motion analysis technique is utilized, and then motion retargeting with this simplified model as an intermediate agent is implemented. The entire motion retargeting algorithm involves three steps of nonlinearly constrained optimization: forward retargeting, motion scaling and inverse retargeting. Experimental results show the validity of this algorithm.
Research on 2D Animation Simulation Based on Artificial Intelligence and Biomechanical Modeling

Zhiyong Li,Fangming Dai

DOI: https://doi.org/10.4108/eetpht.10.5907

2024-05-24

EAI Endorsed Transactions on Pervasive Health and Technology

Abstract:Animation techniques have been completely transformed by the union of Artificial Intelligence (AI) and biomechanical modeling, particularly in 2D animation. This study looks at a combination of AI and biomechanics to address the challenges of simulating 2D animation. Current approaches in 2D animation often struggle to achieve lifelike and fluid movements, especially when representing complex motion or interaction. These traditional techniques rely on manual keyframing or physics simulation, which may be time-consuming and do not provide the rich detail needed for realism in animations. To meet these aspects, this study suggested 2D animation using Artificial Intelligence with Biomechanical Modeling (2D-AI-BM). Our approach thus harnesses Deep Neural Network (DNN) for moving forecasts and improvement using biopsychological principles to help us imitate natural human actions better. In addition to character animation, it could apply to interactive storytelling and educational simulations. As a result, animators get more control over motion generation while drastically reducing the necessity for manual intervention through this fusion of AI and biomechanics, which smoothens the production pipeline for animations. This paper considers several important metrics to evaluate the proposed approach's effectiveness, including user satisfaction, computational efficiency, motion smoothness and realism. Comparative studies with classical animation methods showed that the method generates realistic movements on 2D characters while saving time during production. The numerical findings exemplify that the recommended 2D-AI-BM model improves an accuracy rate of 97.4%, computational efficiency ratio of 96.3%, motion control ratio of 95.4%, pose detection ratio of 94.8% and scalability ratio of 93.2% compared to other popular techniques.
An Interactive Motion-Editing Method for Human Animation.

Mofei Song,Yaoye Zhang,Zhengxing Sun

DOI: https://doi.org/10.1504/ijcat.2010.034156

2010-01-01

Abstract:This paper presents an interactive motion-editing method for human animation. Through sketches, users are able to create a 3D skeleton model without any constraints. Then motion retargeting is used to adapt the original motion to the model obtained from the sketches. For supporting expression of intention, our method provides users with direct manipulation of the key parts of the model and uses inverse kinematics to update the gesture. Finally, a new motion is created by smoothly propagating the motion displacement to neighbour frames by linear interpolation. Experimental results prove the effectiveness of the proposed method.
Realization of interactive animation creation based on artificial intelligence technology

YuXin Cai,Haibin Dong,Wei Wang,Hongchang Song

DOI: https://doi.org/10.1111/coin.12443

2021-06-21

Computational Intelligence

Abstract:In film and television animation works, animated characters are the soul and core of the work. The behavior, language expression, and emotional expression of animated characters play an important role in the expression of the animation theme and content. Aiming at the problem that the mobile animation system can only add and change actions for a single virtual character, and the characters cannot interact with each other, this paper analyzes the technical principles, technical characteristics, and application scope of human–computer interaction (HCI), taking sensors as the research object. An algorithm for separating the human body from the background environment in the depth image is proposed. Through the calculation of the depth value, the calculation results are compared, and the target human body and the background are effectively separated. In the depth data processing, the algorithm of judging the pixel offset value is used to identify the body part, and a sensor-based HCI system is designed. The depth-of-field data map acquired by the sensor is used to identify human body parts and determine actions, thereby realizing HCI based on action recognition. Simulation test results show that the effective rate of the system is 80%, and the design of animated characters can be put into the visualization stage. Using the algorithm in this paper, the physical signs of the animated characters can be quickly identified, so that the next action of the animation can be more clearly captured. Has a certain practical value.

computer science, artificial intelligence
Video-based Facial Animation Techniques

Yueting Zhuang,Yunhe Pan,Jun Xiao

2008-01-01

Abstract:Facial expression creation is an indispensable part of human animation. As a special branch of computer graphics and image processing, facial expression synthesis has been an attractive topic for over 30 years and has appeared in many applications, e.g., complex human-computer-interface, interactive game, multimedia teaching, remote experience of virtual reality, and computer animation. Facial animation techniques have evolved from traditional key-frame technique to current techniques of image warping, video-based animation, physics-based animation and behavior animation. Related research domain includes computer graphics, artificial intelligence and machine learning. The requirement of generating high quality facial animation is more and more urgent. The traditional literalness and rigid facial animation cannot satisfy people’s need, thus it is necessary to develop high-quality and high …
Virtual Character Animation Based on Affordable Motion Capture and Reconfigurable Tangible Interfaces

Fabrizio Lamberti,Gianluca Paravati,Valentina Gatteschi,Alberto Cannavo,Paolo Montuschi

DOI: https://doi.org/10.1109/TVCG.2017.2690433

Abstract:Software for computer animation is generally characterized by a steep learning curve, due to the entanglement of both sophisticated techniques and interaction methods required to control 3D geometries. This paper proposes a tool designed to support computer animation production processes by leveraging the affordances offered by articulated tangible user interfaces and motion capture retargeting solutions. To this aim, orientations of an instrumented prop are recorded together with animator's motion in the 3D space and used to quickly pose characters in the virtual environment. High-level functionalities of the animation software are made accessible via a speech interface, thus letting the user control the animation pipeline via voice commands while focusing on his or her hands and body motion. The proposed solution exploits both off-the-shelf hardware components (like the Lego Mindstorms EV3 bricks and the Microsoft Kinect, used for building the tangible device and tracking animator's skeleton) and free open-source software (like the Blender animation tool), thus representing an interesting solution also for beginners approaching the world of digital animation for the first time. Experimental results in different usage scenarios show the benefits offered by the designed interaction strategy with respect to a mouse & keyboard-based interface both for expert and non-expert users.

Intelligent Techniques for Character Animation

Intelligent Motion Data Reusing Techniques

Intelligent Techniques for Processing and Management of Motion Data

Multiple Animated Characters Motion Fusion

Space-Time Constraints Based Motion Editing and Motion Retargeting

Motion Processing in Tight-Clothing Based Motion Capture

Character Animation and Retargeting from Video Streams

Human Motion Capture Using Wireless Inertial Sensors

Reuse of Motion Capture Data in Animation: A Review

Natural Video-based Human Motion Capture

Real Time Falling Animation with Active and Protective Responses

Deep-Learning-Based Motion Capture Technology in Film and Television Animation Production

A Modern Approach To Intelligent Animation Theory And Practice Introduction

Performance-Driven Two-Dimensional Vector Expression Animation

Interactive Animation of Virtual Characters: Application to Virtual Kung-Fu Fighting

A Motion Retargeting Algorithm Based on Model Simplification

Research on 2D Animation Simulation Based on Artificial Intelligence and Biomechanical Modeling

An Interactive Motion-Editing Method for Human Animation.

Realization of interactive animation creation based on artificial intelligence technology

Video-based Facial Animation Techniques

Virtual Character Animation Based on Affordable Motion Capture and Reconfigurable Tangible Interfaces