Abstract:Emotion is considered to be a core element in performances. In computer animation, both body motions and facial expressions are two popular mediums for a character to express the emotion. However, there has been limited research in studying how to effectively synthesize these two types of character movements using different levels of emotion strength with intuitive control, which is difficult to be modeled effectively. In this work, we explore a common model that can be used to represent the emotion for the applications of body motions and facial expressions synthesis. Unlike previous work that encode emotions into discrete motion style descriptors, we propose a continuous control indicator called emotion strength by controlling which a data‐driven approach is presented to synthesize motions with fine control over emotions. Rather than interpolating motion features to synthesize new motion as in existing work, our method explicitly learns a model mapping low‐level motion features to the emotion strength. Because the motion synthesis model is learned in the training stage, the computation time required for synthesizing motions at run time is very low. We further demonstrate the generality of our proposed framework by editing 2D face images using relative emotion strength. As a result, our method can be applied to interactive applications such as computer games, image editing tools, and virtual reality applications, as well as offline applications such as animation and movie production. Unlike previous work that encode emotions into discrete motion style descriptors, we propose a continuous control indicator called emotion strength by controlling which a data‐driven approach is presented to synthesize motions and edit images with fine control over emotions in this research. Our method explicitly learns a model mapping low‐level features to the emotion strength. We further demonstrate the generality of our proposed framework by editing 2D face images and 3D skeletal motion using relative emotion strength.

Emotion control of unstructured dance movements

A generic framework for editing and synthesizing multimodal data with relative emotion strength

Emotion Expression in Human Body Posture and Movement: A Survey on Intelligible Motion Factors, Quantification and Validation

EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning

Example-Based Automatic Music-Driven Conventional Dance Motion Synthesis

Affective Movement Generation using Laban Effort and Shape and Hidden Markov Models

Adaptive Body Gesture Representation for Automatic Emotion Recognition

Bodily expressed emotion understanding through integrating Laban movement analysis

EmoDescriptor: A hybrid feature for emotional classification in dance movements

Emotion capture based on body postures and movements

Motion Manipulation for Characters in Videos

Research on dance teaching methods based on emotion recognition and emotion analysis

EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation

Teaching Robots to Span the Space of Functional Expressive Motion

Estimating Emotional Intensity from Body Poses for Human-Robot Interaction

EMOKINE: A software package and computational framework for scaling up the creation of highly controlled emotional full-body movement datasets

Emotion Recognition From Full-Body Motion Using Multiscale Spatio-Temporal Network

Performance Robots—Motion Control and Dynamic Emotion Regulation in Public Spaces

Robotic Arm Trajectory Generation Based on Emotion and Kinematic Feature

Toward an Asian-based bodily movement database for emotional communication