Abstract:We present a data-driven framework for unsupervised human motion retargeting that animates a target subject with the motion of a source subject. Our method is correspondence-free, requiring neither spatial correspondences between the source and target shapes nor temporal correspondences between different frames of the source motion. This allows to animate a target shape with arbitrary sequences of humans in motion, possibly captured using 4D acquisition platforms or consumer devices. Our method unifies the advantages of two existing lines of work, namely skeletal motion retargeting, which leverages long-term temporal context, and surface-based retargeting, which preserves surface details, by combining a geometry-aware deformation model with a skeleton-aware motion transfer approach. This allows to take into account long-term temporal context while accounting for surface details. During inference, our method runs online, i.e. input can be processed in a serial way, and retargeting is performed in a single forward pass per frame. Experiments show that including long-term temporal context during training improves the method's accuracy for skeletal motion and detail preservation. Furthermore, our method generalizes to unobserved motions and body shapes. We demonstrate that our method achieves state-of-the-art results on two test datasets and that it can be used to animate human models with the output of a multi-view acquisition platform. Code is available at \url{<a class="link-external link-https" href="https://gitlab.inria.fr/rrekikdi/human-motion-retargeting2023" rel="external noopener nofollow">this https URL</a>}.

Robust Real-Time Motion Retargeting Via Neural Latent Prediction

Frame-by-frame Motion Retargeting with Self-Collision Avoidance from Diverse Human Demonstrations

Human-Robot Sign Language Motion Retargeting from Videos

Dynamic Movement Primitive Based Motion Retargeting for Dual-Arm Sign Language Motions

ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Space

Neural Motion Prediction for In-flight Uneven Object Catching

Kinematic Motion Retargeting via Neural Latent Optimization for Learning Sign Language

Motion Imitation of a Humanoid Robot Via Pose Estimation

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

Planning Coordinated Human-Robot Motions with Neural Network Full-Body Prediction Models

Enhanced Human-Robot Collaboration using Constrained Probabilistic Human-Motion Prediction

Neural Kinematic Networks for Unsupervised Motion Retargetting

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometry

Spatio-Temporal Motion Retargeting for Quadruped Robots

Self-Supervised Motion Retargeting with Safety Guarantee

ACE: Adversarial Correspondence Embedding for Cross Morphology Motion Retargeting from Human to Nonhuman Characters

Fast human motion prediction for human-robot collaboration with wearable interfaces

Correspondence-free online human motion retargeting

Pose-Aware Attention Network for Flexible Motion Retargeting by Body Part