Abstract:Digital human motion synthesis is a vibrant research field with applications in movies, AR/VR, and video games. Whereas methods were proposed to generate natural and realistic human motions, most only focus on modeling humans and largely ignore object movements. Generating task-oriented human-object interaction motions in simulation is challenging. For different intents of using the objects, humans conduct various motions, which requires the human first to approach the objects and then make them move consistently with the human instead of staying still. Also, to deploy in downstream applications, the synthesized motions are desired to be flexible in length, providing options to personalize the predicted motions for various purposes. To this end, we propose TOHO: Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations, which generates full human-object interaction motions to conduct specific tasks, given only the task type, the object, and a starting human status. TOHO generates human-object motions in three steps: 1) it first estimates the keyframe poses of conducting a task given the task type and object information; 2) then, it infills the keyframes and generates continuous motions; 3) finally, it applies a compact closed-form object motion estimation to generate the object motion. Our method generates continuous motions that are parameterized only by the temporal coordinate, which allows for upsampling or downsampling of the sequence to arbitrary frames and adjusting the motion speeds by designing the temporal coordinate vector. We demonstrate the effectiveness of our method, both qualitatively and quantitatively. This work takes a step further toward general human-scene interaction simulation.

Inferring Human Interaction from Motion Trajectories in Aerial Videos.

Perception of Human Interaction Based on Motion Trajectories: From Aerial Videos to Decontextualized Animations.

Inferring Object Properties from Human Interaction and Transferring Them to New Motions

Identifying critical kinematic features of animate motion and contribution to animacy perception

Inferring Forces And Learning Human Utilities From Videos

3D Intuitive Gesture Interaction via Motion Sensing

A Unified Psychological Space for Human Perception of Physical and Social Events

InterAct: Capture and Modelling of Realistic, Expressive and Interactive Activities between Two Persons in Daily Scenarios

Joint inference of groups, events and human roles in aerial videos

Learning Interactive Affordance for Human-Robot Interaction

Inferring Human Intent from Video by Sampling Hierarchical Plans

Interactive Humanoid: Online Full-Body Motion Reaction Synthesis with Social Affordance Canonicalization and Forecasting

Modeling and Inferring Human Intents and Latent Functional Objects for Trajectory Prediction

TIMotion: Temporal and Interactive Framework for Efficient Human-Human Motion Generation

Recognising human interaction from videos by a discriminative model

Critical Features of Joint Actions That Signal Human Interaction.

InterControl: Zero-shot Human Interaction Generation by Controlling Every Joint

Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations

InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction

Learning Social Affordance for Human-Robot Interaction

Automatic Human Scene Interaction through Contact Estimation and Motion Adaptation