Abstract:Recent advancements in human motion synthesis have focused on specific types of motions, such as human-scene interaction, locomotion or human-human interaction, however, there is a lack of a unified system capable of generating a diverse combination of motion types. In response, we introduce Sitcom-Crafter, a comprehensive and extendable system for human motion generation in 3D space, which can be guided by extensive plot contexts to enhance workflow efficiency for anime and game designers. The system is comprised of eight modules, three of which are dedicated to motion generation, while the remaining five are augmentation modules that ensure consistent fusion of motion sequences and system functionality. Central to the generation modules is our novel 3D scene-aware human-human interaction module, which addresses collision issues by synthesizing implicit 3D Signed Distance Function (SDF) points around motion spaces, thereby minimizing human-scene collisions without additional data collection costs. Complementing this, our locomotion and human-scene interaction modules leverage existing methods to enrich the system's motion generation capabilities. Augmentation modules encompass plot comprehension for command generation, motion synchronization for seamless integration of different motion types, hand pose retrieval to enhance motion realism, motion collision revision to prevent human collisions, and 3D retargeting to ensure visual fidelity. Experimental evaluations validate the system's ability to generate high-quality, diverse, and physically realistic motions, underscoring its potential for advancing creative workflows.

Human Motion Generation with Multifactor Models

TIMotion: Temporal and Interactive Framework for Efficient Human-Human Motion Generation

Motion Synthesis Using Style-Editable Inverse Kinematics

Automatic Generation of Human Animation Based on Motion Programming.

Morphology Independent Motion Retrieval and Control

Automatic Generation of Human Animation Based on Motion Programming: Virtual Humans and Social Agents

FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models

Learning Style-Directed Dynamics Of Human Motion For Automatic Motion Synthesis

CoMA: Compositional Human Motion Generation with Multi-modal Agents

A Stylistic Human Motion Editing System Based on A Subspace Motion Model

Morph: A Motion-free Physics Optimization Framework for Human Motion Generation

Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D Scenes

MMoFusion: Multi-modal Co-Speech Motion Generation with Diffusion Model

Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes

Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance

Everything2Motion: Synchronizing Diverse Inputs Via a Unified Framework for Human Motion Synthesis

Human Motion Generation: A Survey

Action2Motion: Conditioned Generation of 3D Human Motions

MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators

Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models