Abstract:Character animation in real-world scenarios necessitates a variety of constraints, such as trajectories, key-frames, interactions, etc. Existing methodologies typically treat single or a finite set of these constraint(s) as separate control tasks. They are often specialized, and the tasks they address are rarely extendable or customizable. We categorize these as solutions to the close-set motion control problem. In response to the complexity of practical motion control, we propose and attempt to solve the open-set motion control problem. This problem is characterized by an open and fully customizable set of motion control tasks. To address this, we introduce a new paradigm, programmable motion generation. In this paradigm, any given motion control task is broken down into a combination of atomic constraints. These constraints are then programmed into an error function that quantifies the degree to which a motion sequence adheres to them. We utilize a pre-trained motion generation model and optimize its latent code to minimize the error function of the generated motion. Consequently, the generated motion not only inherits the prior of the generative model but also satisfies the required constraints. Experiments show that we can generate high-quality motions when addressing a wide range of unseen tasks. These tasks encompass motion control by motion dynamics, geometric constraints, physical laws, interactions with scenes, objects or the character own body parts, etc. All of these are achieved in a unified approach, without the need for ad-hoc paired training data collection or specialized network designs. During the programming of novel tasks, we observed the emergence of new skills beyond those of the prior model. With the assistance of large language models, we also achieved automatic programming. We hope that this work will pave the way for the motion control of general AI agents.

Classification of Motion Patterns for Robot Manipulators

Dynamic Modeling and Analysis for Coupling Processing 6-DOF 3 P3 R Manipulator

A GIM-based approach for biomimetic robot motion learning.

Motion Controller Design for a Biomimetic Robotic Fish

Type synthesis of parallel mechanism with 3T/3R motion patterns

The Modeling and Visual Control Simulation of Articulated Serpentine Manipulator

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Type synthesis and performance analysis of manipulators with shape adaptability

Pattern-based autonomous smooth switching control for constrained flexible joint manipulator

Moving Personal Robots in Real-Time Using Primitive Motions

Unified Formulation of Variable Structure Control Schemes for Robot Manipulators

A Classification of 6R Manipulators

Analysis of Dynamics Performance with Flexible Manipulator

Mobility Characteristics of a Flexure-based Compliant Manipulator with Three Legs

Type Synthesis of 2T1R Planar Parallel Mechanisms and Their Moduling Development Applications

Trajectory Planning and Control of Handling Robot Manipulator

Motion/Force Constrainability Analysis of Lower-Mobility Parallel Manipulators

Programmable Motion Generation for Open-Set Motion Control Tasks

Motion Characteristics of a Robotic Mechanism

Robot Variable Impedance Control and Generalizing from Human–Robot Interaction Demonstrations

Type Synthesis and Typical Application of 1T2r-Type Parallel Robotic Mechanisms