Abstract:We present a data-driven method for deformation capture and modeling of general soft objects. We adopt an iterative framework that consists of one component for physics-based deformation tracking and another for spacetime optimization of deformation parameters. Low cost depth sensors are used for the deformation capture, and we do not require any force-displacement measurements, thus making the data capture a cheap and convenient process. We augment a state-of-the-art probabilistic tracking method to robustly handle noise, occlusions, fast movements and large deformations. The spacetime optimization aims to match the simulated trajectories with the tracked ones. The optimized deformation model is then used to boost the accuracy of the tracking results, which can in turn improve the deformation parameter estimation itself in later iterations. Numerical experiments demonstrate that the tracking and parameter optimization components complement each other nicely. Our spacetime optimization of the deformation model includes not only the material elasticity parameters and dynamic damping coefficients, but also the reference shape which can differ significantly from the static shape for soft objects. The resulting optimization problem is highly nonlinear in high dimensions, and challenging to solve with previous methods. We propose a novel splitting algorithm that alternates between reference shape optimization and deformation parameter estimation, and thus enables tailoring the optimization of each subproblem more efficiently and robustly. Our system enables realistic motion reconstruction as well as synthesis of virtual soft objects in response to user stimulation. Validation experiments show that our method not only is accurate, but also compares favorably to existing techniques. We also showcase the ability of our system with high quality animations generated from optimized deformation parameters for a variety of soft objects, such as live plants and fabricated models.

Real-time Deformation with Coupled Cages and Skeletons

Real-time Skeletonization for Sketch-Based Modeling

Mesh Deformation Transfer Based on Mean-Value Skeleton

Adaptive Skeleton-Driven Cages for Mesh Sequences

Cage-based Deformation Transfer

Linear Mesh Deformation With Snake Constraint

A Survey on Cage‐based Deformation of 3D Models

Realtime Planar Shape Deformation

Mesh Deformation with Hierarchical B-Splines

Clustering Method for Fast Deformation with Constraints

A Framework for Real-time Local Free-Form Deformation

Fast and Physical Plausible Elastic-Deformation Driven by Skeleton

Example-based Dynamic Skinning in Real Time

Multiresolution space deformation controlled by subdivision surface

Mesh Puppetry

Efficient Mesh Deformation Using Tetrahedron Control Mesh

Deformation method based on control meshes

EC-CageR

Deformation capture and modeling of soft objects

A functional skeleton transfer

Detail-preserving controllable deformation from sparse examples