Abstract:We present a data-driven method for deformation capture and modeling of general soft objects. We adopt an iterative framework that consists of one component for physics-based deformation tracking and another for spacetime optimization of deformation parameters. Low cost depth sensors are used for the deformation capture, and we do not require any force-displacement measurements, thus making the data capture a cheap and convenient process. We augment a state-of-the-art probabilistic tracking method to robustly handle noise, occlusions, fast movements and large deformations. The spacetime optimization aims to match the simulated trajectories with the tracked ones. The optimized deformation model is then used to boost the accuracy of the tracking results, which can in turn improve the deformation parameter estimation itself in later iterations. Numerical experiments demonstrate that the tracking and parameter optimization components complement each other nicely. Our spacetime optimization of the deformation model includes not only the material elasticity parameters and dynamic damping coefficients, but also the reference shape which can differ significantly from the static shape for soft objects. The resulting optimization problem is highly nonlinear in high dimensions, and challenging to solve with previous methods. We propose a novel splitting algorithm that alternates between reference shape optimization and deformation parameter estimation, and thus enables tailoring the optimization of each subproblem more efficiently and robustly. Our system enables realistic motion reconstruction as well as synthesis of virtual soft objects in response to user stimulation. Validation experiments show that our method not only is accurate, but also compares favorably to existing techniques. We also showcase the ability of our system with high quality animations generated from optimized deformation parameters for a variety of soft objects, such as live plants and fabricated models.

A quick physics-based deformation model and real-time force reflection algorithm

Fast Corotational Simulation for Example-Driven Deformation.

An improved method for soft tissue modeling

Fast and Physical Plausible Elastic-Deformation Driven by Skeleton

Deformation capture and modeling of soft objects

Research of Human Head Deformable Model

A Survey on Fast Simulation of Elastic Objects

A Surface Mass-Spring Model With New Flexion Springs and Collision Detection Algorithms Based on Volume Structure for Real-Time Soft-Tissue Deformation Interaction

A new soft tissue deformation model based on Runge-Kutta: Application in lung

Efficient Simulation of Deformable Particles

Interactive Haptic Deformation of Dynamic Soft Objects

Clustering Method for Fast Deformation with Constraints

Simulation of soft tissue using mass-spring model with simulated annealing optimization

An Efficient Large Deformation Method Using Domain Decomposition

A Framework for Real-time Local Free-Form Deformation

Physics-Based Quadratic Deformation Using Elastic Weighting

An approximate image-space approach for real-time rendering of deformable translucent objects

Scalable Real-Time Vehicle Deformation for Interactive Environments

Real-time Deformation of Soft Tissue Internal Structure with Surface Profile Variations using Particle System

Medial Elastics: Efficient and Collision-Ready Deformation via Medial Axis Transform

Visualization Simulation Technology of Cloth Deformation Based on Mass-Spring Model and Its Prospect