Abstract:We present a data-driven method for deformation capture and modeling of general soft objects. We adopt an iterative framework that consists of one component for physics-based deformation tracking and another for spacetime optimization of deformation parameters. Low cost depth sensors are used for the deformation capture, and we do not require any force-displacement measurements, thus making the data capture a cheap and convenient process. We augment a state-of-the-art probabilistic tracking method to robustly handle noise, occlusions, fast movements and large deformations. The spacetime optimization aims to match the simulated trajectories with the tracked ones. The optimized deformation model is then used to boost the accuracy of the tracking results, which can in turn improve the deformation parameter estimation itself in later iterations. Numerical experiments demonstrate that the tracking and parameter optimization components complement each other nicely. Our spacetime optimization of the deformation model includes not only the material elasticity parameters and dynamic damping coefficients, but also the reference shape which can differ significantly from the static shape for soft objects. The resulting optimization problem is highly nonlinear in high dimensions, and challenging to solve with previous methods. We propose a novel splitting algorithm that alternates between reference shape optimization and deformation parameter estimation, and thus enables tailoring the optimization of each subproblem more efficiently and robustly. Our system enables realistic motion reconstruction as well as synthesis of virtual soft objects in response to user stimulation. Validation experiments show that our method not only is accurate, but also compares favorably to existing techniques. We also showcase the ability of our system with high quality animations generated from optimized deformation parameters for a variety of soft objects, such as live plants and fabricated models.

A Detection-Driven and Sparsity-Constrained Deformable Model for Fascia Lata Labeling and Thigh Inter-Muscular Adipose Quantification

Accurate Thigh Inter-Muscular Adipose Quantification Using A Data-Driven And Sparsity-Constrained Deformable Model

Precise Few-shot Fat-free Thigh Muscle Segmentation in T1-weighted MRI

Deformable models with sparsity constraints for cardiac motion analysis

A Deformation Model to Reduce the Effect of Expressions in 3D Face Recognition

Integrating functional and structural images for simultaneous cardiac segmentation and deformation recovery.

Deep learning-based structure segmentation and intramuscular fat annotation on lumbar magnetic resonance imaging

A fast 2D shape recovery approach by fusing features and appearance.

Deep learning-based automatic pipeline for quantitative assessment of thigh muscle morphology and fatty infiltration

Temporal sparse free-form deformations

Statistical Shape Modeling of Compound Musculoskeletal Structures Around the Thigh Region

Deformable 3D Fusion: from Partial Dynamic 3D Observations to Complete 4D Models

Towards large-scale MR thigh image analysis via an integrated quantification framework.

An Efficient Muscle Segmentation Method Via Bayesian Fusion of Probabilistic Shape Modeling and Deep Edge Detection

An Elasticity-Based Region Model And Its Application To The Estimation Of The Heart Deformation In Tagged Mri

A hybrid statistical morphometry free-form deformation approach to 3D personalized foot-ankle models

Pixel-Level Deep Segmentation: Artificial Intelligence Quantifies Muscle on Computed Tomography for Body Morphometric Analysis

Modeling of Personalized Anatomy using Plastic Strains

Deep network and multi-atlas segmentation fusion for delineation of thigh muscle groups in three-dimensional water-fat separated MRI

Deformation capture and modeling of soft objects

Abdominal Wall Extraction Using Constrained Deformable Model and Abdominal Context.