Abstract:We present a data-driven method for deformation capture and modeling of general soft objects. We adopt an iterative framework that consists of one component for physics-based deformation tracking and another for spacetime optimization of deformation parameters. Low cost depth sensors are used for the deformation capture, and we do not require any force-displacement measurements, thus making the data capture a cheap and convenient process. We augment a state-of-the-art probabilistic tracking method to robustly handle noise, occlusions, fast movements and large deformations. The spacetime optimization aims to match the simulated trajectories with the tracked ones. The optimized deformation model is then used to boost the accuracy of the tracking results, which can in turn improve the deformation parameter estimation itself in later iterations. Numerical experiments demonstrate that the tracking and parameter optimization components complement each other nicely. Our spacetime optimization of the deformation model includes not only the material elasticity parameters and dynamic damping coefficients, but also the reference shape which can differ significantly from the static shape for soft objects. The resulting optimization problem is highly nonlinear in high dimensions, and challenging to solve with previous methods. We propose a novel splitting algorithm that alternates between reference shape optimization and deformation parameter estimation, and thus enables tailoring the optimization of each subproblem more efficiently and robustly. Our system enables realistic motion reconstruction as well as synthesis of virtual soft objects in response to user stimulation. Validation experiments show that our method not only is accurate, but also compares favorably to existing techniques. We also showcase the ability of our system with high quality animations generated from optimized deformation parameters for a variety of soft objects, such as live plants and fabricated models.

Visual Tracking Control of Deformable Objects With a FAT-Based Controller

Variable Force Tracking Control Via Online Learning

Model-Free 3-D Shape Control of Deformable Objects Using Novel Features Based on Modal Analysis

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Visually servoed deformation control by robot manipulators

Robust Tracking Control of Robot Manipulators with Actuator Faults and Joint Velocity Measurement Uncertainty

Global Model Learning for Large Deformation Control of Elastic Deformable Linear Objects: An Efficient and Adaptive Approach

Active Manipulation of Elastic Rods Using Optimization-based Shape Perception and Sensorimotor Model Approximation

Contour Moments Based Manipulation of Composite Rigid-Deformable Objects with Finite Time Model Estimation and Shape/Position Control

Model-Free Visually Servoed Deformation Control of Elastic Objects by Robot Manipulators

Immersion and Invariance Adaptive Tracking Control for Robot Manipulators with a Novel Modified Scaling Factor Design

Deformation Control of a Deformable Object Based on Visual and Tactile Feedback

Kinematic-Free Position Control for A Deformable Manipulator

A Unified Controller for Region-reaching and Deforming of Soft Objects.

Regressor-Based Model Adaptation for Shaping Deformable Linear Objects with Force Control

Shape Control of Elastic Objects Based on Implicit Sensorimotor Models and Data-Driven Geometric Features

Automatic 3-D Manipulation of Soft Objects by Robotic Arms with an Adaptive Deformation Model.

Hybrid Vision/Force Control of Soft Robot Based on a Deformation Model

Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera

Deformation capture and modeling of soft objects

Real-Time Deformable-Contact-Aware Model Predictive Control for Force-Modulated Manipulation