Abstract:Robotic manipulation of deformable linear objects (DLOs) has broad application prospects in many fields. However, a key issue is to obtain the exact deformation models (i.e., how robot motion affects DLO deformation), which are hard to theoretically calculate and vary among different DLOs. Thus, shape control of DLOs is challenging, especially for large deformation control which requires global and more accurate models. In this paper, we propose a coupled offline and online data-driven method for efficiently learning a global deformation model, allowing for both accurate modeling through offline learning and further updating for new DLOs via online adaptation. Specifically, the model approximated by a neural network is first trained offline on random data, then seamlessly migrated to the online phase, and further updated online during actual manipulation. Several strategies are introduced to improve the model's efficiency and generalization ability. We propose a convex-optimization-based controller, and analyze the system's stability using the Lyapunov method. Detailed simulations and real-world experiments demonstrate that our method can efficiently and precisely estimate the deformation model, and achieve large deformation control of untrained DLOs in 2D and 3D dual-arm manipulation tasks better than the existing methods. It accomplishes all 24 tasks with different desired shapes on different DLOs in the real world, using only simulation data for the offline learning.

Visually servoed deformation control by robot manipulators

Model-Free Visually Servoed Deformation Control of Elastic Objects by Robot Manipulators

On the visual deformation servoing of compliant objects: Uncalibrated control methods and experiments

Model-Based Nonlinear Control of the Dielectric Elastomer Actuator with High Robustness and Precision

Learning-based Feedback Controller for Deformable Object Manipulation

Automatic 3-D Manipulation of Soft Objects by Robotic Arms with an Adaptive Deformation Model.

Adaptive Shape Servoing of Elastic Rods using Parameterized Regression Features and Auto-Tuning Motion Controls

Hand-eye Robotic Visual Servoing Around Moving Objects Using Active Deformable Models

Deformation Control of a Deformable Object Based on Visual and Tactile Feedback

Contour Moments Based Manipulation of Composite Rigid-Deformable Objects with Finite Time Model Estimation and Shape/Position Control

A Unified Controller for Region-reaching and Deforming of Soft Objects.

Optimal Cosserat-based deformation control for robotic manipulation of linear objects

Shape Control of Elastic Objects Based on Implicit Sensorimotor Models and Data-Driven Geometric Features

Visual Servoing of Soft Robot Manipulator in Constrained Environments with an Adaptive Controller

Visual Tracking Control of Deformable Objects With a FAT-Based Controller

Visual Servo Kinematic Control For Robotic Manipulators

Robust Model-Predictive Deformation Control of a Soft Object by Using a Flexible Continuum Robot

Global Model Learning for Large Deformation Control of Elastic Deformable Linear Objects: An Efficient and Adaptive Approach

Active Manipulation of Elastic Rods Using Optimization-based Shape Perception and Sensorimotor Model Approximation

Hybrid Vision/Force Control of Soft Robot Based on a Deformation Model

Kinematic-Free Position Control for A Deformable Manipulator