Abstract:Constrained environments are common in practical applications of manipulating deformable linear objects (DLOs), where movements of both DLOs and robots should be constrained. This task is high-dimensional and highly constrained owing to the highly deformable DLOs, dual-arm robots with high degrees of freedom, and 3-D complex environments, which render global planning challenging. Furthermore, accurate DLO models needed by planning are often unavailable owing to their strong nonlinearity and diversity, resulting in unreliable planned paths. This article focuses on the global moving and shaping of DLOs in constrained environments by dual-arm robots. The main objectives are 1) to efficiently and accurately accomplish this task, and 2) to achieve generalizable and robust manipulation of various DLOs. To this end, we propose a complementary framework with whole-body planning and control using appropriate DLO model representations. First, a global planner is proposed to efficiently find feasible solutions based on a simplified DLO energy model, which considers the full system states and all constraints to plan more reliable paths. Then, a closed-loop manipulation scheme is proposed to compensate for the modeling errors and enhance the robustness and accuracy, which incorporates a model predictive controller that real-time adjusts the robot motion based on an adaptive DLO motion model. The key novelty is that our framework can efficiently solve the high-dimensional problem subject to multiple constraints and generalize to various DLOs without elaborate model identifications. Experiments demonstrate that our framework can accomplish considerably more complicated tasks than existing works, with significantly higher efficiency, generalizability, and reliability.

Multidimensional Deformable Object Manipulation Based on DN-Transporter Networks

Dense-Descriptor Transporter Networks for Multidimensional Deformable Object Manipulation

Learning to Rearrange Deformable Cables, Fabrics, and Bags with Goal-Conditioned Transporter Networks

COMBINATION OF AFFINE DEFORMATION AND DYNAMIC MOVEMENT PRIMITIVE IN LEARNING HUMAN MOTION FOR REDUNDANT MANIPULATOR

Learning Latent Dynamics for Autonomous Shape Control of Deformable Object

DeformerNet: Learning Bimanual Manipulation of 3D Deformable Objects

Bimanual Deformable Bag Manipulation Using a Structure-of-Interest Based Neural Dynamics Model

DeRi-Bot: Learning to Collaboratively Manipulate Rigid Objects via Deformable Objects

Learning Language-Conditioned Deformable Object Manipulation with Graph Dynamics

Graph-Transporter: A Graph-based Learning Method for Goal-Conditioned Deformable Object Rearranging Task

DeformNet: Latent Space Modeling and Dynamics Prediction for Deformable Object Manipulation

DeRi-IGP: Learning to Manipulate Rigid Objects Using Deformable Objects via Iterative Grasp-Pull

Sim2Real Neural Controllers for Physics-based Robotic Deployment of Deformable Linear Objects

GenDOM: Generalizable One-shot Deformable Object Manipulation with Parameter-Aware Policy

Efficient Spatial Representation and Routing of Deformable One-Dimensional Objects for Manipulation

Differentiable Particles for General-Purpose Deformable Object Manipulation

Generalizable whole-body global manipulation of deformable linear objects by dual-arm robot in 3-D constrained environments

Deformable One-Dimensional Object Detection for Routing and Manipulation

Learning visual-based deformable object rearrangement with local graph neural networks

Global Model Learning for Large Deformation Control of Elastic Deformable Linear Objects: An Efficient and Adaptive Approach