Abstract:Constrained environments are common in practical applications of manipulating deformable linear objects (DLOs), where movements of both DLOs and robots should be constrained. This task is high-dimensional and highly constrained owing to the highly deformable DLOs, dual-arm robots with high degrees of freedom, and 3-D complex environments, which render global planning challenging. Furthermore, accurate DLO models needed by planning are often unavailable owing to their strong nonlinearity and diversity, resulting in unreliable planned paths. This article focuses on the global moving and shaping of DLOs in constrained environments by dual-arm robots. The main objectives are 1) to efficiently and accurately accomplish this task, and 2) to achieve generalizable and robust manipulation of various DLOs. To this end, we propose a complementary framework with whole-body planning and control using appropriate DLO model representations. First, a global planner is proposed to efficiently find feasible solutions based on a simplified DLO energy model, which considers the full system states and all constraints to plan more reliable paths. Then, a closed-loop manipulation scheme is proposed to compensate for the modeling errors and enhance the robustness and accuracy, which incorporates a model predictive controller that real-time adjusts the robot motion based on an adaptive DLO motion model. The key novelty is that our framework can efficiently solve the high-dimensional problem subject to multiple constraints and generalize to various DLOs without elaborate model identifications. Experiments demonstrate that our framework can accomplish considerably more complicated tasks than existing works, with significantly higher efficiency, generalizability, and reliability.

Learning Graph Dynamics with External Contact for Deformable Linear Objects Shape Control.

Robotic co-manipulation of deformable linear objects for large deformation tasks

Sequential Robotic Manipulation for Active Shape Control of Deformable Linear Objects.

Global Model Learning for Large Deformation Control of Elastic Deformable Linear Objects: An Efficient and Adaptive Approach

Dynamic Modeling and Control of Deformable Linear Objects for Single-Arm and Dual-Arm Robot Manipulations

Sim2Real Neural Controllers for Physics-based Robotic Deployment of Deformable Linear Objects

Generalizable whole-body global manipulation of deformable linear objects by dual-arm robot in 3-D constrained environments

Keypoint-Based Planar Bimanual Shaping of Deformable Linear Objects under Environmental Constraints with Hierarchical Action Framework

A Coarse-to-Fine Framework for Dual-Arm Manipulation of Deformable Linear Objects with Whole-Body Obstacle Avoidance

Learning Shape Control of Elastoplastic Deformable Linear Objects

Offline Goal-Conditioned Reinforcement Learning for Shape Control of Deformable Linear Objects

Adaptive Control for Robotic Manipulation of Deformable Linear Objects with Offline and Online Learning of Unknown Models

DexDLO: Learning Goal-Conditioned Dexterous Policy for Dynamic Manipulation of Deformable Linear Objects

Shape Control of Deformable Linear Objects with Offline and Online Learning of Local Linear Deformation Models

Learning Latent Dynamics for Autonomous Shape Control of Deformable Object

In-Hand Following of Deformable Linear Objects Using Dexterous Fingers with Tactile Sensing

Cable Assembly in Constrained Environment Based on Contact State Transition Graph

Sequential Manipulation of Deformable Linear Object Networks with Endpoint Pose Measurements using Adaptive Model Predictive Control

Motion Planning for Deformable Linear Objects under Multiple Constraints

Differentiable Discrete Elastic Rods for Real-Time Modeling of Deformable Linear Objects