Abstract:The International Journal of Robotics Research, Ahead of Print. Constrained environments, compared with open spaces without other objects, are more common in practical applications of manipulating deformable linear objects (DLOs) by robots, where movements of both DLOs and robot manipulators should be constrained and unintended collision should be avoided. Such a task is high-dimensional and highly constrained owing to the highly deformable DLOs, dual-arm robots with high degrees of freedom, and 3-D complex environments, which render global planning extremely challenging. Furthermore, accurate DLO models needed by planning are often unavailable owing to their strong nonlinearity and diversity, resulting in unreliable planned paths. This article focuses on the global moving and shaping of DLOs in constrained environments by dual-arm robots. The main objectives are (1) to efficiently and accurately accomplish this task and (2) to achieve generalizable and robust manipulation of various DLOs. To this end, we propose a complementary framework with whole-body planning and control using appropriate DLO model representations. First, a global planner is proposed to efficiently find feasible solutions based on a simplified DLO energy model, which considers the full system states and all constraints to plan more reliable paths. Then, a closed-loop manipulation scheme is proposed to compensate for the modeling errors and enhance the robustness and accuracy, which incorporates a constrained model predictive controller to track the planned path as guidance while real-time adjusting the robot motion based on an adaptive DLO motion model. This framework systematically considers multiple constraints for this problem, including stable deformation, overstretch prevention, closed-chain movements, and collision avoidance. The key novelty is that it can efficiently solve the high-dimensional problem subject to all those constraints and generalize to various DLOs without elaborate model identifications. Experiments demonstrate that our framework can accomplish considerably more complicated tasks than existing works. It achieves a 100% planning success rate among thousands of trials with an average time cost of less than 15 seconds, and a 100% manipulation success rate among 135 real-world tests on five different DLOs.

In-Hand Following of Deformable Linear Objects Using Dexterous Fingers with Tactile Sensing

DexDLO: Learning Goal-Conditioned Dexterous Policy for Dynamic Manipulation of Deformable Linear Objects

D(R, O) Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Grasping

Learn to Grasp Objects with Dexterous Robot Manipulator from Human Demonstration

Learning thin deformable object manipulation with a multi-sensory integrated soft hand

Dexterous Soft Hands Linearize Feedback-Control for In-Hand Manipulation

Multi-fingered Dynamic Grasping for Unknown Objects

Mechanical Design and Analysis of a Novel Dexterous Hand Based on Grasping Manipulation.

DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics

Dynamic Modeling and Control of Deformable Linear Objects for Single-Arm and Dual-Arm Robot Manipulations

Generalizable whole-body global manipulation of deformable linear objects by dual-arm robot in 3-D constrained environments

Development of a Three-Fingered Multi-Modality Dexterous Hand with Integrated Embedded High-Dimensional Sensors

Object-Centric Dexterous Manipulation from Human Motion Data

Dexterous In-Hand Manipulation of Slender Cylindrical Objects through Deep Reinforcement Learning with Tactile Sensing

A Dexterous Soft Robotic Hand for Delicate In-Hand Manipulation

Real-time Dexterous Telemanipulation with an End-Effect-Oriented Learning-based Approach

DexH2R: Task-oriented Dexterous Manipulation from Human to Robots

A new control strategy for DLR's multisensory articulated hand

Robust Dexterous Manipulation Under Object Dynamics Uncertainties