Modeling, learning, perception, and control methods for deformable object manipulation

Hang Yin,Anastasia Varava,Danica Kragic

DOI: https://doi.org/10.1126/scirobotics.abd8803

IF: 25

2021-05-12

Science Robotics

Abstract:Enabling robots to handle deformable objects requires careful integration of data-driven and analytic approaches.

robotics

What problem does this paper attempt to address?

A Survey on Robotic Manipulation of Deformable Objects: Recent Advances, Open Challenges and New Frontiers

Feida Gu,Yanmin Zhou,Zhipeng Wang,Shuo Jiang,Bin He

2023-12-16

Abstract:Deformable object manipulation (DOM) for robots has a wide range of applications in various fields such as industrial, service and health care sectors. However, compared to manipulation of rigid objects, DOM poses significant challenges for robotic perception, modeling and manipulation, due to the infinite dimensionality of the state space of deformable objects (DOs) and the complexity of their dynamics. The development of computer graphics and machine learning has enabled novel techniques for DOM. These techniques, based on data-driven paradigms, can address some of the challenges that analytical approaches of DOM face. However, some existing reviews do not include all aspects of DOM, and some previous reviews do not summarize data-driven approaches adequately. In this article, we survey more than 150 relevant studies (data-driven approaches mainly) and summarize recent advances, open challenges, and new frontiers for aspects of perception, modeling and manipulation for DOs. Particularly, we summarize initial progress made by Large Language Models (LLMs) in robotic manipulation, and indicates some valuable directions for further research. We believe that integrating data-driven approaches and analytical approaches can provide viable solutions to open challenges of DOM.

Robotics
Challenges and Outlook in Robotic Manipulation of Deformable Objects

Jihong Zhu,Andrea Cherubini,Claire Dune,David Navarro-Alarcon,Farshid Alambeigi,Dmitry Berenson,Fanny Ficuciello,Kensuke Harada,Jens Kober,Xiang LI,Jia Pan,Wenzhen Yuan,Michael Gienger

DOI: https://doi.org/10.1109/mra.2022.3147415

2022-01-01

Abstract:Deformable object manipulation (DOM) is an emerging research problem in robotics. The ability to manipulate deformable objects endows robots with higher autonomy and promises new applications in the industrial, services, and health-care sectors. However, compared to rigid object manipulation, the manipulation of deformable objects is considerably more complex and is still an open research problem. Addressing DOM challenges demands breakthroughs in almost all aspects of robotics: hardware design, sensing, (deformation) modeling, planning, and control. In this article, we review recent advances and highlight the main challenges when considering deformation in each subfield. A particular focus of our article lies in the discussions of these challenges and proposing future directions of research.

robotics,automation & control systems
Global Model Learning for Large Deformation Control of Elastic Deformable Linear Objects: An Efficient and Adaptive Approach

Mingrui Yu,Kangchen Lv,Hanzhong Zhong,Shiji Song,Xiang Li

DOI: https://doi.org/10.1109/TRO.2022.3200546

IF: 7.8

2022-01-01

IEEE Transactions on Robotics

Abstract:Robotic manipulation of deformable linear objects (DLOs) has broad application prospects in many fields. However, a key issue is to obtain the exact deformation models (i.e., how robot motion affects DLO deformation), which are hard to theoretically calculate and vary among different DLOs. Thus, shape control of DLOs is challenging, especially for large deformation control which requires global and more accurate models. In this paper, we propose a coupled offline and online data-driven method for efficiently learning a global deformation model, allowing for both accurate modeling through offline learning and further updating for new DLOs via online adaptation. Specifically, the model approximated by a neural network is first trained offline on random data, then seamlessly migrated to the online phase, and further updated online during actual manipulation. Several strategies are introduced to improve the model's efficiency and generalization ability. We propose a convex-optimization-based controller, and analyze the system's stability using the Lyapunov method. Detailed simulations and real-world experiments demonstrate that our method can efficiently and precisely estimate the deformation model, and achieve large deformation control of untrained DLOs in 2D and 3D dual-arm manipulation tasks better than the existing methods. It accomplishes all 24 tasks with different desired shapes on different DLOs in the real world, using only simulation data for the offline learning.
Enhancing Deformable Object Manipulation By Using Interactive Perception and Assistive Tools

Peng Zhou

2023-11-16

Abstract:In the field of robotic manipulation, the proficiency of deformable object manipulation lags behind human capabilities due to the inherent characteristics of deformable objects. These objects have infinite degrees of freedom, resulting in non-trivial perception and state estimation, and complex dynamics, complicating the prediction of future configurations. Although recent research has focused on deformable object manipulation, most approaches rely on static vision and simple manipulation techniques, limiting the performance level. This paper proposes two solutions to enhance the performance: interactive perception and the use of assistive tools. The first solution posits that optimal perspectives exist during deformable object manipulation, facilitating easier state estimation. By exploring the action-perception regularity, interactive perception facilitates better manipulation and perception. The second solution advocates for the use of assistive tools, a hallmark of human intelligence, to improve manipulation performance. For instance, a folding board can aid in garment folding tasks by reducing object deformation and managing complex dynamics. Hence, this research aims to address the deformable object manipulation problem by incorporating interactive perception and assistive tools to augment manipulation performance.

Robotics
Soft Contact Simulation and Manipulation Learning of Deformable Objects with Vision-based Tactile Sensor

Jianhua Shan,Yuhao Sun,Shixin Zhang,Fuchun Sun,Zixi Chen,Zirong Shen,Cesare Stefanini,Yiyong Yang,Shan Luo,Bin Fang

DOI: https://doi.org/10.48550/arxiv.2405.07237

2024-01-01

Abstract:Deformable object manipulation is a classical and challenging research areain robotics. Compared with rigid object manipulation, this problem is morecomplex due to the deformation properties including elastic, plastic, andelastoplastic deformation. In this paper, we describe a new deformable objectmanipulation method including soft contact simulation, manipulation learning,and sim-to-real transfer. We propose a novel approach utilizing Vision-BasedTactile Sensors (VBTSs) as the end-effector in simulation to produceobservations like relative position, squeezed area, and object contour, whichare transferable to real robots. For a more realistic contact simulation, a newsimulation environment including elastic, plastic, and elastoplasticdeformations is created. We utilize RL strategies to train agents in thesimulation, and expert demonstrations are applied for challenging tasks.Finally, we build a real experimental platform to complete the sim-to-realtransfer and achieve a 90sphere. To test the robustness of our method, we use plasticine of differenthardness and sizes to repeat the tasks including cylinder and sphere. Theexperimental results show superior performances of deformable objectmanipulation with the proposed method.
Dynamic Modeling and Control of Deformable Linear Objects for Single-Arm and Dual-Arm Robot Manipulations

Naijing Lv,Jianhua Liu,Yunyi Jia

DOI: https://doi.org/10.1109/tro.2021.3139838

IF: 7.8

2022-08-09

IEEE Transactions on Robotics

Abstract:Robotic manipulation of deformable linear objects (DLOs) is important in many applications such as the assembly of deformable wire harnesses and cables in manufacturing. Despite some relevant work in modeling, few studies have studied the comprehensive dynamic modeling and precise automatic control of DLOs using robots due to their high degrees of freedom and high flexibility. To fill this gap, the precise single-arm and dual-arm robot manipulation control of DLOs is studied in this article. First, a more comprehensive dynamic model of DLOs is established based on a discrete elastic rod model, which takes into account the twisting deformation of DLOs. The collisions, contacts, and frictions between the DLOs and the plane, as well as the kinematic constraints of both ends of the DLOs, are also considered in the model. Second, practical dynamic control schemes of robots are proposed to realize the precise control of DLOs for both the single-arm control and dual-arm control. For validations, we built an experimental platform using an ABB Yumi robot to implement and validate the proposed approaches in addition to simulations. Finally, various DLO manipulation tasks are conducted and the results for both single-arm and dual-arm manipulations validate the proposed modeling and control approaches.

robotics
Interactive Perception for Deformable Object Manipulation

Zehang Weng,Peng Zhou,Hang Yin,Alexander Kravberg,Anastasiia Varava,David Navarro-Alarcon,Danica Kragic

2024-06-11

Abstract:Interactive perception enables robots to manipulate the environment and objects to bring them into states that benefit the perception process. Deformable objects pose challenges to this due to significant manipulation difficulty and occlusion in vision-based perception. In this work, we address such a problem with a setup involving both an active camera and an object manipulator. Our approach is based on a sequential decision-making framework and explicitly considers the motion regularity and structure in coupling the camera and manipulator. We contribute a method for constructing and computing a subspace, called Dynamic Active Vision Space (DAVS), for effectively utilizing the regularity in motion exploration. The effectiveness of the framework and approach are validated in both a simulation and a real dual-arm robot setup. Our results confirm the necessity of an active camera and coordinative motion in interactive perception for deformable objects.

Robotics
Learning-based Feedback Controller for Deformable Object Manipulation

Biao Jia,Zhe Hu,Zherong Pan,Dinesh Manocha,Jia Pan

DOI: https://doi.org/10.48550/arXiv.1806.09618

IF: 3.7

2018-06-25

Robotics

Abstract:In this paper, we present a general learning-based framework to automatically visual-servo control the position and shape of a deformable object with unknown deformation parameters. The servo-control is accomplished by learning a feedback controller that determines the robotic end-effector's movement according to the deformable object's current status. This status encodes the object's deformation behavior by using a set of observed visual features, which are either manually designed or automatically extracted from the robot's sensor stream. A feedback control policy is then optimized to push the object toward a desired featured status efficiently. The feedback policy can be learned either online or offline. Our online policy learning is based on the Gaussian Process Regression (GPR), which can achieve fast and accurate manipulation and is robust to small perturbations. An offline imitation learning framework is also proposed to achieve a control policy that is robust to large perturbations in the human-robot interaction. We validate the performance of our controller on a set of deformable object manipulation tasks and demonstrate that our method can achieve effective and accurate servo-control for general deformable objects with a wide variety of goal settings.
Deformable Object Manipulation in Caregiving Scenarios: A Review

Liman Wang,Jihong Zhu

DOI: https://doi.org/10.3390/machines11111013

IF: 2.899

2023-11-08

Machines

Abstract:This paper reviews the robotic manipulation of deformable objects in caregiving scenarios. Deformable objects like clothing, food, and medical supplies are ubiquitous in care tasks, yet pose modeling, control, and sensing challenges. This paper categorises caregiving deformable objects and analyses their distinct properties influencing manipulation. Key sections examine progress in simulation, perception, planning, control, and system designs for deformable object manipulation, along with end-to-end deep learning's potential. Hybrid analytical data-driven modeling shows promise. While laboratory successes have been achieved, real-world caregiving applications lag behind. Enhancing safety, speed, generalisation, and human compatibility is crucial for adoption. The review synthesises critical technologies, capabilities, and limitations, while also pointing to open challenges in deformable object manipulation for robotic caregiving. It provides a comprehensive reference for researchers tackling this socially valuable domain. In conclusion, multi-disciplinary innovations combining analytical and data-driven methods are needed to advance real-world robot performance and safety in deformable object manipulation for patient care.

engineering, mechanical, electrical & electronic
Robust Model-Predictive Deformation Control of a Soft Object by Using a Flexible Continuum Robot

Bo Ouyang,Hangjie Mo,Haoyao Chen,Yunhui Liu,Dong Sun

DOI: https://doi.org/10.1109/IROS.2018.8593880

2018-01-01

Abstract:Flexible continuum robots have exhibited unique advantages in working in an unstructured environment. Many applications require robots to actively control the deformation of soft objects, such as soft tissues in surgery. Thus, this study presents a robust model-predictive deformation control of a soft object using a flexible continuum robot. A linear approximation model for mapping from actuation space of a continuum robot to deformation space of a soft object is established. Jacobian matrix is estimated online by using a robust Geman-McClure estimator. Then, the deformation of the soft object is regulated by using a prediction horizon-based controller with exponential weighting for model uncertainty. The proposed control approach is effective in manipulating a soft object with a flexible continuum robot that is in contact with obstacles.
Robot Control Based on Integration of Visual and Force/Torque Sensor Information : Handling of a Deformable Object

Jian HUANG,Isao TODO,Isao MURAMATSU

DOI: https://doi.org/10.1299/jsmemecjo.2000.2.0_585

2000-01-01

The proceedings of the JSME annual meeting

Abstract:Ability of handling of a deformable object for a robot is expected not only in industrial manufacturing but also in human life support. A force/torque sensor is frequently used for robot control in playing a contact task with a rigid object. However, it is not enough for controlling a robot in handling of a deformable object. In this paper, a sensor fusion algorithm is proposed to control a robot to insert an aluminum peg set up on the robot hand into a deformable hole. To completing the task, a high-speed camera is used and a real time processing algorithm is developed to detect the deformation of the central line of the hole. The results of real time visual processing are integrated with information of a force/torque sensor for controlling a robot in playing the task using a proposed compliance control algorithm. The effectiveness of proposed method has been demonstrated through experiments.
Learning thin deformable object manipulation with a multi-sensory integrated soft hand

Chao Zhao,Chunli Jiang,Lifan Luo,Shuai Yuan,Qifeng Chen,Hongyu Yu

2024-11-21

Abstract:Robotic manipulation has made significant advancements, with systems demonstrating high precision and repeatability. However, this remarkable precision often fails to translate into efficient manipulation of thin deformable objects. Current robotic systems lack imprecise dexterity, the ability to perform dexterous manipulation through robust and adaptive behaviors that do not rely on precise control. This paper explores the singulation and grasping of thin, deformable objects. Here, we propose a novel solution that incorporates passive compliance, touch, and proprioception into thin, deformable object manipulation. Our system employs a soft, underactuated hand that provides passive compliance, facilitating adaptive and gentle interactions to dexterously manipulate deformable objects without requiring precise control. The tactile and force/torque sensors equipped on the hand, along with a depth camera, gather sensory data required for manipulation via the proposed slip module. The manipulation policies are learned directly from raw sensory data via model-free reinforcement learning, bypassing explicit environmental and object modeling. We implement a hierarchical double-loop learning process to enhance learning efficiency by decoupling the action space. Our method was deployed on real-world robots and trained in a self-supervised manner. The resulting policy was tested on a variety of challenging tasks that were beyond the capabilities of prior studies, ranging from displaying suit fabric like a salesperson to turning pages of sheet music for violinists.

Robotics
Learning Robotic Manipulation through Visual Planning and Acting

Angelina Wang,Thanard Kurutach,Kara Liu,Pieter Abbeel,Aviv Tamar

DOI: https://doi.org/10.48550/arXiv.1905.04411

2019-05-11

Abstract:Planning for robotic manipulation requires reasoning about the changes a robot can affect on objects. When such interactions can be modelled analytically, as in domains with rigid objects, efficient planning algorithms exist. However, in both domestic and industrial domains, the objects of interest can be soft, or deformable, and hard to model analytically. For such cases, we posit that a data-driven modelling approach is more suitable. In recent years, progress in deep generative models has produced methods that learn to `imagine' plausible images from data. Building on the recent Causal InfoGAN generative model, in this work we learn to imagine goal-directed object manipulation directly from raw image data of self-supervised interaction of the robot with the object. After learning, given a goal observation of the system, our model can generate an imagined plan -- a sequence of images that transition the object into the desired goal. To execute the plan, we use it as a reference trajectory to track with a visual servoing controller, which we also learn from the data as an inverse dynamics model. In a simulated manipulation task, we show that separating the problem into visual planning and visual tracking control is more sample efficient and more interpretable than alternative data-driven approaches. We further demonstrate our approach on learning to imagine and execute in 3 environments, the final of which is deformable rope manipulation on a PR2 robot.

Robotics,Computer Vision and Pattern Recognition,Machine Learning
Model-Free Visually Servoed Deformation Control of Elastic Objects by Robot Manipulators

David Navarro-Alarcon,Yun-Hui Liu,Jose Guadalupe Romero,Peng Li

DOI: https://doi.org/10.1109/tro.2013.2275651

IF: 7.8

2013-01-01

IEEE Transactions on Robotics

Abstract:Despite the recent progress in physically interactive and surgical robotics, the active deformation of compliant objects remains an open problem. The main obstacle to its implementation comes from the difficulty to identify or estimate the object's deformation model. In this paper, we propose a novel vision-based deformation controller for robot manipulators interacting with unknown elastic objects. We derive a new dynamic-state feedback velocity control law using the passivity-based framework. Our method exploits visual feedback to estimate the deformation Jacobian matrix in real time, avoiding any model identification steps. We prove that even in the presence of inexact estimations, the closed-loop dynamical system ensures input-to-state stability (i.e., full dissipativity) with respect to external disturbances. An experimental study with several deformation tasks is presented to validate the theory.
Reactive human–robot collaborative manipulation of deformable linear objects using a new topological latent control model

Peng Zhou,Pai Zheng,Jiaming Qi,Chengxi Li,Hoi-Yin Lee,Anqing Duan,Liang Lu,Zhongxuan Li,Luyin Hu,David Navarro-Alarcon

DOI: https://doi.org/10.1016/j.rcim.2024.102727

IF: 10.103

2024-01-17

Robotics and Computer-Integrated Manufacturing

Abstract:Real-time reactive manipulation of deformable linear objects is a challenging task that requires robots to quickly and adaptively respond to changes in the object's deformed shape that result from external forces. In this paper, a novel approach is proposed for real-time reactive deformable linear object manipulation in the context of human–robot collaboration. The proposed approach combines a topological latent representation and a fixed-time sliding mode controller to enable seamless interaction between humans and robots. The introduced topological control model offers a framework for controlling the dynamic shape of deformable objects. By leveraging the topological representation, our approach captures the connectivity and structure of the objects' shapes within a latent space. This enables improved generalization and performance when handling complex deformable shapes. A fixed-time sliding mode controller ensures that the object is manipulated in real-time, while also ensuring that it remains accurate and stable during the manipulation process. To validate our proposed framework, we first conduct motor-robot experiments to simulate fixed human interaction processes, enabling straightforward comparisons with other approaches. We then follow up with human–robot experiments to demonstrate the effectiveness of our approach.

robotics,computer science, interdisciplinary applications,engineering, manufacturing
Bimanual Deformable Bag Manipulation Using a Structure-of-Interest Based Neural Dynamics Model

Peng Zhou,Pai Zheng,Jiaming Qi,Chenxi Li,Samantha Lee,Chenguang Yang,David Navarro-Alarcon,Jia Pan

2024-10-21

Abstract:The manipulation of deformable objects by robotic systems presents a significant challenge due to their complex and infinite-dimensional configuration spaces. This paper introduces a novel approach to Deformable Object Manipulation (DOM) by emphasizing the identification and manipulation of Structures of Interest (SOIs) in deformable fabric bags. We propose a bimanual manipulation framework that leverages a Graph Neural Network (GNN)-based latent dynamics model to succinctly represent and predict the behavior of these SOIs. Our approach involves constructing a graph representation from partial point cloud data of the object and learning the latent dynamics model that effectively captures the essential deformations of the fabric bag within a reduced computational space. By integrating this latent dynamics model with Model Predictive Control (MPC), we empower robotic manipulators to perform precise and stable manipulation tasks focused on the SOIs. We have validated our framework through various empirical experiments demonstrating its efficacy in bimanual manipulation of fabric bags. Our contributions not only address the complexities inherent in DOM but also provide new perspectives and methodologies for enhancing robotic interactions with deformable objects by concentrating on their critical structural elements. Experimental videos can be obtained from <a class="link-external link-https" href="https://sites.google.com/view/bagbot" rel="external noopener nofollow">this https URL</a>.

Robotics
Automatic 3-D Manipulation of Soft Objects by Robotic Arms with an Adaptive Deformation Model.

David Navarro-Alarcon,Hiu Man Yip,Zerui Wang,Yun-Hui Liu,Fangxun Zhong,Tianxue Zhang,Peng Li

DOI: https://doi.org/10.1109/tro.2016.2533639

IF: 7.8

2016-01-01

IEEE Transactions on Robotics

Abstract:In this paper, we present a new feedback method to automatically servo-control the 3-D shape of soft objects with robotic manipulators. The soft object manipulation problem has recently received a great deal of attention from robotics researchers because of its potential applications in, e.g., food industry, home robots, medical robotics, and manufacturing. A major complication to automatically control the shape of an object is the estimation of its deformation properties, which determines how the manipulator's motion actively transforms into deformations. Note that these properties are rarely known beforehand, and its offline parametric identification is difficult and/or impractical to conduct in many applications. To cope with this issue, we developed a new algorithm that computes in real time the unknown deformation parameters of a soft object; this algorithm provides a valuable adaptive behavior to the deformation controller, something we cannot achieve with traditional fixed-model approaches. In contrast with most controllers in the literature, our new method can explicitly servocontrol 3-D deformations (and not just 2-D image projections) in an entirely model-free way. To validate the proposed adaptive controller, we present a detailed experimental study with robotic manipulators.
Collaborative Manipulation of Deformable Objects with Predictive Obstacle Avoidance

Burak Aksoy,John Wen

2024-01-30

Abstract:Manipulating deformable objects arises in daily life and numerous applications. Despite phenomenal advances in industrial robotics, manipulation of deformable objects remains mostly a manual task. This is because of the high number of internal degrees of freedom and the complexity of predicting its motion. In this paper, we apply the computationally efficient position-based dynamics method to predict object motion and distance to obstacles. This distance is incorporated in a control barrier function for the resolved motion kinematic control for one or more robots to adjust their motion to avoid colliding with the obstacles. The controller has been applied in simulations to 1D and 2D deformable objects with varying numbers of assistant agents, demonstrating its versatility across different object types and multi-agent systems. Results indicate the feasibility of real-time collision avoidance through deformable object simulation, minimizing path tracking error while maintaining a predefined minimum distance from obstacles and preventing overstretching of the deformable object. The implementation is performed in ROS, allowing ready portability to different applications.

Robotics
Optimal Cosserat-based deformation control for robotic manipulation of linear objects

Azad Artinian,Faiz Ben Amar,Veronique Perdereau

DOI: https://doi.org/10.1109/AIM46323.2023.10196216

2024-09-19

Abstract:The robotic shape control of deformable linear objects has garnered increasing interest within the robotics community. Despite recent progress, the majority of shape control approaches can be classified into two main groups: open-loop control, which relies on physically realistic models to represent the object, and closed-loop control, which employs less precise models alongside visual data to compute commands. In this work, we present a novel 3D shape control approach that includes the physically realistic Cosserat model into a closed-loop control framework, using vision feedback to rectify errors in real-time. This approach capitalizes on the advantages of both groups: the realism and precision provided by physics-based models, and the rapid computation, therefore enabling real-time correction of model errors, and robustness to elastic parameter estimation inherent in vision-based approaches. This is achieved by computing a deformation Jacobian derived from both the Cosserat model and visual data. To demonstrate the effectiveness of the method, we conduct a series of shape control experiments where robots are tasked with deforming linear objects towards a desired shape.

Robotics
SculptBot: Pre-Trained Models for 3D Deformable Object Manipulation

Alison Bartsch,Charlotte Avra,Amir Barati Farimani

DOI: https://doi.org/10.48550/arXiv.2309.08728

2023-09-16

Abstract:Deformable object manipulation presents a unique set of challenges in robotic manipulation by exhibiting high degrees of freedom and severe self-occlusion. State representation for materials that exhibit plastic behavior, like modeling clay or bread dough, is also difficult because they permanently deform under stress and are constantly changing shape. In this work, we investigate each of these challenges using the task of robotic sculpting with a parallel gripper. We propose a system that uses point clouds as the state representation and leverages pre-trained point cloud reconstruction Transformer to learn a latent dynamics model to predict material deformations given a grasp action. We design a novel action sampling algorithm that reasons about geometrical differences between point clouds to further improve the efficiency of model-based planners. All data and experiments are conducted entirely in the real world. Our experiments show the proposed system is able to successfully capture the dynamics of clay, and is able to create a variety of simple shapes.

Robotics,Artificial Intelligence

Modeling, learning, perception, and control methods for deformable object manipulation

A Survey on Robotic Manipulation of Deformable Objects: Recent Advances, Open Challenges and New Frontiers

Challenges and Outlook in Robotic Manipulation of Deformable Objects

Global Model Learning for Large Deformation Control of Elastic Deformable Linear Objects: An Efficient and Adaptive Approach

Enhancing Deformable Object Manipulation By Using Interactive Perception and Assistive Tools

Soft Contact Simulation and Manipulation Learning of Deformable Objects with Vision-based Tactile Sensor

Dynamic Modeling and Control of Deformable Linear Objects for Single-Arm and Dual-Arm Robot Manipulations

Interactive Perception for Deformable Object Manipulation

Learning-based Feedback Controller for Deformable Object Manipulation

Deformable Object Manipulation in Caregiving Scenarios: A Review

Robust Model-Predictive Deformation Control of a Soft Object by Using a Flexible Continuum Robot

Robot Control Based on Integration of Visual and Force/Torque Sensor Information : Handling of a Deformable Object

Learning thin deformable object manipulation with a multi-sensory integrated soft hand

Learning Robotic Manipulation through Visual Planning and Acting

Model-Free Visually Servoed Deformation Control of Elastic Objects by Robot Manipulators

Reactive human–robot collaborative manipulation of deformable linear objects using a new topological latent control model

Bimanual Deformable Bag Manipulation Using a Structure-of-Interest Based Neural Dynamics Model

Automatic 3-D Manipulation of Soft Objects by Robotic Arms with an Adaptive Deformation Model.

Collaborative Manipulation of Deformable Objects with Predictive Obstacle Avoidance

Optimal Cosserat-based deformation control for robotic manipulation of linear objects

SculptBot: Pre-Trained Models for 3D Deformable Object Manipulation