Abstract:Service robotics is a fast-developing sector, requiring embedded intelligence into robotic platforms to interact with the humans and the surrounding environment. One of the main challenges in the field is robust and versatile manipulation in everyday life activities. An appealing opportunity is to exploit compliant end-effectors to address the manipulation of deformable objects. However, the intrinsic compliance of such grippers results in increased difficulties in grasping control. Within the described context, this work addresses the problem of optimizing the grasping of deformable objects making use of a compliant, under-actuated, sensorless robotic hand. The main aim of the paper is, therefore, finding the best position and joint configuration for the mentioned robotic hand to grasp an unforeseen deformable object based on collected RGB image and partial point cloud. Due to the complex grasping dynamics, learning-from-simulations approaches (e.g., Reinforcement Learning) are not effective in the faced context. Thus, trial-and-error-based methodologies have to be exploited. In order to save resources, a samples-efficient approach has to be employed. Indeed, a Bayesian approach to address the optimization of the grasping strategy is proposed, enhancing it with transfer learning capabilities to exploit the acquired knowledge to grasp (partially) new objects. A PAL Robotics TIAGo (a mobile manipulator with a 7-degrees-of-freedom arm and an anthropomorphic underactuated compliant hand) has been used as a test platform, executing a pouring task while manipulating plastic (i.e., deformable) bottles. The sampling efficiency of the data-driven learning is shown, compared to an evenly spaced grid sampling of the input space. In addition, the generalization capability of the optimized model is tested (exploiting transfer learning) on a set of plastic bottles and other liquid containers, achieving a success rate of the 88%.

Flipbot: Learning Continuous Paper Flipping via Coarse-to-Fine Exteroceptive-Proprioceptive Exploration

Dexterous Manoeuvre Through Touch in a Cluttered Scene

Dynamic Flex-and-Flip Manipulation of Deformable Linear Objects

Autonomous Learning of Page Flipping Movements via Tactile Feedback

Learning thin deformable object manipulation with a multi-sensory integrated soft hand

PaperBot: Learning to Design Real-World Tools Using Paper

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing

RoTipBot: Robotic Handling of Thin and Flexible Objects using Rotatable Tactile Sensors

Precise In-Hand Manipulation of Soft Objects using Soft Fingertips with Tactile Sensing and Active Deformation

ScissorBot: Learning Generalizable Scissor Skill for Paper Cutting via Simulation, Imitation, and Sim2Real

Fine Manipulation Using a Tactile Skin: Learning in Simulation and Sim-to-Real Transfer

Rotating without Seeing: Towards In-hand Dexterity through Touch

Learning Cloth Folding Tasks with Refined Flow Based Spatio-Temporal Graphs

FlingBot: The Unreasonable Effectiveness of Dynamic Manipulation for Cloth Unfolding

Grasping learning, optimization, and knowledge transfer in the robotics field

Active Affordance Exploration For Robot Grasping

Enabling Robot Manipulation of Soft and Rigid Objects with Vision-based Tactile Sensors

Deep Reinforcement Learning for Flipper Control of Tracked Robots

TacRot: A Parallel-Jaw Gripper with Rotatable Tactile Sensors for In-Hand Manipulation

Design of an Optoelectronically Innervated Gripper for Rigid-Soft Interactive Grasping