Abstract:Robust and efficient grasping of different objects is still an open problem due to the difficulty of integrating multidisciplinary knowledge such as gripper ontology design, perception, control, and learning. In recent years, learning-based methods have achieved excellent results in grasping various novel objects. However, current methods are usually limited to a single grasping mode or rely on different end effectors to grasp objects of different shapes. For human beings, our hands are capable of grasping various objects with changes in grasping methods and form of hands. In light of this, developing a gripper with similar performance could possibly improve the robot's gripping ability. In this paper, we design a dual-modal soft gripper (DSG) and propose a deep reinforcement learning (DRL) framework to implement the operations. Both of our grasping modes, namely enveloping and pinching, are achieved through the tendon drive system and the deformation of the spring steel plate, which enables the gripper to switch between the two grasping modes in real time. We also combined the cutting-edge achievements of deep learning and reinforcement learning to design an autonomous grasping algorithm based on Q-learning and a deep Q network. Moreover, to fully utilize the visual input from the sensor, we added semantic embeddings of target objects to facilitate the learning, which is especially useful in deciding the grasping method for objects previously unseen. We also evaluate our DRL framework in different scenarios, offering a detailed comparison of each grasping mode and the mixed method (with or without semantic information). Our design has proved efficient in reducing the number of failing grasping actions and improving the success rate when facing novel and tricky objects.

Design and Research of a New Multi-Scene Intelligent Grasping and Handling Robot

Design, Control and Implementation of an Intelligent Material Handling Robot

A Human-Robot Collaboration System for Object Handover

Design of a small material handling robot gripping and storage system

Electromagnetic Switching Multiple Grasping Modes Robot Hand

Design of an Intelligent Handling Robot

Design of a Tactile Sensing Robotic Gripper and Its Grasping Method

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Modular Industrial Robot Suitable for Various Scenarios

Design And Use Of An Apparatus For Presenting Graspable Objects In 3d Workspace

Design and Control of Roller Grasper V3 for In-Hand Manipulation

Design of a Multi-Functional Logistics Robot

Design and Implementation of A Three-Degree-of-Freedom Intelligent Logistics Robot

Perception Enhanced Robotic Arm

Design and Control of Roller Grasper V2 for In-Hand Manipulation

Design and Implementation of Intelligent Material Handling Robot Based on STM32

Design and Research of Intelligent Logistics Robot based on STM32

Human Grasp Mechanism Understanding, Human-Inspired Grasp Control and Robotic Grasping Planning for Agricultural Robots

Implementation and Optimization of Grasping Learning with Dual-modal Soft Gripper.

Efficient and Robust Robotic Grasping in Cluttered Scenes: A Point Cloud-Based Approach with Heuristic Evaluation.

A Vision-based Robot Grasping System