Abstract:Grasping objects is a fundamental yet important capability of robots, and many tasks such as sorting and picking rely on this skill. The prerequisite for stable grasping is the ability to correctly identify suitable grasping positions. However, finding appropriate grasping points is challenging due to the diverse shapes, varying density distributions, and significant differences between the barycenter of various objects. In the past few years, researchers have proposed many methods to address the above-mentioned issues and achieved very good results on publicly available datasets such as the Cornell dataset and the Jacquard dataset. The problem is that the backgrounds of Cornell and Jacquard datasets are relatively simple - typically just a whiteboard, while in real-world operational environments, the background could be complex and noisy. Moreover, in real-world scenarios, robots usually only need to grasp fixed types of objects. To address the aforementioned issues, we proposed a large-scale grasp detection dataset called NBMOD: Noisy Background Multi-Object Dataset for grasp detection, which consists of 31,500 RGB-D images of 20 different types of fruits. Accurate prediction of angles has always been a challenging problem in the detection task of oriented bounding boxes. This paper presents a Rotation Anchor Mechanism (RAM) to address this issue. Considering the high real-time requirement of robotic systems, we propose a series of lightweight architectures called RA-GraspNet (GraspNet with Rotation Anchor): RARA (network with Rotation Anchor and Region Attention), RAST (network with Rotation Anchor and Semi Transformer), and RAGT (network with Rotation Anchor and Global Transformer) to tackle this problem. Among them, the RAGT-3/3 model achieves an accuracy of 99% on the NBMOD dataset. The NBMOD and our code are available at <a class="link-external link-https" href="https://github.com/kmittle/Grasp-Detection-NBMOD" rel="external noopener nofollow">this https URL</a>.

SuctionNet-1Billion: A Large-Scale Benchmark for Suction Grasping

Sim-Suction: Learning a Suction Grasp Policy for Cluttered Environments Using a Synthetic Benchmark

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Model-free Grasping with Multi-Suction Cup Grippers for Robotic Bin Picking

Dex-Net 3.0: Computing Robust Robot Vacuum Suction Grasp Targets in Point Clouds using a New Analytic Model and Deep Learning

Robotic picking in dense clutter via domain invariant learning from synthetic dense cluttered rendering

MetaGraspNet: A Large-Scale Benchmark Dataset for Scene-Aware Ambidextrous Bin Picking via Physics-based Metaverse Synthesis

Robotic Continuous Grasping System by Shape Transformer-Guided Multi-Object Category-Level 6D Pose Estimation

Get a Grip: Multi-Finger Grasp Evaluation at Scale Enables Robust Sim-to-Real Transfer

Multiple-object Grasping Using a Multiple-suction-cup Vacuum Gripper in Cluttered Scenes

REGNet V2: End-to-End REgion-based Grasp Detection Network for Grippers of Different Sizes in Point Clouds

AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domains

Graspness Discovery in Clutters for Fast and Accurate Grasp Detection

DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenes

Grasp Quality Evaluation Network for Surface-to-Surface Contacts in Point Clouds

S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes

Jacquard: A Large Scale Dataset for Robotic Grasp Detection

NBMOD: Find It and Grasp It in Noisy Background

MetaGraspNet_v0: A Large-Scale Benchmark Dataset for Vision-driven Robotic Grasping via Physics-based Metaverse Synthesis

CMG-Net: An End-to-End Contact-Based Multi-Finger Dexterous Grasping Network

Robotic grasping using visual and tactile sensing