Abstract:Real-time and accuracy are important evaluation metrics of robotic grasp detection algorithms. To further improve the accuracy on the premise of ensuring real-time performance, in this paper, a new Selective Kernel convolution Grasp detection Network (SKGNet) is proposed. Compared with previous methods, the attention mechanism and multi-scale fusion features are integrated into the SKGNet, which makes the network not only pay full attention to the grasp area but also flexibly adjust the grasp area according to the scale of the object, thus effectively distinguishing the object from the background. The SKGNet is trained and tested on the Cornell dataset and the Jacquard dataset, with the accuracy of 99.1% and 95.9% respectively, which is superior to SOTA methods. Moreover, SKGNet's detection speed has reached 28fps. To demonstrate the performance of SKGNet, comparison studies and ablation experiments are performed in this paper. Finally, the grasp experiments of Baxter robot are also performed to verify the generalization of SKGNet in the actual scene, which achieves an average grasping success rate of 96.5%. Video is available at https://youtu.be/j07sb_ChzWQ. Note to Practitioners-Autonomous grasping is an very important skill for the robotic systems in the real world. However, due to the low grasp detection accuracy, robotic grasp is still a challenging problem. Although some methods have been developed to improve the grasp detection accuracy, the time efficiency is poor. Grasp detection with good accuracy and efficiency is worthy of further study. In this view, a novel deep learning- based grasp detection network SKGNet is proposed in this paper. It takes RGB-D images as input, trains and tests on public datasets, and finally outputs a series of grasp rectangles. Compared with the existing works, it not only achieves state-of-the-art detection accuracy, but also has high efficiency. To demonstrate the generalization performance and effectiveness, the SKGNet is also tested in the real world, and applied to perform the actual grasp task of Baxter robot. The results show that the SKGNet has good robustness and can detect the unknown objects of different sizes and shapes in the real world well.

SE-ResUNet: A Novel Robotic Grasp Detection Method

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

A pixel-level grasp detection method based on Efficient Grasp Aware Network

SKGNet: Robotic Grasp Detection with Selective Kernel Convolution

DSC-GraspNet: A Lightweight Convolutional Neural Network for Robotic Grasp Detection

A Novel Large-Kernel Residual Grasp Network for Robot Grasp Detection

Deep Vision Networks for Real-Time Robotic Grasp Detection

Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

Robotic Grasp Detection Using Structure Prior Attention and Multiscale Features

CGNet: Robotic Grasp Detection in Heavily Cluttered Scenes

Accurate Robotic Grasp Detection with Angular Label Smoothing

Real-Time, Highly Accurate Robotic Grasp Detection using Fully Convolutional Neural Networks with High-Resolution Images

A Robot Grasping System With Single-Stage Anchor-Free Deep Grasp Detector

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Pixel-Reasoning-Based Robotics Fine Grasping for Novel Objects with Deep EDINet Structure.

Edge-Dependent Efficient Grasp Rectangle Search in Robotic Grasp Detection

FCNN-GraspNet: a Steamlined Neural Network for Robotic Grasp Detection

Enhancement ofreal-timegrasp detection by cascaded deep convolutional neural networks

Novel Representation of Robotic Grasp Detection based on Residual Hourglass Architecture