Abstract:Grasping detection from single images in robotic applications poses a significant challenge. While contemporary deep learning techniques excel, their success often hinges on large annotated datasets and intricate network architectures. In this letter, we present LiteGrasp, a novel semi-supervised lightweight framework purpose-built for grasp detection, eliminating the necessity for exhaustive supervision and intricate networks. Our approach uses a limited amount of labeled data via a knowledge distillation method, introducing HRGrasp-Net, a model with high efficiency for extracting features and largely based on HRNet. We incorporate pseudo-label filtering within a mutual learning model set within a teacher-student paradigm. This enhances the transference of data from images with labels to those without. Additionally, we introduce the streamlined Lite HRGrasp-Net, acting as the student network which gains further distillation knowledge using a multi-level fusion cascade originating from HRGrasp-Net. Impressively, LiteGrasp thrives with just a fraction (4.3%) of HRGrasp-Net's original model size, and with limited labeled data relative to total data (25% ratio) across all benchmarks, regularly outperforming solely supervised and semi-supervised models. Taking just 6 ms for execution, LiteGrasp showcases exceptional accuracy (99.99% and 97.21% on Cornell and Jacquard data sets respectively), as well as an impressive 95.3% rate of success in grasping when deployed using a 6DoF UR5e robotic arm. These highlights underscore the effectiveness and efficiency of LiteGrasp for grasp detection, even under resource-limited conditions.

A novel robotic grasp detection method based on region proposal networks

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

Single-Grasp Detection Based On Rotational Region Cnn

REGNet: REgion-based Grasp Network for Single-shot Grasp Detection in Point Clouds

A grasping posture estimation method based on 3D detection network

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

Robotic Grasp Detection Network Based on Improved Deformable Convolution and Spatial Feature Center Mechanism

Real-Time Robotic Multigrasp Detection Using Anchor-Free Fully Convolutional Grasp Detector

RoI-based Robotic Grasp Detection in Object Overlapping Scenes Using Convolutional Neural Network.

Deep Learning Method for Grasping Novel Objects Using Dexterous Hands

Novel Representation of Robotic Grasp Detection based on Residual Hourglass Architecture

AAGDN: Attention-Augmented Grasp Detection Network Based on Coordinate Attention and Effective Feature Fusion Method

Robotic Grasping of Novel Objects from RGB-D Images by Using Multi-Level Convolutional Neural Networks

Robotic Grasp Detection Using Structure Prior Attention and Multiscale Features

High Precision 6-DoF Grasp Detection in Cluttered Scenes Based on Network Optimization and Pose Propagation

Deep learning for detecting robotic grasps

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

Keypoint-Based Robotic Grasp Detection Scheme in Multi-Object Scenes

A Practical Multi-Stage Grasp Detection Method for Kinova Robot in Stacked Environments

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images