Abstract:Grasping detection from single images in robotic applications poses a significant challenge. While contemporary deep learning techniques excel, their success often hinges on large annotated datasets and intricate network architectures. In this letter, we present LiteGrasp, a novel semi-supervised lightweight framework purpose-built for grasp detection, eliminating the necessity for exhaustive supervision and intricate networks. Our approach uses a limited amount of labeled data via a knowledge distillation method, introducing HRGrasp-Net, a model with high efficiency for extracting features and largely based on HRNet. We incorporate pseudo-label filtering within a mutual learning model set within a teacher-student paradigm. This enhances the transference of data from images with labels to those without. Additionally, we introduce the streamlined Lite HRGrasp-Net, acting as the student network which gains further distillation knowledge using a multi-level fusion cascade originating from HRGrasp-Net. Impressively, LiteGrasp thrives with just a fraction (4.3%) of HRGrasp-Net's original model size, and with limited labeled data relative to total data (25% ratio) across all benchmarks, regularly outperforming solely supervised and semi-supervised models. Taking just 6 ms for execution, LiteGrasp showcases exceptional accuracy (99.99% and 97.21% on Cornell and Jacquard data sets respectively), as well as an impressive 95.3% rate of success in grasping when deployed using a 6DoF UR5e robotic arm. These highlights underscore the effectiveness and efficiency of LiteGrasp for grasp detection, even under resource-limited conditions.

Object Discovery and Grasp Detection with a Shared Convolutional Neural Network

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

A Multi-task Convolutional Neural Network for Autonomous Robotic Grasping in Object Stacking Scenes

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

A Real-Time Grasping Detection Network Architecture for Various Grasping Scenarios

Deep Vision Networks for Real-Time Robotic Grasp Detection

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Real-Time, Highly Accurate Robotic Grasp Detection using Fully Convolutional Neural Networks with High-Resolution Images

GR-ConvNet v2: A Real-Time Multi-Grasp Detection Network for Robotic Grasping

Deep learning for detecting robotic grasps

Secure Grasping Detection of Objects in Stacked Scenes Based on Single-Frame RGB Images

A Robotic Grasping Algorithm Based on Simplified Image and Deep Convolutional Neural Network

Object Recognition and Grasping for Collaborative Robots Based on Vision

Keypoint-Based Robotic Grasp Detection Scheme in Multi-Object Scenes

A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions

A two-stage grasp detection method for sequential robotic grasping in stacking scenarios

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

GP-Net: A Lightweight Generative Convolutional Neural Network with Grasp Priority

Deep learning-based method for vision-guided robotic grasping of unknown objects