Abstract:Grasping detection from single images in robotic applications poses a significant challenge. While contemporary deep learning techniques excel, their success often hinges on large annotated datasets and intricate network architectures. In this letter, we present LiteGrasp, a novel semi-supervised lightweight framework purpose-built for grasp detection, eliminating the necessity for exhaustive supervision and intricate networks. Our approach uses a limited amount of labeled data via a knowledge distillation method, introducing HRGrasp-Net, a model with high efficiency for extracting features and largely based on HRNet. We incorporate pseudo-label filtering within a mutual learning model set within a teacher-student paradigm. This enhances the transference of data from images with labels to those without. Additionally, we introduce the streamlined Lite HRGrasp-Net, acting as the student network which gains further distillation knowledge using a multi-level fusion cascade originating from HRGrasp-Net. Impressively, LiteGrasp thrives with just a fraction (4.3%) of HRGrasp-Net's original model size, and with limited labeled data relative to total data (25% ratio) across all benchmarks, regularly outperforming solely supervised and semi-supervised models. Taking just 6 ms for execution, LiteGrasp showcases exceptional accuracy (99.99% and 97.21% on Cornell and Jacquard data sets respectively), as well as an impressive 95.3% rate of success in grasping when deployed using a 6DoF UR5e robotic arm. These highlights underscore the effectiveness and efficiency of LiteGrasp for grasp detection, even under resource-limited conditions.

Real-Time Robotic Grasp Detection with Multi-Scale Feature Fusion

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

Deep Vision Networks for Real-Time Robotic Grasp Detection

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Robotic Grasp Detection Network Based on Improved Deformable Convolution and Spatial Feature Center Mechanism

A robot grasping detection network based on flexible selection of multi-modal feature fusion structure

A Vision-based Robot Grasping System

Deep learning for detecting robotic grasps

Robotic Grasp Detection Using Structure Prior Attention and Multiscale Features

Bilateral Cross-Modal Fusion Network for Robot Grasp Detection

Real-Time, Highly Accurate Robotic Grasp Detection using Fully Convolutional Neural Networks with High-Resolution Images

A refined robotic grasp detection network based on coarse-to-fine feature and residual attention

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

A Real-Time Grasping Detection Network Architecture for Various Grasping Scenarios

Object Discovery and Grasp Detection with a Shared Convolutional Neural Network

Visual-tactile Fusion for Transparent Object Grasping in Complex Backgrounds

Robotic Grasping Detection Algorithm Based on 3D Vision Dual-Stream Encoding Strategy

Robotic Grasping Technology Integrating Large Kernel Convolution and Residual Connections

Deep learning-based method for vision-guided robotic grasping of unknown objects