Abstract:Grasping detection from single images in robotic applications poses a significant challenge. While contemporary deep learning techniques excel, their success often hinges on large annotated datasets and intricate network architectures. In this letter, we present LiteGrasp, a novel semi-supervised lightweight framework purpose-built for grasp detection, eliminating the necessity for exhaustive supervision and intricate networks. Our approach uses a limited amount of labeled data via a knowledge distillation method, introducing HRGrasp-Net, a model with high efficiency for extracting features and largely based on HRNet. We incorporate pseudo-label filtering within a mutual learning model set within a teacher-student paradigm. This enhances the transference of data from images with labels to those without. Additionally, we introduce the streamlined Lite HRGrasp-Net, acting as the student network which gains further distillation knowledge using a multi-level fusion cascade originating from HRGrasp-Net. Impressively, LiteGrasp thrives with just a fraction (4.3%) of HRGrasp-Net's original model size, and with limited labeled data relative to total data (25% ratio) across all benchmarks, regularly outperforming solely supervised and semi-supervised models. Taking just 6 ms for execution, LiteGrasp showcases exceptional accuracy (99.99% and 97.21% on Cornell and Jacquard data sets respectively), as well as an impressive 95.3% rate of success in grasping when deployed using a 6DoF UR5e robotic arm. These highlights underscore the effectiveness and efficiency of LiteGrasp for grasp detection, even under resource-limited conditions.

A Smart Dual-modal Aligned Transformer Deep Network for Robotic Grasp Detection

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

Bilateral Cross-Modal Fusion Network for Robot Grasp Detection

Deep learning for detecting robotic grasps

A Grasps-Generation-and-selection Convolutional Neural Network for a Digital Twin of Intelligent Robotic Grasping.

A Vision-based Robot Grasping System

Deep Vision Networks for Real-Time Robotic Grasp Detection

Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

A Novel Robotic Pushing and Grasping Method Based on Vision Transformer and Convolution

FastGNet: An Efficient 6-DOF Grasp Detection Method with Multi-Attention Mechanisms and Point Transformer Network

Robotic grasping using visual and tactile sensing

Lightweight robotic grasping detection network based on dual attention and inverted residual

Antipodal-Points-aware Dual-decoding Network for Robotic Visual Grasp Detection Oriented to Multi-object Clutter Scenes

HMT-Grasp: A Hybrid Mamba-Transformer Approach for Robot Grasping in Cluttered Environments

[A clinical study on transitional cell carcinoma of the renal pelvis and ureter].

A robot grasping detection network based on flexible selection of multi-modal feature fusion structure

Real-Time, Highly Accurate Robotic Grasp Detection using Fully Convolutional Neural Networks with High-Resolution Images

GR-ConvNet v2: A Real-Time Multi-Grasp Detection Network for Robotic Grasping