Abstract:Grasping detection from single images in robotic applications poses a significant challenge. While contemporary deep learning techniques excel, their success often hinges on large annotated datasets and intricate network architectures. In this letter, we present LiteGrasp, a novel semi-supervised lightweight framework purpose-built for grasp detection, eliminating the necessity for exhaustive supervision and intricate networks. Our approach uses a limited amount of labeled data via a knowledge distillation method, introducing HRGrasp-Net, a model with high efficiency for extracting features and largely based on HRNet. We incorporate pseudo-label filtering within a mutual learning model set within a teacher-student paradigm. This enhances the transference of data from images with labels to those without. Additionally, we introduce the streamlined Lite HRGrasp-Net, acting as the student network which gains further distillation knowledge using a multi-level fusion cascade originating from HRGrasp-Net. Impressively, LiteGrasp thrives with just a fraction (4.3%) of HRGrasp-Net's original model size, and with limited labeled data relative to total data (25% ratio) across all benchmarks, regularly outperforming solely supervised and semi-supervised models. Taking just 6 ms for execution, LiteGrasp showcases exceptional accuracy (99.99% and 97.21% on Cornell and Jacquard data sets respectively), as well as an impressive 95.3% rate of success in grasping when deployed using a 6DoF UR5e robotic arm. These highlights underscore the effectiveness and efficiency of LiteGrasp for grasp detection, even under resource-limited conditions.

Grasping Detection Based on YOLOv3 Algorithm

YOLO-Based 3D Perception for UVMS Grasping

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

Object Detection Method for Grasping Robot Based on Improved YOLOv5

Robot grasping system based on deep learning target detection

A grasping posture estimation method based on 3D detection network

Secure Grasping Detection of Objects in Stacked Scenes Based on Single-Frame RGB Images

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Keypoint-Based Robotic Grasp Detection Scheme in Multi-Object Scenes

Object Detection Algorithm Based on Improved YOLOv3

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

Object Detection Based on Deep Learning and B-Spline Level Set in Color Images

Object Recognition and Grasping for Collaborative Robots Based on Vision

A neural learning approach for simultaneous object detection and grasp detection in cluttered scenes

A YOLO-GGCNN based grasping framework for mobile robots in unknown environments

Deep Vision Networks for Real-Time Robotic Grasp Detection

YOLO V5-MAX: A Multi-object Detection Algorithm in Complex Scenes

MGBM-YOLO: a Faster Light-Weight Object Detection Model for Robotic Grasping of Bolster Spring Based on Image-Based Visual Servoing

Antipodal-Points-aware Dual-decoding Network for Robotic Visual Grasp Detection Oriented to Multi-object Clutter Scenes

A Real-Time Grasping Detection Network Architecture for Various Grasping Scenarios

Robotic Grasping Detection Algorithm Based on 3D Vision Dual-Stream Encoding Strategy