Abstract:Our way of grasping objects is challenging for efficient, intelligent and optimal grasp by COBOTs. To streamline the process, here we use deep learning techniques to help robots learn to generate and execute appropriate grasps quickly. We developed a Generative Inception Neural Network (GI-NNet) model, capable of generating antipodal robotic grasps on seen as well as unseen objects. It is trained on Cornell Grasping Dataset (CGD) and attained 98.87% grasp pose accuracy for detecting both regular and irregular shaped objects from RGB-Depth (RGB-D) images while requiring only one third of the network trainable parameters as compared to the existing approaches. However, to attain this level of performance the model requires the entire 90% of the available labelled data of CGD keeping only 10% labelled data for testing which makes it vulnerable to poor generalization. Furthermore, getting sufficient and quality labelled dataset is becoming increasingly difficult keeping in pace with the requirement of gigantic networks. To address these issues, we attach our model as a decoder with a semi-supervised learning based architecture known as Vector Quantized Variational Auto Encoder (VQVAE), which works efficiently when trained both with the available labelled and unlabelled data. The proposed model, which we name as Representation based GI-NNet (RGI-NNet), has been trained with various splits of label data on CGD with as minimum as 10% labelled dataset together with latent embedding generated from VQVAE up to 50% labelled data with latent embedding obtained from VQVAE. The performance level, in terms of grasp pose accuracy of RGI-NNet, varies between 92.13% to 95.6% which is far better than several existing models trained with only labelled dataset. For the performance verification of both GI-NNet and RGI-NNet models, we use Anukul (Baxter) hardware cobot.

VGQ-CNN: Moving Beyond Fixed Cameras and Top-Grasps for Grasp Quality Prediction

GVGNet: Gaze-Directed Visual Grounding for Learning Under-Specified Object Referring Intention

GR-ConvNet v2: A Real-Time Multi-Grasp Detection Network for Robotic Grasping

Volumetric Grasping Network: Real-time 6 DOF Grasp Detection in Clutter

GraspVDN: scene-oriented grasp estimation by learning vector representations of grasps

KGNet: Knowledge-Guided Networks for Category-Level 6D Object Pose and Size Estimation.

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

GI-NNet \& RGI-NNet: Development of Robotic Grasp Pose Models, Trainable with Large as well as Limited Labelled Training Datasets, under supervised and semi supervised paradigms

Grasping Complex-Shaped and Thin Objects Using a Generative Grasping Convolutional Neural Network

DVGG: Deep Variational Grasp Generation for Dextrous Manipulation

Fully Convolutional Grasp Detection Network with Oriented Anchor Box

GP-Net: A Lightweight Generative Convolutional Neural Network with Grasp Priority

A pixel-level grasp detection method based on Efficient Grasp Aware Network

Deep Reinforcement Learning Enhanced Convolutional Neural Networks for Robotic Grasping

Light-Weight Convolutional Neural Networks for Generative Robotic Grasping

Vision-Based Intelligent Robot Grasping Using Sparse Neural Network

VMGNet: A Low Computational Complexity Robotic Grasping Network Based on VMamba with Multi-Scale Feature Fusion

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

FastGNet: An Efficient 6-DOF Grasp Detection Method with Multi-Attention Mechanisms and Point Transformer Network

Robotic Grasping of Novel Objects from RGB-D Images by Using Multi-Level Convolutional Neural Networks

Constrained Generative Sampling of 6-DoF Grasps