Abstract:Real-time robotic grasping, supporting a subsequent precise object-in-hand operation task, is a priority target towards highly advanced autonomous systems. However, such an algorithm which can perform sufficiently-accurate grasping with time efficiency is yet to be found. This paper proposes a novel method with a 2-stage approach that combines a fast 2D object recognition using a deep neural network and a subsequent accurate and fast 6D pose estimation based on Point Pair Feature framework to form a real-time 3D object recognition and grasping solution capable of multi-object class scenes. The proposed solution has a potential to perform robustly on real-time applications, requiring both efficiency and accuracy. In order to validate our method, we conducted extensive and thorough experiments involving laborious preparation of our own dataset. The experiment results show that the proposed method scores 97.37% accuracy in 5cm5deg metric and 99.37% in Average Distance metric. Experiment results have shown an overall 62% relative improvement (5cm5deg metric) and 52.48% (Average Distance metric) by using the proposed method. Moreover, the pose estimation execution also showed an average improvement of 47.6% in running time. Finally, to illustrate the overall efficiency of the system in real-time operations, a pick-and-place robotic experiment is conducted and has shown a convincing success rate with 90% of accuracy. This experiment video is available at <a class="link-external link-https" href="https://sites.google.com/view/dl-ppf6dpose/" rel="external noopener nofollow">this https URL</a>.

A Real-Time Robotic Grasping Approach with Oriented Anchor Box

Fully Convolutional Grasp Detection Network with Oriented Anchor Box

A Cascaded Deep Learning Framework for Real-time and Robust Grasp Planning

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Real-Time Robotic Multigrasp Detection Using Anchor-Free Fully Convolutional Grasp Detector

Accurate Robotic Grasp Detection with Angular Label Smoothing

A Visual Detection and Grasping Method Based on Deep Learning

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Enhancement ofreal-timegrasp detection by cascaded deep convolutional neural networks

Deep Vision Networks for Real-Time Robotic Grasp Detection

A Vision-based Robot Grasping System

A Real-Time Grasping Detection Network Architecture for Various Grasping Scenarios

Robotic Grasping in Multi-Object Stacking Scenes Based on Visual Reasoning

High-performance Pixel-level Grasp Detection Based on Adaptive Grasping and Grasp-aware Network

Accurate grasp detection learning using oriented regression loss

A Robot Grasping System With Single-Stage Anchor-Free Deep Grasp Detector

RoI-based Robotic Grasp Detection in Object Overlapping Scenes Using Convolutional Neural Network.

RPRG: Toward Real-time Robotic Perception, Reasoning and Grasping with One Multi-task Convolutional Neural Network.

A grasping posture estimation method based on 3D detection network

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks