Abstract:Industrial Cyber Physical Systems can use data and information gained from across a variety of different environments to enable robots that are reconfigurable. Custom grasping is a basic operation a robot must be able to carry out for a given task, i.e., finding the best grasping point for emergent behaviors. However, environmental disturbance and limited data degrade the precision and speed of many tailored machine learning models on robot grasping detection. This paper proposes a region-based method to enable fast custom grasping through fewer RGB-D data. The grasping detection problem is simplified as a two-stage prediction problem. At the first stage, a robust grasp candidate generation strategy is proposed based on the Sobel operator. At the second stage, a region-based predictor is designed to locate the best grasping point-pair for an emergent task. The predictor is trained by a modified consistency based self-training method to realize semi-supervised learning. Experimental results show that the success rate of custom grasping of new emergent object can be increased by 3.4% on average using the proposed method. By introducing data augmentation strategies in training, the success rate is further increased by 9.2% on average. A robot is able to grasp new object with 91.5% success rate using less than 100 training samples. The number of training samples required for the proposed method is less than to 1% of which for the previous works. Note to Practitioners—This research was motivated by the problem of robot reconfigurability for various industrial automation processes and focuses mainly on the recognition of grasping point-pair of emergent object for different task. Existing approaches on robotic grasping detection are tailored to a given object and require expensive training with large amount of labeled data. This paper presents a region-based few shot learning approach that enables the robot to detect the best grasping point-pair autonomously and quickly. We show how to generate candidate point-pairs with image distortion and background disturbance. We then demonstrate how the best grasping point-pair can be located with much less training cost. Experiments suggest that this approach is feasible in robot automation for handling a class of objects. In future research, we will construct behavior learning module to enable evolving cyber-physical robotic system for more purposes.

Multitarget Flexible Grasping Detection Method for Robots in Unstructured Environments

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

A robot grasping detection network based on flexible selection of multi-modal feature fusion structure

Robot Dynamic Object Positioning and Grasping Method Based on Two Stages

A grasping posture estimation method based on 3D detection network

A Visual Detection and Grasping Method Based on Deep Learning

Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network

Robot grasping system based on deep learning target detection

Enhancement ofreal-timegrasp detection by cascaded deep convolutional neural networks

Robotic Grasping in Multi-Object Stacking Scenes Based on Visual Reasoning

A Semantic Robotic Grasping Framework Based on Multi-Task Learning in Stacking Scenes.

Robotic Grasp Detection Network Based on Improved Deformable Convolution and Spatial Feature Center Mechanism

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

A Robot Grasping System With Single-Stage Anchor-Free Deep Grasp Detector

Robotic Grasping of Novel Objects from RGB-D Images by Using Multi-Level Convolutional Neural Networks

An Efficient Grasp Pose Detection Method Based on Point-PN

A Novel Vision-Based Multi-Task Robotic Grasp Detection Method for Multi-Object Scenes

Custom Grasping: A Region-Based Robotic Grasping Detection Method in Industrial Cyber-Physical Systems

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

Real-Time Robotic Multigrasp Detection Using Anchor-Free Fully Convolutional Grasp Detector