Abstract:Purpose This paper aims to use fully convolutional network (FCN) to predict pixel-wise antipodal grasp affordances for unknown objects and improve the grasp detection performance through multi-scale feature fusion. Design/methodology/approach A modified FCN network is used as the backbone to extract pixel-wise features from the input image, which are further fused with multi-scale context information gathered by a three-level pyramid pooling module to make more robust predictions. Based on the proposed unify feature embedding framework, two head networks are designed to implement different grasp rotation prediction strategies (regression and classification), and their performances are evaluated and compared with a defined point metric. The regression network is further extended to predict the grasp rectangles for comparisons with previous methods and real-world robotic grasping of unknown objects. Findings The ablation study of the pyramid pooling module shows that the multi-scale information fusion significantly improves the model performance. The regression approach outperforms the classification approach based on same feature embedding framework on two data sets. The regression network achieves a state-of-the-art accuracy (up to 98.9%) and speed (4 ms per image) and high success rate (97% for household objects, 94.4% for adversarial objects and 95.3% for objects in clutter) in the unknown object grasping experiment. Originality/value A novel pixel-wise grasp affordance prediction network based on multi-scale feature fusion is proposed to improve the grasp detection performance. Two prediction approaches are formulated and compared based on the proposed framework. The proposed method achieves excellent performances on three benchmark data sets and real-world robotic grasping experiment.

A Robust Pixel-Wise Prediction Network with Applications to Industrial Robotic Grasping

A Depth Adaptive Feature Extraction and Dense Prediction Network for 6-D Pose Estimation in Robotic Grasping

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

Object Pose Estimation for Robotic Grasping based on Multi-view Keypoint Detection

Real-time Pixel-Wise Grasp Affordance Prediction Based on Multi-Scale Context Information Fusion

A Robotic Semantic Grasping Method for Pick-and-place Tasks

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

A Pose Estimation Approach Based on Keypoints Detection for Robotic Bin-picking Application

Pose Prediction of Textureless Objects for Robot Bin Picking with Deep Learning Approach

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

A Novel Robotic Grasp Detection Framework Using Low-Cost RGB-D Camera for Industrial Bin Picking

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

A RGB-D Based 6D Object Pose Estimation and Its Application in Robotic Grasping

An Efficient Grasp Pose Detection Method Based on Point-PN

A Novel Deep Learning-Based Pose Estimation Method for Robotic Grasping of Axisymmetric Bodies in Industrial Stacked Scenarios

High-performance Pixel-level Grasp Detection Based on Adaptive Grasping and Grasp-aware Network

PointNet++ Grasping: Learning an End-to-end Spatial Grasp Generation Algorithm from Sparse Point Clouds