Abstract:In order to better solve the visual detection problem of manipulator grasping non-cooperative targets, we propose a method of grasp pose detection based on pixel point and feature fusion. By using the improved U2net network as the backbone for feature extraction and feature fusion of the input image, and the grasp prediction layer detects the grasp pose on each pixel. In order to adapt the U2net to grasp pose detection and improve its detection performance, we improve detection speed and control sampling depth by simplifying its network structure, while retaining some shallow features in feature fusion to enhance its feature extraction capability. We introduce depthwise separable convolution in the grasp prediction layer, further fusing the features extracted from the backbone to obtain predictive feature maps with stronger feature expressiveness. FocalLoss is selected as the loss function to solve the problem of unbalanced positive and negative samples in network training. We use the Cornell dataset for training and testing, perform pixel-level labeling on the image, and replace the labels that are not conducive to the actual grasping. This adaptation helps the dataset better suit the network training and testing while meeting the real-world grasping requirements of the manipulator. The evaluation results on image-wise and object-wise are 95.65% and 91.20% respectively, and the detection speed is 0.007 s/frame. We also used the method for actual manipulator grasping experiments. The results show that our method has improved accuracy and speed compared with previous methods, and has strong generalization ability and portability.

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

A New Robotic Grasp Detection Method Based on RGB-D Deep Fusion.

Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

Edge-Dependent Efficient Grasp Rectangle Search in Robotic Grasp Detection

Deep learning for detecting robotic grasps

DSC-GraspNet: A Lightweight Convolutional Neural Network for Robotic Grasp Detection

Lightweight Pixel-Wise Generative Robot Grasping Detection Based on RGB-D Dense Fusion

Robust Robot Grasp Detection in Multimodal Fusion

Real-Time, Highly Accurate Robotic Grasp Detection using Fully Convolutional Neural Networks with High-Resolution Images

Robotic Grasping of Novel Objects from RGB-D Images by Using Multi-Level Convolutional Neural Networks

Detection Method of Manipulator Grasp Pose Based on RGB-D Image

Real-Time Pixel-Wise Grasp Detection Based on RGB-D Feature Dense Fusion

Cascaded Feature Fusion Grasping Network for Real-Time Robotic Systems

A pixel-level grasp detection method based on Efficient Grasp Aware Network

Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network

Deep Vision Networks for Real-Time Robotic Grasp Detection