Abstract:In order to better solve the visual detection problem of manipulator grasping non-cooperative targets, we propose a method of grasp pose detection based on pixel point and feature fusion. By using the improved U2net network as the backbone for feature extraction and feature fusion of the input image, and the grasp prediction layer detects the grasp pose on each pixel. In order to adapt the U2net to grasp pose detection and improve its detection performance, we improve detection speed and control sampling depth by simplifying its network structure, while retaining some shallow features in feature fusion to enhance its feature extraction capability. We introduce depthwise separable convolution in the grasp prediction layer, further fusing the features extracted from the backbone to obtain predictive feature maps with stronger feature expressiveness. FocalLoss is selected as the loss function to solve the problem of unbalanced positive and negative samples in network training. We use the Cornell dataset for training and testing, perform pixel-level labeling on the image, and replace the labels that are not conducive to the actual grasping. This adaptation helps the dataset better suit the network training and testing while meeting the real-world grasping requirements of the manipulator. The evaluation results on image-wise and object-wise are 95.65% and 91.20% respectively, and the detection speed is 0.007 s/frame. We also used the method for actual manipulator grasping experiments. The results show that our method has improved accuracy and speed compared with previous methods, and has strong generalization ability and portability.

Target Segmentation and Pose Estimation for Rapid Grabbing Using Depth Information

Picking from Clutter: An Object Segmentation Method for Robot Grasping.

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Fast and precise 6D pose estimation of textureless objects using the point cloud and gray image

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

Unseen Object Few-Shot Semantic Segmentation for Robotic Grasping

Real-time Sorting of Stacked Objects Using Depth Information

Simulation and Deep Learning on Point Clouds for Robot Grasping

A two-stage grasp detection method for sequential robotic grasping in stacking scenarios

An Efficient and Stable Grasp Planning Method for Stacked Parts

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Six-dimensional Target Pose Estimation for Robot Autonomous Manipulation: Methodology and Verification

Object Discovery and Grasp Detection with a Shared Convolutional Neural Network

Detection Method of Manipulator Grasp Pose Based on RGB-D Image

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

Graspness Discovery in Clutters for Fast and Accurate Grasp Detection

Deep Vision Networks for Real-Time Robotic Grasp Detection

High Precision 6-DoF Grasp Detection in Cluttered Scenes Based on Network Optimization and Pose Propagation

Mask-GD Segmentation Based Robotic Grasp Detection

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network