Abstract:In order to better solve the visual detection problem of manipulator grasping non-cooperative targets, we propose a method of grasp pose detection based on pixel point and feature fusion. By using the improved U2net network as the backbone for feature extraction and feature fusion of the input image, and the grasp prediction layer detects the grasp pose on each pixel. In order to adapt the U2net to grasp pose detection and improve its detection performance, we improve detection speed and control sampling depth by simplifying its network structure, while retaining some shallow features in feature fusion to enhance its feature extraction capability. We introduce depthwise separable convolution in the grasp prediction layer, further fusing the features extracted from the backbone to obtain predictive feature maps with stronger feature expressiveness. FocalLoss is selected as the loss function to solve the problem of unbalanced positive and negative samples in network training. We use the Cornell dataset for training and testing, perform pixel-level labeling on the image, and replace the labels that are not conducive to the actual grasping. This adaptation helps the dataset better suit the network training and testing while meeting the real-world grasping requirements of the manipulator. The evaluation results on image-wise and object-wise are 95.65% and 91.20% respectively, and the detection speed is 0.007 s/frame. We also used the method for actual manipulator grasping experiments. The results show that our method has improved accuracy and speed compared with previous methods, and has strong generalization ability and portability.

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

Detection Method of Manipulator Grasp Pose Based on RGB-D Image

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

Robotic Grasp Detection Network Based on Improved Deformable Convolution and Spatial Feature Center Mechanism

A robot grasping detection network based on flexible selection of multi-modal feature fusion structure

Real-Time, Highly Accurate Robotic Grasp Detection using Fully Convolutional Neural Networks with High-Resolution Images

Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

Lightweight robotic grasping detection network based on dual attention and inverted residual

Bilateral Cross-Modal Fusion Network for Robot Grasp Detection

Robotic Grasp Detection Using Structure Prior Attention and Multiscale Features

A grasping posture estimation method based on 3D detection network

Deep learning for detecting robotic grasps

Robotic Grasping Technology Integrating Large Kernel Convolution and Residual Connections

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

A Vision-based Robot Grasping System

Manipulator grabbing position detection with information fusion of color image and depth image using deep learning

A Real-Time Grasping Detection Network Architecture for Various Grasping Scenarios

A Robotic Semantic Grasping Method for Pick-and-place Tasks

A Robotic Grasping Algorithm Based on Simplified Image and Deep Convolutional Neural Network