Abstract:In order to better solve the visual detection problem of manipulator grasping non-cooperative targets, we propose a method of grasp pose detection based on pixel point and feature fusion. By using the improved U2net network as the backbone for feature extraction and feature fusion of the input image, and the grasp prediction layer detects the grasp pose on each pixel. In order to adapt the U2net to grasp pose detection and improve its detection performance, we improve detection speed and control sampling depth by simplifying its network structure, while retaining some shallow features in feature fusion to enhance its feature extraction capability. We introduce depthwise separable convolution in the grasp prediction layer, further fusing the features extracted from the backbone to obtain predictive feature maps with stronger feature expressiveness. FocalLoss is selected as the loss function to solve the problem of unbalanced positive and negative samples in network training. We use the Cornell dataset for training and testing, perform pixel-level labeling on the image, and replace the labels that are not conducive to the actual grasping. This adaptation helps the dataset better suit the network training and testing while meeting the real-world grasping requirements of the manipulator. The evaluation results on image-wise and object-wise are 95.65% and 91.20% respectively, and the detection speed is 0.007 s/frame. We also used the method for actual manipulator grasping experiments. The results show that our method has improved accuracy and speed compared with previous methods, and has strong generalization ability and portability.

A Stable Grasping Method for Robotic Manipulator Based on Visual Detection

LiteGrasp: A Light Robotic Grasp Detection Via Semi-Supervised Knowledge Distillation

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Visual Servo Kinematic Control For Robotic Manipulators

Incremental Visual Servo Control of Robotic Manipulator for Autonomous Capture of Non-Cooperative Target

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Robotic Object Recognition And Grasping With A Natural Background

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

Robot grasping system based on deep learning target detection

A Self-Supervised Learning Manipulator Grasping Approach Based on Instance Segmentation.

Design of a Tactile Sensing Robotic Gripper and Its Grasping Method

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Kinect-based Object Grasping by Manipulator

A grasping posture estimation method based on 3D detection network

RGBD Object Recognition and Flat Area Analysis Method for Manipulator Grasping

Autonomous Robotic Manipulation: Real-Time, Deep-Learning Approach for Grasping of Unknown Objects

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

Detection Method of Manipulator Grasp Pose Based on RGB-D Image

Non-cooperative Target Localization and Grasp Based on Visual Closed Loop

Bayesian Grasp: Robotic visual stable grasp based on prior tactile knowledge

Real-Time Robotic Multigrasp Detection Using Anchor-Free Fully Convolutional Grasp Detector