Abstract:Autonomous robotic grasping is an essential skill for service robots to perform specified tasks in unstructured scenarios. Previous work focus on simple pick-and-place tasks, and it is not satisfactory for real-world scenes that have requirements for manipulation. In this paper, we present a modular intelligent robot architecture via multi-task convolutional neural network which can be used for specific object grasping and manipulation in a stacked and cluttered environment. Firstly, an end-to-end, multi-task semantic grasping convolutional neural network (MSG-ConvNet) that simultaneously outputs the results of grasp detection and semantic segmentation is proposed to recognize the affiliations between objects and grasps in cluttered scenarios. Secondly, we propose a post-processing method which allows the robot to select an optimal grasping area in an active perception way through simply reasoning on the multi-modal information output by the proposed model. The proposed multi-task network has a great improvement in both recognition accuracy and detection speed on the public multi-object dataset GraspNet-1Billion compared with the benchmark. The proposed grasp detection method also yields state-of-the-art performance with accuracies of 95.06% and 98.6% on the public single-object Jacquard Dataset and Cornell Dataset, respectively. In addition, the experiments in a real-world scene demonstrate that our proposed method has stronger robustness and adaptability than the simple direct grasping strategy in the environment with higher mutual occlusion.

Robot Grasping Detection in Object Overlapping Scenes Based on Multi-Stage ROI Extraction

RoI-based Robotic Grasp Detection in Object Overlapping Scenes Using Convolutional Neural Network.

Robotic Grasping in Multi-Object Stacking Scenes Based on Visual Reasoning

Secure Grasping Detection of Objects in Stacked Scenes Based on Single-Frame RGB Images

A Practical Multi-Stage Grasp Detection Method for Kinova Robot in Stacked Environments

A two-stage grasp detection method for sequential robotic grasping in stacking scenarios

A Semantic Robotic Grasping Framework Based on Multi-Task Learning in Stacking Scenes.

Keypoint-Based Robotic Grasp Detection Scheme in Multi-Object Scenes

Robotic Grasping Method Based on 3D Vision for Stacked Rectangular Objects

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Residual Squeeze-and-Excitation Network with Multi-scale Spatial Pyramid Module for Fast Robotic Grasping Detection

Task-Oriented Grasping In Object Stacking Scenes With Crf-Based Semantic Model

MTGrasp: Multiscale 6-Dof Robotic Grasp Detection

GoalGrasp: Grasping Goals in Partially Occluded Scenarios without Grasp Training

A Novel Vision-Based Multi-Task Robotic Grasp Detection Method for Multi-Object Scenes

Object Pose Estimation for Robotic Grasping based on Multi-view Keypoint Detection

Multitarget Flexible Grasping Detection Method for Robots in Unstructured Environments

Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network

A Multi-Scale Robotic Tool Grasping Method for Robot State Segmentation Masks

Object Detection Method for Grasping Robot Based on Improved YOLOv5

A Multi-task Convolutional Neural Network for Autonomous Robotic Grasping in Object Stacking Scenes