Abstract:Industrial bin picking is a challenging task as lots of highly reflective and textureless objects are stacked. Previous methods generally predict gripper configurations or 6D object pose by expensive industrial 3D camera, ignoring the role of consumer-grade RGB-D cameras in this task. For highly reflective objects, depth maps of consumer-grade RGB-D cameras are generally of a lower quality with much stronger noise, making it challenging to detect robust grasp poses in stacked industrial scenarios. To address these challenges, we propose a novel grasp detection framework including a synthetic data generation pipeline, a novel local grasp detection method, and a global search algorithm. Specifically, in the training phase, we utilize the Pybullet and OpenGL to generate synthetic data by approximate 3D models. We introduce a novel grasp representation and propose MixStyle-ResUnet to predict and achieve sim2real transfer for this representation. In the testing phase, the Object Singleness Metric (OSM) is proposed for the global search block to evaluate the graspable probability. In addition, the RGB image enhanced by edge feature is utilized as the input of the network, which can bridge the domain shift. Extensive experiments in real scenes demonstrate that our method can achieve competitive results in grasping disordered metal parts. In over 2400 robotic grasp trials, our method achieves an average success rate of 91.1% in dense stack scenarios. We also confirm that the proposed method can be applied to unseen objects which are not included in the training dataset. Code and videos are available at https://github.com/sunhan1997/IndusGrasp.

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Pick2Place: Task-aware 6DoF Grasp Estimation via Object-Centric Perspective Affordance

A Self-Supervised Learning-Based 6-DOF Grasp Planning Method for Manipulator

Efficient End-to-End Detection of 6-DoF Grasps for Robotic Bin Picking

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Semantic Part Segmentation Method Based 3D Object Pose Estimation with RGB-D Images for Bin-Picking

A Novel Robotic Grasp Detection Framework Using Low-Cost RGB-D Camera for Industrial Bin Picking

Robot Dynamic Object Positioning and Grasping Method Based on Two Stages

Visual Reconstruction and Localization-Based Robust Robotic 6-Dof Grasping in the Wild

A Semantic Robotic Grasping Framework Based on Multi-Task Learning in Stacking Scenes.

Unseen Object Few-Shot Semantic Segmentation for Robotic Grasping

Robotic Grasping Method with 6D Pose Estimation and Point Cloud Fusion

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching

A Vision-based Robot Grasping System

Robotic Grasping Method Based on 3D Vision for Stacked Rectangular Objects

FunctionalGrasp: Learning Functional Grasp for Robots Via Semantic Hand-Object Representation

6-DOF Grasp Planning of Manipulator Combined with Self-Supervised Learning

Monocular Vision Based 6D Object Localization for Service Robot's Intelligent Grasping