Abstract:Industrial bin picking is a challenging task as lots of highly reflective and textureless objects are stacked. Previous methods generally predict gripper configurations or 6D object pose by expensive industrial 3D camera, ignoring the role of consumer-grade RGB-D cameras in this task. For highly reflective objects, depth maps of consumer-grade RGB-D cameras are generally of a lower quality with much stronger noise, making it challenging to detect robust grasp poses in stacked industrial scenarios. To address these challenges, we propose a novel grasp detection framework including a synthetic data generation pipeline, a novel local grasp detection method, and a global search algorithm. Specifically, in the training phase, we utilize the Pybullet and OpenGL to generate synthetic data by approximate 3D models. We introduce a novel grasp representation and propose MixStyle-ResUnet to predict and achieve sim2real transfer for this representation. In the testing phase, the Object Singleness Metric (OSM) is proposed for the global search block to evaluate the graspable probability. In addition, the RGB image enhanced by edge feature is utilized as the input of the network, which can bridge the domain shift. Extensive experiments in real scenes demonstrate that our method can achieve competitive results in grasping disordered metal parts. In over 2400 robotic grasp trials, our method achieves an average success rate of 91.1% in dense stack scenarios. We also confirm that the proposed method can be applied to unseen objects which are not included in the training dataset. Code and videos are available at https://github.com/sunhan1997/IndusGrasp.

Combining RGB and Points to Predict Grasping Region for Robotic Bin-Picking

Suction Grasp Region Prediction Using Self-supervised Learning for Object Picking in Dense Clutter

Efficient Fully Convolutional Network and Optimization Approach for Robotic Grasping Detection Based on RGB-D Images

RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

Robotic Grasping of Novel Objects from RGB-D Images by Using Multi-Level Convolutional Neural Networks

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

Bin-picking of novel objects through category-agnostic-segmentation: RGB matters

A Novel Robotic Grasp Detection Framework Using Low-Cost RGB-D Camera for Industrial Bin Picking

Affordance-Based Grasping Point Detection Using Graph Convolutional Networks for Industrial Bin-Picking Applications

Deep Learning for Picking Point Detection in Dense Cluster

RGB-D-Based Pose Estimation of Workpieces with Semantic Segmentation and Point Cloud Registration

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

Robotic picking in dense clutter via domain invariant learning from synthetic dense cluttered rendering

Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images

PPR-Net: Point-wise Pose Regression Network for Instance Segmentation and 6D Pose Estimation in Bin-picking Scenarios.

6-DoF grasp estimation method that fuses RGB-D data based on external attention

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

Vision-Based Localization Method for Picking Points in Tea-Harvesting Robots

Real-Time Pixel-Wise Grasp Detection Based on RGB-D Feature Dense Fusion