Abstract:Industrial bin picking is a challenging task as lots of highly reflective and textureless objects are stacked. Previous methods generally predict gripper configurations or 6D object pose by expensive industrial 3D camera, ignoring the role of consumer-grade RGB-D cameras in this task. For highly reflective objects, depth maps of consumer-grade RGB-D cameras are generally of a lower quality with much stronger noise, making it challenging to detect robust grasp poses in stacked industrial scenarios. To address these challenges, we propose a novel grasp detection framework including a synthetic data generation pipeline, a novel local grasp detection method, and a global search algorithm. Specifically, in the training phase, we utilize the Pybullet and OpenGL to generate synthetic data by approximate 3D models. We introduce a novel grasp representation and propose MixStyle-ResUnet to predict and achieve sim2real transfer for this representation. In the testing phase, the Object Singleness Metric (OSM) is proposed for the global search block to evaluate the graspable probability. In addition, the RGB image enhanced by edge feature is utilized as the input of the network, which can bridge the domain shift. Extensive experiments in real scenes demonstrate that our method can achieve competitive results in grasping disordered metal parts. In over 2400 robotic grasp trials, our method achieves an average success rate of 91.1% in dense stack scenarios. We also confirm that the proposed method can be applied to unseen objects which are not included in the training dataset. Code and videos are available at https://github.com/sunhan1997/IndusGrasp.

Fast UOIS: Unseen Object Instance Segmentation with Adaptive Clustering for Industrial Robotic Grasping

Picking from Clutter: An Object Segmentation Method for Robot Grasping.

RISeg: Robot Interactive Object Segmentation via Body Frame-Invariant Features

Adapting Segment Anything Model for Unseen Object Instance Segmentation

High-quality Unknown Object Instance Segmentation via Quadruple Boundary Error Refinement

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Robot Dynamic Object Positioning and Grasping Method Based on Two Stages

Self-Supervised Instance Segmentation by Grasping

A Fast Feature Points-Based Object Tracking Method For Robot Grasp

Unseen Object Few-Shot Semantic Segmentation for Robotic Grasping

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

Deep instance segmentation and 6D object pose estimation in cluttered scenes for robotic autonomous grasping

Speedup 3-D Texture-Less Object Recognition Against Self-Occlusion for Intelligent Manufacturing

Towards Robust Part-aware Instance Segmentation for Industrial Bin Picking

Fuzzy-Depth Objects Grasping Based on FSG Algorithm and a Soft Robotic Hand

Fast and Accurate Pose Estimation for Industrial Workpieces Robotic Picking

A Novel Robotic Grasp Detection Framework Using Low-Cost RGB-D Camera for Industrial Bin Picking

Multi-scale deep learning and clustering-based tabletop object instance segmentation for robot manipulation

Efficient Heatmap-Guided 6-Dof Grasp Detection in Cluttered Scenes

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation