Abstract:Using robots to replace manual production has been seen as a feasible solution to reduce production costs and increase productivity, especially in the 3C (Computer, Communication, and Consumer Electronics) products assembly lines, which rely heavily on labor. Due to the characteristic of small size and accurate fitting precision, small uncertainties in the assembly process will lead to the failure of the assembly, especially in the process of grasping, when the gripper needs to move to a certain position. So, to realize the 3C products flexible assembly of the robot, machine vision is required to provide the high-precision pose information of the object. So far, point cloud based 6D (6-dimensional) pose estimation algorithms have attracted the attention of many researchers because point cloud can provide three-dimensional information directly. However, the disorder of the point cloud and the background information with miscellaneous noise makes it impossible to directly estimate the pose of the target object with high precision. To deal with this problem, we propose a 2D-3D combined high-precision pose estimation method. The whole method is divided into two stages. In the first stage, the mask of the object in the 2D image is identified through the Mask R-CNN which is trained through fine-turning. In the second stage, we use a structured light camera to generate the point cloud and map the mask to it to extract useful point cloud, then the high-precision pose estimating algorithm composed by PCA-ICP is used to get the global pose of the part. Finally, the pose is converted to the robot coordinate frame by the result of hand-eye calibration. The proposed method is verified by the grasping and assembly experiments.

Semantic Part Segmentation Method Based 3D Object Pose Estimation with RGB-D Images for Bin-Picking

6D Pose Estimation Method of Metal Parts for Robotic Grasping Based on Semantic-Level Line Matching

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

Deep Learning Based 6D Pose Estimation for Bin-Picking Using 3D Point Clouds

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

RGB-D-Based Pose Estimation of Workpieces with Semantic Segmentation and Point Cloud Registration

Bin-picking of novel objects through category-agnostic-segmentation: RGB matters

Semantic Segmentation and 6DoF Pose Estimation using RGB-D Images and Deep Neural Networks

Realtime 3D Reconstruction at Scale and Object Pose Estimation for Bin Picking System.

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

AttentionVote: A Coarse-to-fine Voting Network of Anchor-Free 6D Pose Estimation on Point Cloud for Robotic Bin-Picking Application

Picking from Clutter: An Object Segmentation Method for Robot Grasping.

Recognition and Pose Estimation Method for Random Bin Picking Considering Incomplete Point Cloud Scene

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Domain-Generalized Robotic Picking Via Contrastive Learning-Based 6-D Pose Estimation

A Pose Estimation Approach Based on Keypoints Detection for Robotic Bin-picking Application

Object Pose Estimation from RGB-D Images with Affordance-Instance Segmentation Constraint for Semantic Robot Manipulation

High-Precision Pose Estimation Method of the 3C Parts by Combining 2D and 3D Vision for Robotic Grasping in Assembly Applications.