Abstract:Using robots to replace manual production has been seen as a feasible solution to reduce production costs and increase productivity, especially in the 3C (Computer, Communication, and Consumer Electronics) products assembly lines, which rely heavily on labor. Due to the characteristic of small size and accurate fitting precision, small uncertainties in the assembly process will lead to the failure of the assembly, especially in the process of grasping, when the gripper needs to move to a certain position. So, to realize the 3C products flexible assembly of the robot, machine vision is required to provide the high-precision pose information of the object. So far, point cloud based 6D (6-dimensional) pose estimation algorithms have attracted the attention of many researchers because point cloud can provide three-dimensional information directly. However, the disorder of the point cloud and the background information with miscellaneous noise makes it impossible to directly estimate the pose of the target object with high precision. To deal with this problem, we propose a 2D-3D combined high-precision pose estimation method. The whole method is divided into two stages. In the first stage, the mask of the object in the 2D image is identified through the Mask R-CNN which is trained through fine-turning. In the second stage, we use a structured light camera to generate the point cloud and map the mask to it to extract useful point cloud, then the high-precision pose estimating algorithm composed by PCA-ICP is used to get the global pose of the part. Finally, the pose is converted to the robot coordinate frame by the result of hand-eye calibration. The proposed method is verified by the grasping and assembly experiments.

A grasping posture estimation method based on 3D detection network

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

Multitarget Flexible Grasping Detection Method for Robots in Unstructured Environments

Grasping Pose Detection for Loose Stacked Object Based on Convolutional Neural Network with Multiple Self-Powered Sensors Information

High-Precision Pose Estimation Method of the 3C Parts by Combining 2D and 3D Vision for Robotic Grasping in Assembly Applications.

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

UPG: 3D Vision-Based Prediction Framework for Robotic Grasping in Multi-Object Scenes.

A Grasp Pose Detection Network Based on the DeepLabv3+Semantic Segmentation Model

A Vision-based Robot Grasping System

Robotic Grasping Method Based on 3D Vision for Stacked Rectangular Objects

Robot Dynamic Object Positioning and Grasping Method Based on Two Stages

A Method for Estimating an Unknown Target Grasping Pose Based on Keypoint Detection

An Efficient Grasp Pose Detection Method Based on Point-PN

A Visual Detection and Grasping Method Based on Deep Learning

Robotic Grasping of Novel Objects from RGB-D Images by Using Multi-Level Convolutional Neural Networks

Detection-driven 3D masking for efficient object grasping

Two-stage Grasp Detection Method for Robotics Using Point Clouds and Deep Hierarchical Feature Learning Network

A Real-Time Grasping Detection Network Architecture for Various Grasping Scenarios