Abstract:Purpose This paper aims to propose an identification method based on monocular vision for cylindrical parts in cluttered scene, which solves the issue that iterative closest point (ICP) algorithm fails to obtain global optimal solution, as the deviation from scene point cloud to target CAD model is huge in nature. Design/methodology/approach The images of the parts are captured at three locations by a camera amounted on a robotic end effector to reconstruct initial scene point cloud. Color signatures of histogram of orientations (C-SHOT) local feature descriptors are extracted from the model and scene point cloud. Random sample consensus (RANSAC) algorithm is used to perform the first initial matching of point sets. Then, the second initial matching is conducted by proposed remote closest point (RCP) algorithm to make the model get close to the scene point cloud. Levenberg Marquardt (LM)-ICP is used to complete fine registration to obtain accurate pose estimation. Findings The experimental results in bolt-cluttered scene demonstrate that the accuracy of pose estimation obtained by the proposed method is higher than that obtained by two other methods. The position error is less than 0.92 mm and the orientation error is less than 0.86°. The average recognition rate is 96.67 per cent and the identification time of the single bolt does not exceed 3.5 s. Practical implications The presented approach can be applied or integrated into automatic sorting production lines in the factories. Originality/value The proposed method improves the efficiency and accuracy of the identification and classification of cylindrical parts using a robotic arm.

Recognition and Pose Estimation Method for Random Bin Picking Considering Incomplete Point Cloud Scene

ContourPose: Monocular 6D Pose Estimation Method for Reflective Texture-Less Metal Parts

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

Deep Learning Based 6D Pose Estimation for Bin-Picking Using 3D Point Clouds

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

Automatic Identification and Autonomous Sorting of Cylindrical Parts in Cluttered Scene Based on Monocular Vision 3D Reconstruction

Detect in RGB, Optimize in Edge: Accurate 6D Pose Estimation for Texture-less Industrial Parts

Fast and Accurate Pose Estimation for Industrial Workpieces Robotic Picking

6D Pose Estimation for Texture-Less Industrial Parts in the Crowd

Fast and precise 6D pose estimation of textureless objects using the point cloud and gray image

Efficient 3D Object Recognition for Unadjusted Bin Picking Automation

3D pose estimation for bin-picking task using convex hull

RGB-D-Based Pose Estimation of Workpieces with Semantic Segmentation and Point Cloud Registration

Speedup 3-D Texture-Less Object Recognition Against Self-Occlusion for Intelligent Manufacturing

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

Recognition and Pose Estimation of Auto Parts for an Autonomous Spray Painting Robot

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

Point cloud segmentation of 3D scattered parts sampled by RealSense

Pose Estimation of Sheet Stampings Based on Point Pair Features