Abstract:We propose a fast and accurate method of 6D object pose estimation for bin-picking of mechanical parts by a robot manipulator. We extend the single-shot approach to stereo vision by application of attention architecture. Our convolutional neural network model regresses to object locations and rotations from either a left image or a right image without depth information. Then, a stereo feature matching module, designated as Stereo Grid Attention, generates stereo grid matching maps. The important point of our method is only to calculate disparity of the objects found by the attention from stereo images, instead of calculating a point cloud over the entire image. The disparity value is then used to calculate the depth to the objects by the principle of triangulation. Our method also achieves a rapid processing speed of pose estimation by the single-shot architecture and it is possible to process a 1024 x 1024 pixels image in 75 milliseconds on the Jetson AGX Xavier implemented with half-float model. Weakly textured mechanical parts are used to exemplify the method. First, we create original synthetic datasets for training and evaluating of the proposed model. This dataset is created by capturing and rendering numerous 3D models of several types of mechanical parts in virtual space. Finally, we use a robotic manipulator with an electromagnetic gripper to pick up the mechanical parts in a cluttered state to verify the validity of our method in an actual scene. When a raw stereo image is used by the proposed method from our stereo camera to detect black steel screws, stainless screws, and DC motor parts, i.e., cases, rotor cores and commutator caps, the bin-picking tasks are successful with 76.3%, 64.0%, 50.5%, 89.1% and 64.2% probability, respectively.

Stereo Vision Based Single-Shot 6D Object Pose Estimation for Bin-Picking by a Robot Manipulator

Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

6D Pose Estimation Method of Metal Parts for Robotic Grasping Based on Semantic-Level Line Matching

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

Object 6DoF Pose Estimation for Power Grid Manipulating Robots.

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

A RGB-D Based 6D Object Pose Estimation and Its Application in Robotic Grasping

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

Semantic Part Segmentation Method Based 3D Object Pose Estimation with RGB-D Images for Bin-Picking

Pose Estimation of a Cobot Implemented on a Small AI-Powered Computing System and a Stereo Camera for Precision Evaluation

Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

Deep Learning Based 6D Pose Estimation for Bin-Picking Using 3D Point Clouds

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Semantic Segmentation and 6DoF Pose Estimation using RGB-D Images and Deep Neural Networks

Multi-View Keypoints for Reliable 6D Object Pose Estimation

Probabilistic Multi-View Fusion of Active Stereo Depth Maps for Robotic Bin-Picking

Vision-guided Robot System for Picking Objects by Casting Shadows

AttentionVote: A Coarse-to-fine Voting Network of Anchor-Free 6D Pose Estimation on Point Cloud for Robotic Bin-Picking Application

Single-Camera Multi-View 6DoF pose estimation for robotic grasping

PS6D: Point Cloud Based Symmetry-Aware 6D Object Pose Estimation in Robot Bin-Picking