Abstract:We propose a fast and accurate method of 6D object pose estimation for bin-picking of mechanical parts by a robot manipulator. We extend the single-shot approach to stereo vision by application of attention architecture. Our convolutional neural network model regresses to object locations and rotations from either a left image or a right image without depth information. Then, a stereo feature matching module, designated as Stereo Grid Attention, generates stereo grid matching maps. The important point of our method is only to calculate disparity of the objects found by the attention from stereo images, instead of calculating a point cloud over the entire image. The disparity value is then used to calculate the depth to the objects by the principle of triangulation. Our method also achieves a rapid processing speed of pose estimation by the single-shot architecture and it is possible to process a 1024 x 1024 pixels image in 75 milliseconds on the Jetson AGX Xavier implemented with half-float model. Weakly textured mechanical parts are used to exemplify the method. First, we create original synthetic datasets for training and evaluating of the proposed model. This dataset is created by capturing and rendering numerous 3D models of several types of mechanical parts in virtual space. Finally, we use a robotic manipulator with an electromagnetic gripper to pick up the mechanical parts in a cluttered state to verify the validity of our method in an actual scene. When a raw stereo image is used by the proposed method from our stereo camera to detect black steel screws, stainless screws, and DC motor parts, i.e., cases, rotor cores and commutator caps, the bin-picking tasks are successful with 76.3%, 64.0%, 50.5%, 89.1% and 64.2% probability, respectively.

A Variable Photo-Model Method for Object Pose and Size Estimation with Stereo Vision in a Complex Home Scene

Expanded photo-model-based stereo vision pose estimation using a shooting distance unknown photo

Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

Pose Measurement of Non-Cooperative Target Based on Stereo Vision

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

Unseen Object Pose Estimation via Registration

Real-time Pose Tracking of 3D Targets by Photo-Model-based Stereo-Vision

Research on Model-Free 6D Object Pose Estimation Based on Vision 3D Matching.

A Two-Stage Monocular Vision Detection Method for 6D Pose Estimation in Multi-Heterogeneous Robot Systems

Stereo Vision Based Single-Shot 6D Object Pose Estimation for Bin-Picking by a Robot Manipulator

CVAM-Pose: Conditional Variational Autoencoder for Multi-Object Monocular Pose Estimation

Estimation Of 3-D Pose With 2-D Vision Based On Shape Matching Method

A Method of Head Pose Estimation Based on Active Shape Model and Stereo Vision

Object Pose Estimation Based on Stereo Vision with Improvedk‐dtreeicpalgorithm

ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformers

Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimation

Synthetic Depth Image-based Category-Level Object Pose Estimation with Effective Pose Decoupling and Shape Optimization

Flexible Generation-on-demand Multistation for Non-Cooperative 6DOF Pose Measurement

A novel data-driven algorithm for object detection, tracking, distance estimation, and size measurement in stereo vision systems

An Isomap-Eigenanalysis-Regression Pose Estimation Algorithm of Three-Dimentional Object

RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling