Abstract:This paper studies the problem of 6D pose estimation, which is practically important in various application scenarios such as robotic-based object grasping, obstacle avoidance in autonomous driving scene, and object integration in mixed reality. However, existing methods suffer from at least one of the five major limitations: dependence on object identification, complex deployment, difficulty in data collection, low accuracy, and incomplete estimation. To overcome the above limitations, this paper proposes an RC6D system, which is the first to estimate 6D poses by fusing RFID and Computer Vision (CV) data with multi-modal deep learning techniques. In RC6D, we first detect 2D keypoints through a deep learning approach. We then propose a novel RFID-CV fusion neural network to predict the depth of the scene, and use the estimated depth information to expand the 2D keypoints to 3D keypoints. Finally, we model the coordinate correspondences between the detected 2D-3D keypoints, which is applied to estimate the 6D pose of the target object. When implementing RC6D, we mainly address the following three technical challenges. (i) To predict 6D poses without using the CAD model, we propose a network architecture for monocular depth estimation. (ii) To train the neural network for 6D pose estimation without time-consuming 6D labeling, we use an unsupervised learning algorithm based on 2D-3D point pair matching. (iii) To detect the subject of the object without identification, we leverage optical flow to restrict the object and RFID to directly obtain its information. The experimental results show that the localization error of RC6D is less than 10 cm with a probability higher than 90:64% and its orientation estimation error is less than 10 degrees with a probability higher than 79:63%. Hence, the proposed RC6D system performs much better than the state-of-the-art related solutions.

Survey on 6D Pose Estimation of Rigid Object

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

6D Pose Estimation of Objects: Recent Technologies and Challenges

ContourPose: Monocular 6D Pose Estimation Method for Reflective Texture-Less Metal Parts

A Survey of 6DoF Object Pose Estimation Methods for Different Application Scenarios

6D pose estimation of 3D objects in scenes with mutual similarities and occlusions

Rigidity-Aware Detection for 6D Object Pose Estimation

Deep Learning-Based Object Pose Estimation: A Comprehensive Survey

Research on Model-Free 6D Object Pose Estimation Based on Vision 3D Matching.

Deep Learning-Based 6-DoF Object Pose Estimation Considering Synthetic Dataset

Point Pair Feature Based 6D Pose Estimation for Robotic Grasping

Six-dimensional Target Pose Estimation for Robot Autonomous Manipulation: Methodology and Verification

A Survey on 3D Hand Pose Estimation: Cameras, Methods, and Datasets

6-D Object Pose Estimation Based on Point Pair Matching for Robotic Grasp Detection

6DOF pose estimation of a 3D rigid object based on edge-enhanced point pair features

6D object pose estimation based on dense convolutional object center voting with improved accuracy and efficiency

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

RC6D: An RFID and CV Fusion System for Real-time 6D Object Pose Estimation

Pose Estimation of Specular and Symmetrical Objects

6D Assembly Pose Estimation by Point Cloud Registration for Robot Manipulation