Abstract:The 6D pose estimation using RGBD images plays a pivotal role in robotics applications. At present, after obtaining the RGB and depth modality information, most methods directly concatenate them without considering information interactions. This leads to the low accuracy of 6D pose estimation in occlusion and illumination changes. To solve this problem, we propose a new method to fuse RGB and depth modality features. Our method effectively uses individual information contained within each RGBD image modality and fully integrates cross-modality interactive information. Specifically, we transform depth images into point clouds, applying the PointNet++ network to extract point cloud features; RGB image features are extracted by CNNs and attention mechanisms are added to obtain context information within the single modality; then, we propose a cross-modality feature fusion module (CFFM) to obtain the cross-modality information, and introduce a feature contribution weight training module (CWTM) to allocate the different contributions of the two modalities to the target task. Finally, the result of 6D object pose estimation is obtained by the final cross-modality fusion feature. By enabling information interactions within and between modalities, the integration of the two modalities is maximized. Furthermore, considering the contribution of each modality enhances the overall robustness of the model. Our experiments indicate that the accuracy rate of our method on the LineMOD dataset can reach 96.9%, on average, using the ADD (-S) metric, while on the YCB-Video dataset, it can reach 94.7% using the ADD-S AUC metric and 96.5% using the ADD-S score (<2 cm) metric.

Fundamental Coordinate Space for Object 6D Pose Estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Direct Alignment with Generalized Correspondences: A Unified Framework for Structure-Based Visual Pose Estimation.

Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

Learning Symmetry-Aware Geometry Correspondences for 6D Object Pose Estimation

SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variations

Resolving Symmetry Ambiguity in Correspondence-based Methods for Instance-level Object Pose Estimation

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

OCSKB: An Object Component Sketch Knowledge Base for Fast 6D Pose Estimation

6D object pose estimation based on dense convolutional object center voting with improved accuracy and efficiency

Spatial Feature Mapping for 6DoF Object Pose Estimation

HFE-Net: Hierarchical Feature Extraction and Coordinate Conversion of Point Cloud for Object 6D Pose Estimation

Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wild

SS-Pose: Self-Supervised 6-D Object Pose Representation Learning Without Rendering

CosyPose: Consistent multi-view multi-object 6D pose estimation

Exploring Multiple Geometric Representations for 6DoF Object Pose Estimation

An Iterative Attention Fusion Network for 6D Object Pose Estimation

Homologous multimodal fusion network with geometric constraint keypoints selection for 6D pose estimation

6D Object Pose Estimation Based on Cross-Modality Feature Fusion

Neural Correspondence Field for Object Pose Estimation

An Efficient Color and Geometric Feature Fusion Module for 6D Object Pose Estiamtion