Abstract:This paper focuses on the problem of 6D object pose estimation in occluded environments. We propose a novel 6D pose estimation algorithm based on RGB‐D images, which utilises conventional image processing techniques to generate a distance map and uses it as the compensation information for pose estimation. Specifically, we introduce a new sampling strategy and add an object segmentation module based on foreground probability to improve the algorithm's robustness to occluded environments. 6D object pose estimation usually refers to acquiring the 6D pose information of 3D objects in the sensor coordinate system using computer vision techniques. However, the task faces numerous challenges due to the complexity of natural scenes. One of the most significant challenges is occlusion, which is an unavoidable situation in 3D scenes and poses a significant obstacle in real‐world applications. To tackle this issue, we propose a novel 6D pose estimation algorithm based on RGB‐D images, aiming for enhanced robustness in occluded environments. Our approach follows the basic architecture of keypoint‐based pose estimation algorithms. To better leverage complementary information of RGB‐D data, we introduce a novel foreground probability‐guided sampling strategy at the network's input stage. This strategy mitigates the sampling ratio imbalance between foreground and background points due to smaller foreground objects in occluded environments. Moreover, considering the impact of occlusion on semantic segmentation networks, we introduce a new object segmentation module. This module utilises traditional image processing techniques to compensate for severe semantic segmentation errors of deep learning networks. We evaluate our algorithm using the Occlusion LineMOD public dataset. Experimental results demonstrate that our method is more robust in occlusion environments compared to existing state‐of‐the‐art algorithms. It maintains stable performance even in scenarios with no or low occlusion.

REDE: End-to-End Object 6D Pose Robust Estimation Using Differentiable Outliers Elimination

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

RFFCE: Residual Feature Fusion and Confidence Evaluation Network for 6dof Pose Estimation.

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images

Occluded object 6D pose estimation using foreground probability compensation

A Geometry-Enhanced 6D Pose Estimation Network with Incomplete Shape Recovery for Industrial Parts

End-to-End Differentiable 6DoF Object Pose Estimation with Local and Global Constraints

RNNPose: 6-DoF Object Pose Estimation Via Recurrent Correspondence Field Estimation and Pose Optimization

Robust Pose Estimation via Hybrid Point and Twin Line Reprojection for RGB-D Vision Navigation

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation.

Robust RGB-based 6-DoF Pose Estimation without Real Pose Annotations

KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation

RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization

Iterative Pose Refinement for Object Pose Estimation Based on RGBD Data

Leveraging Positional Encoding for Robust Multi-Reference-Based Object 6D Pose Estimation

End-to-End Probabilistic Geometry-Guided Regression for 6DoF Object Pose Estimation

Multi-View Keypoints for Reliable 6D Object Pose Estimation

Robust 6DoF Pose Estimation Against Depth Noise and a Comprehensive Evaluation on a Mobile Dataset

PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation

Diff-DOPE: Differentiable Deep Object Pose Estimation

DON6D: a decoupled one-stage network for 6D pose estimation