Abstract:This paper focuses on the problem of 6D object pose estimation in occluded environments. We propose a novel 6D pose estimation algorithm based on RGB‐D images, which utilises conventional image processing techniques to generate a distance map and uses it as the compensation information for pose estimation. Specifically, we introduce a new sampling strategy and add an object segmentation module based on foreground probability to improve the algorithm's robustness to occluded environments. 6D object pose estimation usually refers to acquiring the 6D pose information of 3D objects in the sensor coordinate system using computer vision techniques. However, the task faces numerous challenges due to the complexity of natural scenes. One of the most significant challenges is occlusion, which is an unavoidable situation in 3D scenes and poses a significant obstacle in real‐world applications. To tackle this issue, we propose a novel 6D pose estimation algorithm based on RGB‐D images, aiming for enhanced robustness in occluded environments. Our approach follows the basic architecture of keypoint‐based pose estimation algorithms. To better leverage complementary information of RGB‐D data, we introduce a novel foreground probability‐guided sampling strategy at the network's input stage. This strategy mitigates the sampling ratio imbalance between foreground and background points due to smaller foreground objects in occluded environments. Moreover, considering the impact of occlusion on semantic segmentation networks, we introduce a new object segmentation module. This module utilises traditional image processing techniques to compensate for severe semantic segmentation errors of deep learning networks. We evaluate our algorithm using the Occlusion LineMOD public dataset. Experimental results demonstrate that our method is more robust in occlusion environments compared to existing state‐of‐the‐art algorithms. It maintains stable performance even in scenarios with no or low occlusion.

Adaptive Pose Estimation Algorithm Based on Point Pair Feature

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

6DOF pose estimation of a 3D rigid object based on edge-enhanced point pair features

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

A Fast Point Cloud Recognition Algorithm Based on Keypoint Pair Feature

3D Object Recognition and Pose Estimation From Point Cloud Using Stably Observed Point Pair Feature

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

6-D Object Pose Estimation Based on Point Pair Matching for Robotic Grasp Detection

Efficient Encoding and Aligning Viewpoints for 6D Pose Estimation of Unseen Industrial Parts

PAV-Net: Point-wise Attention Keypoints Voting Network for Real-time 6D Object Pose Estimation

A Method for Unseen Object Six Degrees of Freedom Pose Estimation Based on Segment Anything Model and Hybrid Distance Optimization

Instance segmentation based 6D pose estimation of industrial objects using point clouds for robotic bin-picking

Occluded object 6D pose estimation using foreground probability compensation

Center-Based Decoupled Point-cloud Registration for 6D Object Pose Estimation

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

Scene-level Pose Estimation for Multiple Instances of Densely Packed Objects

A Pose Estimation Algorithm for Multimodal Data Fusion

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images

SD-Pose: facilitating space-decoupled human pose estimation via adaptive pose perception guidance

Fast and Robust Multi-Person 3D Pose Estimation from Multiple Views

PCKRF: Point Cloud Completion and Keypoint Refinement With Fusion Data for 6D Pose Estimation