Abstract:This paper focuses on the problem of 6D object pose estimation in occluded environments. We propose a novel 6D pose estimation algorithm based on RGB‐D images, which utilises conventional image processing techniques to generate a distance map and uses it as the compensation information for pose estimation. Specifically, we introduce a new sampling strategy and add an object segmentation module based on foreground probability to improve the algorithm's robustness to occluded environments. 6D object pose estimation usually refers to acquiring the 6D pose information of 3D objects in the sensor coordinate system using computer vision techniques. However, the task faces numerous challenges due to the complexity of natural scenes. One of the most significant challenges is occlusion, which is an unavoidable situation in 3D scenes and poses a significant obstacle in real‐world applications. To tackle this issue, we propose a novel 6D pose estimation algorithm based on RGB‐D images, aiming for enhanced robustness in occluded environments. Our approach follows the basic architecture of keypoint‐based pose estimation algorithms. To better leverage complementary information of RGB‐D data, we introduce a novel foreground probability‐guided sampling strategy at the network's input stage. This strategy mitigates the sampling ratio imbalance between foreground and background points due to smaller foreground objects in occluded environments. Moreover, considering the impact of occlusion on semantic segmentation networks, we introduce a new object segmentation module. This module utilises traditional image processing techniques to compensate for severe semantic segmentation errors of deep learning networks. We evaluate our algorithm using the Occlusion LineMOD public dataset. Experimental results demonstrate that our method is more robust in occlusion environments compared to existing state‐of‐the‐art algorithms. It maintains stable performance even in scenarios with no or low occlusion.

Occlusion-Aware Object Localization, Segmentation and Pose Estimation

Multi-Instance Object Segmentation With Occlusion Handling

BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depth

Occluded object 6D pose estimation using foreground probability compensation

Boundary-Aware Instance Segmentation

Sub-OBB based object recognition and localization algorithm using range images

iPose: Instance-Aware 6D Pose Estimation of Partly Occluded Objects

OccuSeg: Occupancy-Aware 3D Instance Segmentation

Occ$^2$Net: Robust Image Matching Based on 3D Occupancy Estimation for Occluded Regions

One Point, One Object: Simultaneous 3D Object Segmentation and 6-DOF Pose Estimation

Occlusion Localization Based on Convolutional Neural Networks.

Detection and Segmentation of Unlearned Objects in Unknown Environment

Occlusion-Aware Region-Based 3D Pose Tracking of Objects with Temporally Consistent Polar-Based Local Partitioning

Sequential Amodal Segmentation via Cumulative Occlusion Learning

Object-Occluded Human Shape and Pose Estimation with Probabilistic Latent Consistency

Object Co-Segmentation Via Salient and Common Regions Discovery

Seeing Through the Occluders: Robust Monocular 6-DOF Object Pose Tracking via Model-Guided Video Object Segmentation

Pose2Seg: Detection Free Human Instance Segmentation

Multi-person Pose Estimation with Object Occlusion Information

Visual Attention and Color Cues for 6D Pose Estimation on Occluded Scenarios Using RGB-D Data

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation.