Abstract:The 6-D pose estimation is a critical work essential to achieve reliable robotic grasping. Currently, the prevalent method is reliant on keypoint correspondence. However, this approach hinges on the determination of object keypoint locations, alongside their detection and localization in real scenes. It also employs the random sample consensus (RANSAC)-based perspective-n-point (PnP) algorithm to solve the pose. Yet, it is nondifferentiable and incapable of backpropagation with loss during the training phase. Alternatively, the direct regression method, while speedy and differentiable, falls short in terms of pose estimation performance, and thus needs enhancement. In view of these gaps, we investigate PPM6D, a new method for 6-D object pose estimation based on regression and point pair matching. Our methodology begins with a proposed cross-fusion module, designed to achieve the fusion and complementation of RGB features and point cloud features. Subsequently, an attention module adjusts the features of the object's 3-D model. Finally, we design a point pair matching module for effective matching of points and characteristics, resulting in an integral matching and fusion. PPM6D is extensively trained and tested utilizing benchmark datasets like LINEMOD, occlusion LINEMOD (LINEMOD-occ), YCB-Video, and T-LESS dataset. Experimental results prove that PPM6D can outperform many keypoint-based pose estimation methods, given its relatively rapid speed, thereby offering novel regression-based pose estimation ideas. When applied to real-world scenarios of object pose estimation tasks and grasp tasks of an actual Baxter robot, PPM6D demonstrates superior performance as compared to most alternatives.

3D Object Recognition and Pose Estimation From Point Cloud Using Stably Observed Point Pair Feature

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

A Fast Point Cloud Recognition Algorithm Based on Keypoint Pair Feature

Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud

Adaptive Pose Estimation Algorithm Based on Point Pair Feature

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

Embrace descriptors that use point pairs feature

6DOF pose estimation of a 3D rigid object based on edge-enhanced point pair features

Object Pose Estimation with Point Cloud Data for Robot Grasping

PPFNet: Global Context Aware Local Features for Robust 3D Point Matching

Matching Algorithm for 3D Point Cloud Recognition and Registration Based on Multi-Statistics Histogram Descriptors

CPPF++: Uncertainty-Aware Sim2Real Object Pose Estimation by Vote Aggregation

A Hybrid Approach for Cross-modality Pose Estimation Between Image and Point Cloud

6-D Object Pose Estimation Based on Point Pair Matching for Robotic Grasp Detection

P2V-RCNN: Point to Voxel Feature Learning for 3D Object Detection From Point Clouds

Robust Classification and 6D Pose Estimation by Sensor Dual Fusion of Image and Point Cloud Data

HCCG: Efficient high compatibility correspondence grouping for 3D object recognition and 6D pose estimation in cluttered scenes

Center-Based Decoupled Point-cloud Registration for 6D Object Pose Estimation

One Point, One Object: Simultaneous 3D Object Segmentation and 6-DOF Pose Estimation

An Efficient 3-D Point Cloud Place Recognition Approach Based on Feature Point Extraction and Transformer

Matching Technology of Point Cloud Models Based on Combination Features