Abstract:The 6-D pose estimation is a critical work essential to achieve reliable robotic grasping. Currently, the prevalent method is reliant on keypoint correspondence. However, this approach hinges on the determination of object keypoint locations, alongside their detection and localization in real scenes. It also employs the random sample consensus (RANSAC)-based perspective-n-point (PnP) algorithm to solve the pose. Yet, it is nondifferentiable and incapable of backpropagation with loss during the training phase. Alternatively, the direct regression method, while speedy and differentiable, falls short in terms of pose estimation performance, and thus needs enhancement. In view of these gaps, we investigate PPM6D, a new method for 6-D object pose estimation based on regression and point pair matching. Our methodology begins with a proposed cross-fusion module, designed to achieve the fusion and complementation of RGB features and point cloud features. Subsequently, an attention module adjusts the features of the object's 3-D model. Finally, we design a point pair matching module for effective matching of points and characteristics, resulting in an integral matching and fusion. PPM6D is extensively trained and tested utilizing benchmark datasets like LINEMOD, occlusion LINEMOD (LINEMOD-occ), YCB-Video, and T-LESS dataset. Experimental results prove that PPM6D can outperform many keypoint-based pose estimation methods, given its relatively rapid speed, thereby offering novel regression-based pose estimation ideas. When applied to real-world scenarios of object pose estimation tasks and grasp tasks of an actual Baxter robot, PPM6D demonstrates superior performance as compared to most alternatives.

A Depth Adaptive Feature Extraction and Dense Prediction Network for 6-D Pose Estimation in Robotic Grasping

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Deep instance segmentation and 6D object pose estimation in cluttered scenes for robotic autonomous grasping

Point Pair Feature Based 6D Pose Estimation for Robotic Grasping

6D Pose Estimation with Combined Deep Learning and 3D Vision Techniques for a Fast and Accurate Object Grasping

Instance-level 6D pose estimation based on multi-task parameter sharing for robotic grasping

6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping

A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

6D Pose Estimation for Bin-Picking based on Improved Mask R-CNN and DenseFusion

A Geometry-Enhanced 6D Pose Estimation Network with Incomplete Shape Recovery for Industrial Parts

FEIF: Feature Excitation and Interactive Fusion for 6D Object Pose Estimation.

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

Attention Guided 6D Object Pose Estimation with Multi-constraints Voting Network

A Novel Deep Learning-Based Pose Estimation Method for Robotic Grasping of Axisymmetric Bodies in Industrial Stacked Scenarios

Estimating 6D Object Poses with Temporal Motion Reasoning for Robot Grasping in Cluttered Scenes

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion

Depth-aware gaze-following via auxiliary networks for robotics

6D Hybrid Pose Estimation in Cluttered Industrial Scenes for Robotic Grasping

A Manufacturing-Oriented Intelligent Vision System Based on Deep Neural Network for Object Recognition and 6D Pose Estimation

Robotic Grasping Method with 6D Pose Estimation and Point Cloud Fusion

6-D Object Pose Estimation Based on Point Pair Matching for Robotic Grasp Detection