Abstract:6 DoF pose estimation problem aims to estimate the rotation and translation parameters between two coordinates, such as object world coordinate and camera world coordinate. Although some advances are made with the help of deep learning, how to full use scene information is still a problem. Prior works tackle the problem by pixel-wise feature fusion but need to randomly select numerous points from images, which can not satisfy the demands of fast inference simultaneously and accurate pose estimation. In this work, we present a novel deep neural network based on dynamic keypoint selection designed for 6DoF pose estimation from a single RGBD image. Our network includes three parts, instance semantic segmentation, edge points detection and 6DoF pose estimation. Given an RGBD image, our network is trained to predict pixel category and the translation to edge points and center points. Then, a least-square fitting manner is applied to estimate the 6DoF pose parameters. Specifically, we propose a dynamic keypoint selection algorithm to choose keypoints from the foreground feature map. It allows us to leverage geometric and appearance information. During 6DoF pose estimation, we utilize the instance semantic segmentation result to filter out background points and only use foreground points to finish edge points detection and 6DoF pose estimation. Experiments on two commonly used 6DoF estimation benchmark datasets, YCB-Video and LineMoD, demonstrate that our method outperforms the state-of-the-art methods and achieves significant improvements over other same category methods time efficiency.(c) 2022 Published by Elsevier B.V.

Prior-information-guided corresponding point regression network for 6D pose estimation

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Prior Geometry Guided Direct Regression Network for Monocular 6D Object Pose Estimation

Exploiting Point-Wise Attention in 6D Object Pose Estimation Based on Bidirectional Prediction

BiCo-Net: Regress Globally, Match Locally for Robust 6D Pose Estimation

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images

Attention Guided 6D Object Pose Estimation with Multi-constraints Voting Network

Center-Based Decoupled Point-cloud Registration for 6D Object Pose Estimation

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

Exploring Multiple Geometric Representations for 6DoF Object Pose Estimation

Sparse Convolution Based 6D Pose Estimation for Robotic Bin-Picking with Point Clouds

HFE-Net: Hierarchical Feature Extraction and Coordinate Conversion of Point Cloud for Object 6D Pose Estimation

DGECN++: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation via Attention Mechanism

Object 6-Dof Pose Estimation Using Auxiliary Learning

DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation

PPR-Net: Point-wise Pose Regression Network for Instance Segmentation and 6D Pose Estimation in Bin-picking Scenarios.

6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

Learning Deep Network for Detecting 3D Object Keypoints and 6D Poses

Deep Learning Based 6D Pose Estimation for Bin-Picking Using 3D Point Clouds

A dynamic keypoint selection network for 6DoF pose estimation

Homologous multimodal fusion network with geometric constraint keypoints selection for 6D pose estimation