Abstract:Unsupervised end-to-end deep learning-based framework for non-rigid point cloud correspondence has been proposed to conveniently and effectively find the alignment relationship between two unordered point sets. However, due to the lacking of datasets in this field, researchers are still facing the challenge in designing novel neural networks which could sufficiently learn the correct correspondence and displacements of every points. In this paper, we propose a novel end-to-end unsupervised network, which consists of three modules from front to back: the feature embedding module, the correspondence prediction module and the shared deformer module. Specifically, We first use a hierarchical dilated graph convolution network(HDGCN) to boost the feature extraction as it has the potential in finding more correlations among local points. Then those features are fed into the correspondence prediction module to get the correspondence matrix, and we make it learnable in high-dimensional space. Finally, to acquire more precise point-wise displacements, we make the permuted point cloud into the one where each point carrys higher-dimensional information, and we input it to the shared deformer module which outputs the final non-rigid registration results. We name it HCDNet3D(HDGCN+Corr+Deform) and we experimentally prove our HCDNet3D makes better performance on correspondence rate and visual non-rigid registration results, comparing with several existing methods. According to the extensive experiment results, HCDNet3D outperforms state-of-the-art methods on both synthetic and real-world datasets of non-rigid 3D point clouds, including those directly computing point drifts and those taking meshes as input.

Learning 2D-3D Correspondences To Solve The Blind Perspective-n-Point Problem

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

EPro-PnP: Generalized End-to-End Probabilistic Perspective-N-Points for Monocular Object Pose Estimation

A robust direct linear transformation for camera pose estimation using points

2D3D-MatchNet: Learning to Match Keypoints Across 2D Image and 3D Point Cloud

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

2D-3D Cross-Modality Network for End-to-End Localization with Probabilistic Supervision

DDM-NET: End-to-end learning of keypoint feature Detection, Description and Matching for 3D localization

VIEWPOINT ESTIMATION IN IMAGES BY A KEY-POINT BASED DEEP NEURAL NETWORK

P2-Net - Joint Description and Detection of Local Features for Pixel and Point Matching.

Two Heads Are Better than One: Image-Point Cloud Network for Depth-Based 3D Hand Pose Estimation

Neural Correspondence Field for Object Pose Estimation

Toward 3D Face Reconstruction in Perspective Projection: Estimating 6DoF Face Pose From Monocular Image

An Efficient and Consistent Solution to the PnP Problem.

Three-dimensional Object Tracking Based on Perspective Scale Invariant Feature Transform Correspondences

DGECN++: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation via Attention Mechanism

Learning Sufficient Correlations among Points for 3D Non-rigid Point Cloud Registration

A Robust and Fast Method to the Perspective-n-Point Problem for Camera Pose Estimation

Unsupervised Monocular Estimation of Depth and Visual Odometry uUsing Attention and Depth-Pose Consistency Loss

Combining Kinect and PnP for Camera Pose Estimation.