Abstract:Current point cloud registration methods predominantly focus on extracting geometric information from point clouds. In certain scenarios, i.e., when the target objects to be registered contain a large number of repetitive planar structures, the point-only based methods struggle to extract distinctive features from the similar structures, which greatly limits the accuracy of registration. Moreover, the deep learning-based approaches achieve commendable results on public datasets, but they face challenges in generalizing to unseen few-shot datasets with significant domain differences from the training data, and that is especially common in industrial applications where samples are generally scarce. Moreover, existing registration methods can achieve high accuracy on complete point clouds. However, for partial point cloud registration, many methods are incapable of accurately identifying correspondences, making it challenging to estimate precise rigid transformations. This paper introduces a domain-adaptive multimodal feature fusion method for partial point cloud registration in an unsupervised manner, named DAMF-Net, that significantly addresses registration challenges in scenes dominated by repetitive planar structures, and it can generalize well-trained networks on public datasets to unseen few-shot datasets. Specifically, we first introduce a point-guided two-stage multimodal feature fusion module that utilizes the geometric information contained in point clouds to guide the texture information in images for preliminary and supplementary feature fusion. Secondly, we incorporate a gradient-inverse domain-aware module to construct a domain classifier in a generative adversarial manner, weakening the feature extractor's ability to distinguish between source and target domain samples, thereby achieving generalization across different domains. Experiments on a public dataset and our industrial components dataset demonstrate that our method improves the registration accuracy in specific scenarios with numerous repetitive planar structures and achieves high accuracy on unseen few-shot datasets, compared with the results of state-of-the-art traditional and deep learning-based point cloud registration methods.

Unsupervised Multimodal Remote Sensing Image Registration Via Domain Adaptation

Rotation-Invariant Siamese Network for Low-Altitude Remote-Sensing Image Registration

Towards Self-Similarity Consistency and Feature Discrimination for Unsupervised Domain Adaptation.

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Advances and Challenges in Multimodal Remote Sensing Image Registration

A Multiscale Framework with Unsupervised Learning for Remote Sensing Image Registration

A Semi-Supervised Image Registration Framework Based on Multimodal Cross-Attention

Remote Sensing Image Registration Based on Multi-Head Self-Attention Mechanism

ADRNet: Affine and Deformable Registration Networks for Multimodal Remote Sensing Images

Multimodal Image Alignment Through a Multiscale Chain of Neural Networks with Application to Remote Sensing

Contrastive Learning of Multimodal Consistency Feature Representation for Remote Sensing Image Registration

Boosting Structure Consistency for Multispectral and Multimodal Image Registration

Multimodal Remote Sensing Image Registration Based on Adaptive Spectrum Congruency

Unsupervised learning of multimodal image registration using domain adaptation with projected Earth Move's discrepancies

Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity

Multifeature Alignment and Matching Network for SAR and Optical Image Registration

Remote Sensing Image Registration Using Multiple Image Features

DAMF-Net: Unsupervised Domain-Adaptive Multimodal Feature Fusion Method for Partial Point Cloud Registration

Self-Supervised Keypoint Detection and Cross-Fusion Matching Networks for Multimodal Remote Sensing Image Registration

PCNet: A Structure Similarity Enhancement Method for Multispectral and Multimodal Image Registration

A Two-Stage Deep Learning Registration Method for Remote Sensing Images Based on Sub-Image Matching