Abstract:Deformable attention only focuses on a small group of key sample-points around the reference point and make itself be able to capture dynamically the local features of input feature map without considering the size of the feature map. Its introduction into point cloud registration will be quicker and easier to extract local geometric features from point cloud than attention. Therefore, we propose a point cloud registration method based on Spatial Deformable Transformer (SDT). SDT consists of a deformable self-attention module and a cross-attention module where the deformable self-attention module is used to enhance local geometric feature representation and the cross-attention module is employed to enhance feature discriminative capability of spatial correspondences. The experimental results show that compared to state-of-the-art registration methods, SDT has a better matching recall, inlier ratio, and registration recall on 3DMatch and 3DLoMatch scene, and has a better generalization ability and time efficiency on ModelNet40 and ModelLoNet40 scene.

What problem does this paper attempt to address?

The paper primarily focuses on addressing the problem of 3D point cloud registration, particularly achieving high-precision and robust registration in low-overlap scenarios. Specifically, the paper investigates the following points: 1. **Proposed Method**: The paper proposes a 3D point cloud registration method based on the Spatial Deformable Transformer (SDT). SDT includes a deformable self-attention module and a cross-attention module to enhance the representation capability of local geometric features and improve the feature discrimination ability of spatial correspondences. 2. **Problem Background**: Point cloud registration is an important task in the field of computer vision, playing a crucial role in 3D reconstruction, SLAM (Simultaneous Localization and Mapping), and autonomous driving. However, due to factors such as noise, outliers, and low overlap rates, point cloud registration becomes a challenging problem. 3. **Limitations of Existing Techniques**: Traditional Iterative Closest Point (ICP) algorithms are prone to getting stuck in local optima; while deep learning-based methods have improved performance, traditional attention mechanisms struggle to effectively capture local features of point clouds, affecting robustness and efficiency in low-overlap scenarios. 4. **Innovations**: - A new 3D point cloud registration network is proposed, addressing the point cloud registration problem in low-overlap scenarios by introducing deformable self-attention and cross-attention mechanisms. - A deformable self-attention module is constructed to enhance the interaction of local geometric information within the point cloud, improving feature representation capability. - A deformable cross-attention module is constructed to transfer features between point clouds and enhance the feature discrimination ability of spatial correspondences. - A balanced weighted loss function is designed, utilizing the supervision between the soft correspondence confidence matrix and the true correspondence matrix to achieve more accurate hard matching correspondences. 5. **Experimental Results**: The experimental results in the paper show that the proposed SDT method achieves better matching recall, inlier ratio, and registration recall on 3DMatch and 3DLoMatch datasets; it also demonstrates better generalization ability and time efficiency on ModelNet40 and ModelLoNet40 datasets. In summary, this paper aims to improve existing Transformer-based point cloud registration methods by introducing deformable attention mechanisms, thereby achieving effective extraction and matching of local features in point clouds, and ultimately enhancing registration accuracy and robustness in low-overlap scenarios.

Spatial deformable transformer for 3D point cloud registration

End-to-end point cloud registration with transformer

Geometric Transformer for Fast and Robust Point Cloud Registration

2D3D-MATR: 2D-3D Matching Transformer for Detection-free Registration between Images and Point Clouds

PointDifformer: Robust Point Cloud Registration With Neural Diffusion and Transformer

Spatial Transformer for 3D Point Clouds

Deep Interactive Full Transformer Framework for Point Cloud Registration.

Fast and Robust Point Cloud Registration with Tree-based Transformer

Low-Overlap Point Cloud Registration With Transformer

GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformer

PointTr: Low-Overlap Point Cloud Registration with Transformer

Full Transformer Framework for Robust Point Cloud Registration With Deep Information Interaction

Point Tree Transformer for Point Cloud Registration

Dynamic Cues-Assisted Transformer for Robust Point Cloud Registration

A Novel Local Feature Descriptor and an Accurate Transformation Estimation Method for 3-D Point Cloud Registration.

Local feature extraction network with high correspondences for 3d point cloud registration

GETr: A Geometric Equivariant Transformer for Point Cloud Registration

DVST: Deformable Voxel Set Transformer for 3D Object Detection from Point Clouds

EGST: Enhanced Geometric Structure Transformer for Point Cloud Registration

D3Former: Jointly Learning Repeatable Dense Detectors and Feature-enhanced Descriptors via Saliency-guided Transformer