Abstract:Point cloud registration is an essential technology in computer vision and robotics. Recently, transformer-based methods have achieved advanced performance in point cloud registration by utilizing the advantages of the transformer in order-invariance and modeling dependencies to aggregate information. However, they still suffer from indistinct feature extraction, sensitivity to noise, and outliers, owing to three major limitations: 1) the adoption of CNNs fails to model global relations due to their local receptive fields, resulting in extracted features susceptible to noise; 2) the shallow-wide architecture of transformers and the lack of positional information lead to indistinct feature extraction due to inefficient information interaction; and 3) the insufficient consideration of geometrical compatibility leads to the ambiguous identification of incorrect correspondences. To address the above-mentioned limitations, a novel full transformer network for point cloud registration is proposed, named the deep interaction transformer (DIT), which incorporates: 1) a point cloud structure extractor (PSE) to retrieve structural information and model global relations with the local feature integrator (LFI) and transformer encoders; 2) a deep-narrow point feature transformer (PFT) to facilitate deep information interaction across a pair of point clouds with positional information, such that transformers establish comprehensive associations and directly learn the relative position between points; and 3) a geometric matching-based correspondence confidence evaluation (GMCCE) method to measure spatial consistency and estimate correspondence confidence by the designed triangulated descriptor. Extensive experiments on the ModelNet40, ScanObjectNN, and 3DMatch datasets demonstrate that our method is capable of precisely aligning point clouds, consequently, achieving superior performance compared with state-of-the-art methods. The code is publicly available at https://github.com/CGuangyan-BIT/DIT.

Point Cloud Transformers applied to Collider Physics

Adaptive Channel Encoding Transformer for Point Cloud Analysis

PU-Transformer: Point Cloud Upsampling Transformer

Interpreting Transformers for Jet Tagging

PCT: Point cloud transformer

Spatial Transformer for 3D Point Clouds

PointMT: Efficient Point Cloud Analysis with Hybrid MLP-Transformer Architecture

Full Transformer Framework for Robust Point Cloud Registration With Deep Information Interaction

Deep Interactive Full Transformer Framework for Point Cloud Registration.

Applying Plain Transformers to Real-World Point Clouds

Comparing Point Cloud Strategies for Collider Event Classification

TrackFormers: In Search of Transformer-Based Particle Tracking for the High-Luminosity LHC Era

Transformer networks for Heavy flavor jet tagging

Transformers for Charged Particle Track Reconstruction in High Energy Physics

NoiseTrans: Point Cloud Denoising with Transformers

Adaptive Point Transformer

Transformer-based Point Cloud Generation Network

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

Point 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos

Transformer and Upsampling-Based Point Cloud Compression

PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysis