Abstract:Point cloud registration is a fundamental task in the fields of computer vision and robotics. Recent developments in transformer-based methods have demonstrated enhanced performance in this domain. However, the standard attention mechanism utilized in these methods often integrates many low-relevance points, thereby struggling to prioritize its attention weights on sparse yet meaningful points. This inefficiency leads to limited local structure modeling capabilities and quadratic computational complexity. To overcome these limitations, we propose the Point Tree Transformer (PTT), a novel transformer-based approach for point cloud registration that efficiently extracts comprehensive local and global features while maintaining linear computational complexity. The PTT constructs hierarchical feature trees from point clouds in a coarse-to-dense manner, and introduces a novel Point Tree Attention (PTA) mechanism, which follows the tree structure to facilitate the progressive convergence of attended regions towards salient points. Specifically, each tree layer selectively identifies a subset of key points with the highest attention scores. Subsequent layers focus attention on areas of significant relevance, derived from the child points of the selected point set. The feature extraction process additionally incorporates coarse point features that capture high-level semantic information, thus facilitating local structure modeling and the progressive integration of multiscale information. Consequently, PTA empowers the model to concentrate on crucial local structures and derive detailed local information while maintaining linear computational complexity. Extensive experiments conducted on the 3DMatch, ModelNet40, and KITTI datasets demonstrate that our method achieves superior performance over the state-of-the-art methods.

PAT: Point Cloud Analysis with Local Filter Embedding in Transformer

3DPCT: 3D Point Cloud Transformer with Dual Self-attention

PatchFormer: an Efficient Point Transformer with Patch Attention

PU-Transformer: Point Cloud Upsampling Transformer

Local Transformer Network on 3D Point Cloud Semantic Segmentation

Hierarchical local global transformer for point clouds analysis

PointCAT: Cross-Attention Transformer for point cloud

MPCT: Multiscale Point Cloud Transformer with a Residual Network

EGCT: Enhanced Graph Convolutional Transformer for 3D Point Cloud Representation Learning

APPT : Asymmetric Parallel Point Transformer for 3D Point Cloud Understanding

Adaptive Channel Encoding Transformer for Point Cloud Analysis

PATNet: Patch-to-pixel attention-aware transformer network for RGB-D and RGB-T salient object detection

Point Tree Transformer for Point Cloud Registration

PCT: Point cloud transformer

Point Cloud Understanding via Attention-Driven Contrastive Learning

PointMT: Efficient Point Cloud Analysis with Hybrid MLP-Transformer Architecture

CloudAttention: Efficient Multi-Scale Attention Scheme For 3D Point Cloud Learning

Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsampling

Learning Cross-Attention Point Transformer With Global Porous Sampling

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

PVT: Point-Voxel Transformer for Point Cloud Learning