Abstract:In the point-cloud-based place recognition area, the existing hybrid architectures combining both convolutional networks and transformers have shown promising performance. They mainly apply the voxel-wise transformer after the sparse convolution (SPConv). However, they can induce information loss by the sparse voxelization and further result in loss propagation to the transformer, significantly degrading the performance of the network, especially in outdoor scenes with complex geometric structures and multiple small objects. To address this issue, we propose a novel Point-wise Transformer with sparse Convolution (PTC). Specifically, SPConv is applied to the sparsely voxelized point cloud to extract local features, which are then converted to the point-based representation via a feature transformation unit (FTU). As such, our PTC can apply a transformer model based on the point-wise representation rather than on the voxel-wise one. To enhance the ability to capture long-range features and reduce the computational complexity of the transformer, we propose a two-step transformer, each with different grouping strategies. Meanwhile, in both steps, the attention matrix is computed with much fewer points by grouping a single point cloud into different attention domains. The experiments show that the PTC-Net can achieve state-of-the-art (SOTA) performance, with an improvement of 3.6% on average recall@1. Furthermore, to demonstrate the effectiveness of the PTC, we introduce an extremely light-weight version, PTC-Net-L, with only one PTC layer and half initial channel dimensions, also achieving SOTA performance in terms of the average recall rate and running time with only 0.08 M parameters.

SP$^2$T: Sparse Proxy Attention for Dual-stream Point Transformer

DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsampling

3DPCT: 3D Point Cloud Transformer with Dual Self-attention

CloudAttention: Efficient Multi-Scale Attention Scheme For 3D Point Cloud Learning

Learning Cross-Attention Point Transformer With Global Porous Sampling

PVT-SSD: Single-Stage 3D Object Detector with Point-Voxel Transformer

APPT : Asymmetric Parallel Point Transformer for 3D Point Cloud Understanding

Superpoint Transformer for 3D Scene Instance Segmentation.

Point-voxel Dual Stream Transformer for 3d Point Cloud Learning

Stratified Transformer for 3D Point Cloud Segmentation

Spatial-Temporal Transformer for 3D Point Cloud Sequences

Local Transformer Network on 3D Point Cloud Semantic Segmentation

MPCT: Multiscale Point Cloud Transformer with a Residual Network

Point Transformer V3: Simpler, Faster, Stronger

PTC-Net: Point-Wise Transformer with Sparse Convolution Network for Place Recognition.

PU-Transformer: Point Cloud Upsampling Transformer

Real-Time Semantic Segmentation of Point Clouds Based on an Attention Mechanism and a Sparse Tensor

PST-NET: Point Cloud Sampling Via Point-Based Transformer.

Spatial Transformer Point Convolution