NoiseTrans: Point Cloud Denoising with Transformers

Guangzhe Hou,Guihe Qin,Minghui Sun,Yanhua Liang,Jie Yan,Zhonghan Zhang

2023-04-24

Abstract:Point clouds obtained from capture devices or 3D reconstruction techniques are often noisy and interfere with downstream tasks. The paper aims to recover the underlying surface of noisy point clouds. We design a novel model, NoiseTrans, which uses transformer encoder architecture for point cloud denoising. Specifically, we obtain structural similarity of point-based point clouds with the assistance of the transformer's core self-attention mechanism. By expressing the noisy point cloud as a set of unordered vectors, we convert point clouds into point embeddings and employ Transformer to generate clean point clouds. To make the Transformer preserve details when sensing the point cloud, we design the Local Point Attention to prevent the point cloud from being over-smooth. In addition, we also propose sparse encoding, which enables the Transformer to better perceive the structural relationships of the point cloud and improve the denoising performance. Experiments show that our model outperforms state-of-the-art methods in various datasets and noise environments.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to address the problem of point cloud denoising. Specifically, point cloud data obtained from acquisition devices or 3D reconstruction techniques usually contain noise, which interferes with the execution of downstream tasks. The goal of the paper is to recover the underlying surface of noisy point cloud data while preserving as much detail as possible.

#### Main Contributions
1. **Proposed a Transformer-based point cloud denoising framework** (NoiseTrans), which is suitable for point cloud denoising tasks in various scenarios.
2. **Designed a point embedding module with local point attention mechanism**, allowing multi-scale extraction of local features of the point cloud and emphasizing edge weights to preserve details.
3. **Proposed a learnable sparse coding**, which has permutation invariance and can provide more information about structural relationships for the denoising task.
4. **Conducted experiments on different datasets and noise types**, achieving state-of-the-art performance compared to existing methods.

Through the above contributions, the paper demonstrates the superior performance of NoiseTrans in different datasets and noise environments.