TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformer

Huimin Xiong,Kunle Li,Kaiyuan Tan,Yang Feng,Joey Tianyi Zhou,Jin Hao,Haochao Ying,Jian Wu,Zuozhu Liu

2023-11-22

Abstract:Optical Intraoral Scanners (IOS) are widely used in digital dentistry to provide detailed 3D information of dental crowns and the gingiva. Accurate 3D tooth segmentation in IOSs is critical for various dental applications, while previous methods are error-prone at complicated boundaries and exhibit unsatisfactory results across patients. In this paper, we propose TSegFormer which captures both local and global dependencies among different teeth and the gingiva in the IOS point clouds with a multi-task 3D transformer architecture. Moreover, we design a geometry-guided loss based on a novel point curvature to refine boundaries in an end-to-end manner, avoiding time-consuming post-processing to reach clinically applicable segmentation. In addition, we create a dataset with 16,000 IOSs, the largest ever IOS dataset to the best of our knowledge. The experimental results demonstrate that our TSegFormer consistently surpasses existing state-of-the-art baselines. The superiority of TSegFormer is corroborated by extensive analysis, visualizations and real-world clinical applicability tests. Our code is available at <a class="link-external link-https" href="https://github.com/huiminxiong/TSegFormer" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address the issue of 3D tooth segmentation in Intraoral Scans (IOS). Specifically, existing methods tend to make errors when dealing with complex boundaries and perform unsatisfactorily in segmentations across different patients. To this end, the authors propose a new framework named TSegFormer, which leverages a multi-task 3D transformer architecture to capture both local and global dependencies between teeth and gums. Additionally, they design a geometry-guided loss function based on newly defined point curvature to refine boundaries in an end-to-end manner, avoiding time-consuming post-processing steps. The paper also creates a dataset containing 16,000 IOS, which is the largest IOS dataset to date. Experimental results show that TSegFormer outperforms existing methods in terms of accuracy, mean Intersection over Union (mIoU), and Dice Similarity Coefficient (DSC), and its superior performance is validated through extensive analysis and practical clinical application tests.

TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformer

TFormer: 3D Tooth Segmentation in Mesh Scans with Geometry Guided Transformer

Clinically Applicable System For 3D Teeth Segmentation in Intraoral Scans using Deep Learning

A fine-grained orthodontics segmentation model for 3D intraoral scan data

Hierarchical Self-Supervised Learning for 3D Tooth Segmentation in Intra-Oral Mesh Scans

Model Adaptive Tooth Segmentation.

Teeth-SEG: An Efficient Instance Segmentation Framework for Orthodontic Treatment based on Anthropic Prior Knowledge

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

[Research on intelligent tooth segmentation method combining multiple seed region growth and boundary extension]

Convolutional neural network for automated tooth segmentation on intraoral scans

Privacy-Preserved Federated Learning for 3D Tooth Segmentation in Intra-Oral Mesh Scans

Toward Clinically Applicable 3-Dimensional Tooth Segmentation via Deep Learning

T-Mamba: A unified framework with Long-Range Dependency in dual-domain for 2D & 3D Tooth Segmentation

Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation

Teeth And Root Canals Segmentation Using ZXYFormer With Uncertainty Guidance And Weight Transfer

Two-Stage Mesh Deep Learning for Automated Tooth Segmentation and Landmark Localization on 3D Intraoral Scans

DentalSegmentator: robust deep learning-based CBCT image segmentation

Algorithms of 3D Segmentation and Reconstruction Based on Teeth CBCT Images

Deep Multi-Scale Mesh Feature Learning for Automated Labeling of Raw Dental Surfaces from 3D Intraoral Scanners

Transformer based 3D tooth segmentation via point cloud region partition