Abstract:Accurate teeth delineation on 3-D dental models is essential for individualized orthodontic treatment planning. Pioneering works like PointNet suggest a promising direction to conduct efficient and accurate 3-D dental model analyses in end-to-end learnable fashions. Recent studies further imply that multistream architectures to concurrently learn geometric representations from different inputs/views (e.g., coordinates and normals) are beneficial for segmenting teeth with varying conditions. However, such multistream networks typically adopt simple late-fusion strategies to combine features captured from raw inputs that encode complementary but fundamentally different geometric information, potentially hampering their accuracy in end-to-end semantic segmentation. This article presents a hierarchical cross-stream aggregation (HiCA) network to learn more discriminative point/cell-wise representations from multiview inputs for fine-grained 3-D semantic segmentation. Specifically, based upon our multistream backbone with input-tailored feature extractors, we first design a contextual cross-steam aggregation (CA) module conditioned on interstream consistency to boost each view's contextual representation learning jointly. Then, before the late fusion of different streams' outputs for segmentation, we further deploy a discriminative cross-stream aggregation (DA) module to concurrently update all views' discriminative representation learning by leveraging a specific graph attention strategy induced by multiview prototype learning. On both public and in-house datasets of real-patient dental models, our method significantly outperformed state-of-the-art (SOTA) deep learning methods for teeth semantic segmentation. In addition, extended experimental results suggest the applicability of HiCA to other general 3-D shape segmentation tasks. The code is available at https://github.com/ladderlab-xjtu/HiCA.

Two-Stream Graph Convolutional Network for Intra-Oral Scanner Image Segmentation

Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation

TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation

TeethGNN: Semantic 3D Teeth Segmentation with Graph Neural Networks

3D Dental model segmentation with graph attentional convolution network

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Automatic Tooth Segmentation and Dense Correspondence of 3D Dental Model.

Clinically Applicable System For 3D Teeth Segmentation in Intraoral Scans using Deep Learning

Few sampling meshes-based 3D tooth segmentation via region-aware graph convolutional network

A fine-grained orthodontics segmentation model for 3D intraoral scan data

Tooth Defect Segmentation in 3D Mesh Scans Using Deep Learning

Multi-feature fusion 3D-CNN for tooth segmentation

STSN-Net: Simultaneous Tooth Segmentation and Numbering Method in Crowded Environments with Deep Learning

3D Tooth Segmentation and Labeling Using Deep Convolutional Neural Networks

A Novel Hierarchical Cross-Stream Aggregation Neural Network for Semantic Segmentation of 3-D Dental Surface Models

TSASNet: Tooth segmentation on dental panoramic X-ray images by Two-Stage Attention Segmentation Network

3D Dental Mesh Segmentation Using Semantics-Based Feature Learning with Graph-Transformer

Two-Stage Mesh Deep Learning for Automated Tooth Segmentation and Landmark Localization on 3D Intraoral Scans

TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformer

Automatic Classification and Segmentation of Teeth on 3D Dental Model Using Hierarchical Deep Learning Networks

Tooth Segmentation and Labeling from Digital Dental Casts