Abstract:Accurate teeth delineation on 3-D dental models is essential for individualized orthodontic treatment planning. Pioneering works like PointNet suggest a promising direction to conduct efficient and accurate 3-D dental model analyses in end-to-end learnable fashions. Recent studies further imply that multistream architectures to concurrently learn geometric representations from different inputs/views (e.g., coordinates and normals) are beneficial for segmenting teeth with varying conditions. However, such multistream networks typically adopt simple late-fusion strategies to combine features captured from raw inputs that encode complementary but fundamentally different geometric information, potentially hampering their accuracy in end-to-end semantic segmentation. This article presents a hierarchical cross-stream aggregation (HiCA) network to learn more discriminative point/cell-wise representations from multiview inputs for fine-grained 3-D semantic segmentation. Specifically, based upon our multistream backbone with input-tailored feature extractors, we first design a contextual cross-steam aggregation (CA) module conditioned on interstream consistency to boost each view's contextual representation learning jointly. Then, before the late fusion of different streams' outputs for segmentation, we further deploy a discriminative cross-stream aggregation (DA) module to concurrently update all views' discriminative representation learning by leveraging a specific graph attention strategy induced by multiview prototype learning. On both public and in-house datasets of real-patient dental models, our method significantly outperformed state-of-the-art (SOTA) deep learning methods for teeth semantic segmentation. In addition, extended experimental results suggest the applicability of HiCA to other general 3-D shape segmentation tasks. The code is available at https://github.com/ladderlab-xjtu/HiCA.

3D Dental Mesh Segmentation Using Semantics-Based Feature Learning with Graph-Transformer

TeethGNN: Semantic 3D Teeth Segmentation with Graph Neural Networks

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

TSGCNet: Discriminative Geometric Feature Learning with Two-Stream Graph Convolutional Network for 3D Dental Model Segmentation

TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation

3D Dental model segmentation with graph attentional convolution network

Deep Multi-Scale Mesh Feature Learning for Automated Labeling of Raw Dental Surfaces from 3D Intraoral Scanners

Clinically Applicable System For 3D Teeth Segmentation in Intraoral Scans using Deep Learning

MeshSNet: Deep Multi-scale Mesh Feature Learning for End-to-End Tooth Labeling on 3D Dental Surfaces.

Tooth Defect Segmentation in 3D Mesh Scans Using Deep Learning

MeshFormer: High-resolution Mesh Segmentation with Graph Transformer

Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation

TFormer: 3D Tooth Segmentation in Mesh Scans with Geometry Guided Transformer

Few sampling meshes-based 3D tooth segmentation via region-aware graph convolutional network

A Novel Hierarchical Cross-Stream Aggregation Neural Network for Semantic Segmentation of 3-D Dental Surface Models

Privacy-Preserved Federated Learning for 3D Tooth Segmentation in Intra-Oral Mesh Scans

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

TSegFormer: 3D Tooth Segmentation in Intraoral Scans with Geometry Guided Transformer

3D Tooth Instance Segmentation Learning Objectness and Affinity in Point Cloud

Multi-scale bidirectional enhancement network for 3d dental model segmentation