Abstract:Accurate teeth delineation on 3-D dental models is essential for individualized orthodontic treatment planning. Pioneering works like PointNet suggest a promising direction to conduct efficient and accurate 3-D dental model analyses in end-to-end learnable fashions. Recent studies further imply that multistream architectures to concurrently learn geometric representations from different inputs/views (e.g., coordinates and normals) are beneficial for segmenting teeth with varying conditions. However, such multistream networks typically adopt simple late-fusion strategies to combine features captured from raw inputs that encode complementary but fundamentally different geometric information, potentially hampering their accuracy in end-to-end semantic segmentation. This article presents a hierarchical cross-stream aggregation (HiCA) network to learn more discriminative point/cell-wise representations from multiview inputs for fine-grained 3-D semantic segmentation. Specifically, based upon our multistream backbone with input-tailored feature extractors, we first design a contextual cross-steam aggregation (CA) module conditioned on interstream consistency to boost each view's contextual representation learning jointly. Then, before the late fusion of different streams' outputs for segmentation, we further deploy a discriminative cross-stream aggregation (DA) module to concurrently update all views' discriminative representation learning by leveraging a specific graph attention strategy induced by multiview prototype learning. On both public and in-house datasets of real-patient dental models, our method significantly outperformed state-of-the-art (SOTA) deep learning methods for teeth semantic segmentation. In addition, extended experimental results suggest the applicability of HiCA to other general 3-D shape segmentation tasks. The code is available at https://github.com/ladderlab-xjtu/HiCA.

TSGCNet: Discriminative Geometric Feature Learning with Two-Stream Graph Convolutional Network for 3D Dental Model Segmentation

TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentation

Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation

TeethGNN: Semantic 3D Teeth Segmentation with Graph Neural Networks

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

3D Dental model segmentation with graph attentional convolution network

Automatic Tooth Segmentation and Dense Correspondence of 3D Dental Model.

3D Dental Mesh Segmentation Using Semantics-Based Feature Learning with Graph-Transformer

Individual Graph Representation Learning for Pediatric Tooth Segmentation from Dental CBCT

Clinically Applicable System For 3D Teeth Segmentation in Intraoral Scans using Deep Learning

Automatic Detection of Tooth-Gingiva Trim Lines on Dental Surfaces

A Novel Hierarchical Cross-Stream Aggregation Neural Network for Semantic Segmentation of 3-D Dental Surface Models

Tooth Defect Segmentation in 3D Mesh Scans Using Deep Learning

3D Tooth Segmentation and Labeling Using Deep Convolutional Neural Networks

Multi-scale bidirectional enhancement network for 3d dental model segmentation

MeshSNet: Deep Multi-scale Mesh Feature Learning for End-to-End Tooth Labeling on 3D Dental Surfaces.

Few sampling meshes-based 3D tooth segmentation via region-aware graph convolutional network

Geo-Net: Geometry-Guided Pretraining for Tooth Point Cloud Segmentation

Deep Multi-Scale Mesh Feature Learning for Automated Labeling of Raw Dental Surfaces from 3D Intraoral Scanners

A fine-grained orthodontics segmentation model for 3D intraoral scan data