Abstract:ObjectivesTo evaluate the performance of the nnU-Net open-source deep learning framework for automatic multi-task segmentation of craniomaxillofacial (CMF) structures in CT scans obtained for computer-assisted orthognathic surgery.MethodsFour hundred and fifty-three consecutive patients having undergone high-resolution CT scans before orthognathic surgery were randomly distributed among a training/validation cohort (n = 300) and a testing cohort (n = 153). The ground truth segmentations were generated by 2 operators following an industry-certified procedure for use in computer-assisted surgical planning and personalized implant manufacturing. Model performance was assessed by comparing model predictions with ground truth segmentations. Examination of 45 CT scans by an industry expert provided additional evaluation. The model’s generalizability was tested on a publicly available dataset of 10 CT scans with ground truth segmentation of the mandible.ResultsIn the test cohort, mean volumetric Dice similarity coefficient (vDSC) and surface Dice similarity coefficient at 1 mm (sDSC) were 0.96 and 0.97 for the upper skull, 0.94 and 0.98 for the mandible, 0.95 and 0.99 for the upper teeth, 0.94 and 0.99 for the lower teeth, and 0.82 and 0.98 for the mandibular canal. Industry expert segmentation approval rates were 93% for the mandible, 89% for the mandibular canal, 82% for the upper skull, 69% for the upper teeth, and 58% for the lower teeth.ConclusionWhile additional efforts are required for the segmentation of dental apices, our results demonstrated the model’s reliability in terms of fully automatic segmentation of preoperative orthognathic CT scans.Key Points• The nnU-Net deep learning framework can be trained out-of-the-box to provide robust fully automatic multi-task segmentation of CT scans performed for computer-assisted orthognathic surgery planning.• The clinical viability of the trained nnU-Net model is shown on a challenging test dataset of 153 CT scans randomly selected from clinical practice, showing metallic artifacts and diverse anatomical deformities.• Commonly used biomedical segmentation evaluation metrics (volumetric and surface Dice similarity coefficient) do not always match industry expert evaluation in the case of more demanding clinical applications.

Automatic craniomaxillofacial landmarks detection in CT images of individuals with dentomaxillofacial deformities by a two-stage deep learning model

Automatic Detection of Craniomaxillofacial Anatomical Landmarks on CBCT Images Using 3D Mask R-CNN.

Craniomaxillofacial landmarks detection in CT scans with limited labeled data via semi-supervised learning

Localization of Craniomaxillofacial Landmarks on CBCT Images Using 3D Mask R-CNN and Local Dependency Learning

Automatic Localization of Landmarks in Craniomaxillofacial CBCT Images Using a Local Attention-Based Graph Convolution Network.

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Fast and Accurate Craniomaxillofacial Landmark Detection Via 3D Faster R-CNN.

Automated Cephalometric Landmark Detection: A Novel Software Model Compared with Manual Annotation Method

[Automated cephalometric landmark identification and location based on convolutional neural network]

CMF-Net: Craniomaxillofacial Landmark Localization on CBCT Images Using Geometric Constraint and Transformer

CephaNet: an Improved Faster R-CNN for Cephalometric Landmark Detection.

Semi-automatic Cephalometric Landmark Detection on X-ray Images Using Deep Learning Method

Automated detection of cephalometric landmarks using deep neural patchworks

Deep learning segmentation of mandible with lower dentition from cone beam CT

Learning-based local-to-global landmark annotation for automatic 3D cephalometry

Automatic Cephalometric Landmark Identification System Based on the Multi-Stage Convolutional Neural Networks with CBCT Combination Images

Automatic Masseter Muscle Accurate Segmentation from CBCT Using Deep Learning-Based Model.

Automatic Cephalometric Landmark Detection on X-Ray Images Using Object Detection

An Efficient Deep Learning Based Coarse-to-Fine Cephalometric Landmark Detection Method

A DCNN system based on an iterative method for automatic landmark detection in cephalometric X-ray images

Fully automatic segmentation of craniomaxillofacial CT scans for computer-assisted orthognathic surgery planning using the nnU-Net framework