A novel difficult-to-segment samples focusing network for oral CBCT image segmentation

Fengjun Hu,Zeyu Chen,Fan Wu
DOI: https://doi.org/10.1038/s41598-024-55522-7
IF: 4.6
2024-03-02
Scientific Reports
Abstract:Using deep learning technology to segment oral CBCT images for clinical diagnosis and treatment is one of the important research directions in the field of clinical dentistry. However, the blurred contour and the scale difference limit the segmentation accuracy of the crown edge and the root part of the current methods, making these regions become difficult-to-segment samples in the oral CBCT segmentation task. Aiming at the above problems, this work proposed a Difficult-to-Segment Focus Network (DSFNet) for segmenting oral CBCT images. The network utilizes a Feature Capturing Module (FCM) to efficiently capture local and long-range features, enhancing the feature extraction performance. Additionally, a Multi-Scale Feature Fusion Module (MFFM) is employed to merge multiscale feature information. To further improve the loss ratio for difficult-to-segment samples, a hybrid loss function is proposed, combining Focal Loss and Dice Loss. By utilizing the hybrid loss function, DSFNet achieves 91.85% Dice Similarity Coefficient (DSC) and 0.216 mm Average Symmetric Surface Distance (ASSD) performance in oral CBCT segmentation tasks. Experimental results show that the proposed method is superior to current dental CBCT image segmentation techniques and has real-world applicability.
multidisciplinary sciences
What problem does this paper attempt to address?
This paper attempts to address the issue of low accuracy in existing methods for segmenting the crown edges and root areas of teeth in oral cone-beam computed tomography (CBCT) images. Specifically, due to the blurred contours of teeth in CBCT images and the significant scale differences between different segmentation targets, these areas become difficult samples to segment. To solve these problems, the paper proposes a new network structure—Difficult Sample Focusing Network (DSFNet), aimed at improving the segmentation accuracy of these challenging areas. ### Main Contributions: 1. **Proposed Difficult Sample Focusing Network (DSFNet)**: - **Feature Capture Module (FCM)**: Efficiently extracts local and long-distance features, enhancing feature extraction performance. - **Multi-Scale Feature Fusion Module (MFFM)**: Fuses multi-scale feature information, reducing noise caused by skip connections. 2. **Proposed Hybrid Loss Function**: - Combines Focal Loss and Dice Loss, and improves Dice Loss to further increase the loss proportion of difficult samples, making the network more focused on these samples. 3. **Experimental Results**: - Using the hybrid loss function, DSFNet achieved a 91.85% Dice Similarity Coefficient (DSC) and a 0.216 mm Average Symmetric Surface Distance (ASSD) in the oral CBCT image segmentation task, outperforming existing models. ### Background: - Oral CBCT technology forms accurate 3D image data by reconstructing multiple 2D X-ray images, providing comprehensive and accurate information for dental diagnosis and treatment. - However, manually segmenting teeth in CBCT images is a complex and time-consuming task, and subjective judgment can affect annotation results, limiting work efficiency. - Deep learning technology has been widely applied to medical image segmentation tasks, but there are still limitations in handling oral CBCT images, especially when dealing with small-scale and boundary-blurred samples. ### Method: - **Overall Architecture**: DSFNet adopts a U-shaped structure with skip connections, including three down-sampling and three up-sampling stages. - **Feature Capture Module (FCM)**: Combines convolution and Transformer operations to extract both local and long-distance features. - **Multi-Scale Feature Fusion Module (MFFM)**: Uses attention mechanisms to build intra-scale and inter-scale attention, improving segmentation performance on difficult samples. - **Hybrid Loss Function**: Combines Focal Loss and improved Dice Loss, making the network more focused on difficult-to-segment samples. ### Experimental Results: - In the oral CBCT image segmentation task, DSFNet outperformed existing models, especially in segmenting the crown edges and root areas of teeth. ### Conclusion: - This study delves into the challenges faced by current deep neural networks in segmenting oral CBCT images and proposes the novel DSFNet architecture. Experimental results show that DSFNet has significant advantages in handling difficult-to-segment samples, particularly in segmenting the crown edges and root areas of teeth.