Boundary feature fusion network for tooth image segmentation

Dongping Zhang,Zheng Li,Fangao Zeng,Yutong Wei
2024-09-06
Abstract:Tooth segmentation is a critical technology in the field of medical image segmentation, with applications ranging from orthodontic treatment to human body identification and dental pathology assessment. Despite the development of numerous tooth image segmentation models by researchers, a common shortcoming is the failure to account for the challenges of blurred tooth boundaries. Dental diagnostics require precise delineation of tooth boundaries. This paper introduces an innovative tooth segmentation network that integrates boundary information to address the issue of indistinct boundaries between teeth and adjacent tissues. This network's core is its boundary feature extraction module, which is designed to extract detailed boundary information from high-level features. Concurrently, the feature cross-fusion module merges detailed boundary and global semantic information in a synergistic way, allowing for stepwise layer transfer of feature information. This method results in precise tooth segmentation. In the most recent STS Data Challenge, our methodology was rigorously tested and received a commendable overall score of 0.91. When compared to other existing approaches, this score demonstrates our method's significant superiority in segmenting tooth boundaries.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the challenge of blurred boundaries in tooth image segmentation. Specifically, tooth image segmentation has important applications in the field of medical image processing, such as orthodontic treatment, human body recognition, and dental pathology assessment. However, the common problem in existing tooth image segmentation models is that they fail to fully consider the issue of blurred tooth boundaries, which makes it difficult to accurately divide the boundaries between teeth and adjacent tissues. To address this challenge, the paper proposes an innovative tooth segmentation network - the Boundary Feature Fusion Network (BFFNet). The core of this network lies in its Boundary Feature Extraction Module (BFEM), which aims to extract detailed boundary information from high - level features. Meanwhile, the Feature Cross - Fusion Module (FCFM) synergistically fuses the detailed boundary information with global semantic information to achieve the layer - by - layer transfer of feature information, thereby achieving accurate tooth segmentation results. By introducing these modules, BFFNet can more effectively solve the problem of blurred boundaries in tooth images, providing a more effective and accurate tool for oral medical image analysis. In addition, this method has achieved remarkable results in the recent STS data challenge, with an overall score of 0.91, demonstrating its superiority over other existing methods in segmenting tooth boundaries. ### Formula Summary - **Boundary Feature Extraction Module Formula**: \[ Fe_i=(Fi\otimes Wi)\oplus Fi\quad\text{(Formula 1)} \] \[ Wi = E-(\sigma(\text{Up}(Si + 1)))\quad\text{(Formula 2)} \] where $\text{Up}(\cdot)$ represents the up - sampling operation, $\sigma(\cdot)$ represents the Sigmoid function, $E$ is a matrix of all ones, $\otimes$ represents element - wise multiplication, and $\oplus$ represents element - wise addition. - **Feature Cross - Fusion Module Formula**: \[ Flocal_{j,j + 1}=\text{Con}\nu3(Fj,j + 1)\otimes Wlocal\oplus\text{Con}\nu3(Fj,j + 1)\quad\text{(Formula 3)} \] \[ Wlocal=\sigma(P-\text{Con}\nu_2(\delta(P-\text{Con}\nu_1(\text{Con}\nu_3(Fj,j + 1))))) \quad\text{(Formula 4)} \] \[ Fu_{j,j + 1}=\text{Con}\nu_3(\text{Concat}(Flocal_{j,j + 1},\text{Con}\nu_3(Fj,j + 1)))\quad\text{(Formula 5)} \] - **Loss Function**: \[ \text{Loss}=Lw_{IOU}+Lw_{BCE}\quad\text{(Formula 6)} \] \[ Ltotal = L(G,Fup_G)+L(G,Fs - up_3)+L(G,Fs - up_4)+L(G,Fs - up_5)\quad\text{(Formula 7)} \] - **Evaluation Metric Formula**: \[ \text{Dice}=\frac{2*|A\cap B|}{|A|+|B|}\quad\text{(Formula 8)} \] \[ \text{IOU}=\frac{|A\cap B|}{|A\cup B|}\quad\text{(Formula 9)} \] \[ H(d)=\min(|x1 - x2|+|y1 - y2|)\quad\text{