A Dual-branch Framework Based on Implicit Continuous Representation for Tumor Image Segmentation

Jing Wang,Yuanjie Zheng,Junxia Wang,Xiao Xiao,Jing Sun
DOI: https://doi.org/10.21203/rs.3.rs-3548540/v1
2023-01-01
Abstract:Abstract Breast tumor segmentation has important significance for early detection and determination of treatment plans. However, segmenting early-stage small tumors in breast images is challenging due to small and low-resolution tumor regions, variation of tumor shapes, and blurred tumor boundaries. More importantly, breast scans are usually noisy and include metal artifacts. Most of the existing tumor segmentation methods have difficulty in extracting lesion discriminative information, leading to the problem that small tumors are ignored or predictions contain a lot of noise. In addition, common reconstruction and segmentation algorithms are based on discrete images and ignore the continuity of feature space. Therefore, in this paper, we investigate a novel and flexible dual-branch framework, named High-Resolution and Information Bottleneck-based Segmentation Network (HR-IBS), for breast tumor segmentation. For the first time, this method introduces the high-resolution tumor region reconstruction (HR-TR) branch via implicit neural representations to learning functions that map the discrete input signal to continuous density. The branch enables reconstruction from lesion regions for another segmentation branch. Furthermore, we design an Information bottleneck-based segmentation (IBS) branch, which adopts information bottleneck and U-Net to retain the features most relevant while removing noisy regions, and discovering more informative lesion regions. The reconstruction and segmentation branches interact with each other to facilitate performance. Comprehensive experiments are conducted on segmentation benchmarks of two modalities of breast images. The results show that the proposed method outperforms other segmentation models and contributes to optimizing hand-crafted ground-truths.
What problem does this paper attempt to address?