Abstract:In clinical diagnosis, positron emission tomography and computed tomography (PET-CT) images containing complementary information are fused. Tumor segmentation based on multi-modal PET-CT images is an important part of clinical diagnosis and treatment. However, the existing current PET-CT tumor segmentation methods mainly focus on positron emission tomography (PET) and computed tomography (CT) feature fusion, which weakens the specificity of the modality. In addition, the information interaction between different modal images is usually completed by simple addition or concatenation operations, but this has the disadvantage of introducing irrelevant information during the multi-modal semantic feature fusion, so effective features cannot be highlighted. To overcome this problem, this paper propose a novel Multi-modal Fusion and Calibration Networks (MFCNet) for tumor segmentation based on three-dimensional PET-CT images. First, a Multi-modal Fusion Down-sampling Block (MFDB) with a residual structure is developed. The proposed MFDB can fuse complementary features of multi-modal images while retaining the unique features of different modal images. Second, a Multi-modal Mutual Calibration Block (MMCB) based on the inception structure is designed. The MMCB can guide the network to focus on a tumor region by combining different branch decoding features using the attention mechanism and extracting multi-scale pathological features using a convolution kernel of different sizes. The proposed MFCNet is verified on both the public dataset (Head and Neck cancer) and the in-house dataset (pancreas cancer). The experimental results indicate that on the public and in-house datasets, the average Dice values of the proposed multi-modal segmentation network are 74.14% and 76.20%, while the average Hausdorff distances are 6.41 and 6.84, respectively. In addition, the experimental results show that the proposed MFCNet outperforms the state-of-the-art methods on the two datasets.

Deep Multi-Scale Feature Fusion for Pancreas Segmentation from CT Images

Multi-phase and Multi-level Selective Feature Fusion for Automated Pancreas Segmentation from CT Images.

Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation

Deep Neural Network for Pancreas Segmentation from CT Images

Harnessing 2D Networks and 3D Features for Automated Pancreas Segmentation from Volumetric CT Images

Cascaded MultiTask 3-D Fully Convolutional Networks for Pancreas Segmentation

FPF-Net: Feature Propagation and Fusion Based on Attention Mechanism for Pancreas Segmentation

Pancreas segmentation using a dual-input v-mesh network

Advancing Pancreas Segmentation through the Patch-Adjust Fusion Framework.

Iterative 3D Feature Enhancement Network for Pancreas Segmentation from CT Images

High-Resolution Recurrent Gated Fusion Network for 3D Pancreas Segmentation.

A deep learning framework for pancreas segmentation with multi-atlas registration and 3D level-set

Hierarchical Combinatorial Deep Learning Architecture for Pancreas Segmentation of Medical Computed Tomography Cancer Images.

Pancreas Segmentation In Abdominal Ct Scans Using Inter-/Intra-Slice Contextual Information With A Cascade Neural Network

Incorporating Multi-Stage Spatial Visual Cues and Active Localization Offset for Pancreas Segmentation.

Segmentation of pancreatic tumors based on multi‐scale convolution and channel attention mechanism in the encoder‐decoder scheme

A Fully 3D Cascaded Framework for Pancreas Segmentation.

MFCNet: A multi-modal fusion and calibration networks for 3D pancreas tumor segmentation on PET-CT images

MDHT-Net: Multi-scale Deformable U-Net with Cos-spatial and Channel Hybrid Transformer for pancreas segmentation

DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation

Learning a Discriminative Feature Attention Network for Pancreas CT Segmentation