Abstract:Automatic gastric tumor segmentation and lymph node (LN) classification not only can assist radiologists in reading images, but also provide image-guided clinical diagnosis and improve diagnosis accuracy. However, due to the inhomogeneous intensity distribution of gastric tumor and LN in CT scans, the ambiguous/missing boundaries, and highly variable shapes of gastric tumor, it is quite challenging to develop an automatic solution. To comprehensively address these challenges, we propose a novel 3D multi-attention guided multi-task learning network for simultaneous gastric tumor segmentation and LN classification, which makes full use of the complementary information extracted from different dimensions, scales, and tasks. Specifically, we tackle task correlation and heterogeneity with the convolutional neural network consisting of scale-aware attention-guided shared feature learning for refined and universal multi-scale features, and task-aware attention-guided feature learning for task-specific discriminative features. This shared feature learning is equipped with two types of scale-aware attention (visual attention and adaptive spatial attention) and two stage-wise deep supervision paths. The task-aware attention-guided feature learning comprises a segmentation-aware attention module and a classification-aware attention module. The proposed 3D multi-task learning network can balance all tasks by combining segmentation and classification loss functions with weight uncertainty. We evaluate our model on an in-house CT images dataset collected from three medical centers. Experimental results demonstrate that our method outperforms the state-of-the-art algorithms, and obtains promising performance for tumor segmentation and LN classification. Moreover, to explore the generalization for other segmentation tasks, we also extend the proposed network to liver tumor segmentation in CT images of the MICCAI 2017 Liver Tumor Segmentation Challenge. Our implementation is released at https://github.com/infinite-tao/MA-MTLN.

Automatic lymph node segmentation using deep parallel squeeze & excitation and attention Unet

LSAM: L2-norm self-attention and latent space feature interaction for automatic 3D multi-modal head and neck tumor segmentation

3D PETCT Tumor Lesion Segmentation via GCN Refinement

Whole-Body Lesion Segmentation in 18F-FDG PET/CT

3D Reconstruction-Oriented Fully Automatic Multi-Modal Tumor Segmentation by Dual Attention-Guided VNet

3D PET/CT tumor segmentation based on nnU-Net with GCN refinement

Automatic Detection and Segmentation of Axillary Lymph Nodes.

Lgma-net: liver and tumor segmentation methods based on local–global feature mergence and attention mechanisms

Image Segmentation of Triple-Negative Breast Cancer by Incorporating Multiscale and Parallel Attention Mechanisms

LATUP-Net: A Lightweight 3D Attention U-Net with Parallel Convolutions for Brain Tumor Segmentation

3D Multi-Attention Guided Multi-Task Learning Network for Automatic Gastric Tumor Segmentation and Lymph Node Classification.

DSU-net: Dense SegU-net for automatic head-and-neck tumor segmentation in MR images

Application of U-Net Network Utilizing Multiattention Gate for MRI Segmentation of Brain Tumors

Anterior Mediastinal Nodular Lesion Segmentation from Chest Computed Tomography Imaging Using UNet Based Neural Network with Attention Mechanisms

PEA-U-Net: Parallel Embedded Attention for Liver and Tumor Segmentation in CT Volumes.

C2BA-UNet: A context-coordination multi-atlas boundary-aware UNet-like method for PET/CT images based tumor segmentation

DASGC-Unet: An Attention Network for Accurate Segmentation of Liver CT Images

Eres-UNet++: Liver CT image segmentation based on high-efficiency channel attention and Res-UNet++

DAUnet: A U-shaped network combining deep supervision and attention for brain tumor segmentation

Multilevel Attention Unet Segmentation Algorithm for Lung Cancer Based on CT Images

Multiscale lightweight 3D segmentation algorithm with attention mechanism: Brain tumor image segmentation