Abstract:Highlights • Introduce a data augmentation strategy to expand the required different morphological data during the training and learning phase, and improve the algorithm’s feature learning ability for complex and diverse tumor morphology CT images. • Design attention mechanisms for encoding and decoding paths to extract fine pixel level features, improve feature extraction capabilities, and achieve efficient spatial channel feature fusion. • The deep supervision layer is used to correct and decode the final image data to provide high accuracy of results. • The effectiveness of this method has been affirmed through validation on the LITS, 3DIRCADb, and SLIVER datasets. BACKGROUND: Accurately extracting liver and liver tumors from medical images is an important step in lesion localization and diagnosis, surgical planning, and postoperative monitoring. However, the limited number of radiation therapists and a great number of images make this work time-consuming. OBJECTIVE: This study designs a spatial attention deep supervised network (SADSNet) for simultaneous automatic segmentation of liver and tumors. METHOD: Firstly, self-designed spatial attention modules are introduced at each layer of the encoder and decoder to extract image features at different scales and resolutions, helping the model better capture liver tumors and fine structures. The designed spatial attention module is implemented through two gate signals related to liver and tumors, as well as changing the size of convolutional kernels; Secondly, deep supervision is added behind the three layers of the decoder to assist the backbone network in feature learning and improve gradient propagation, enhancing robustness. RESULTS: The method was testing on LITS, 3DIRCADb, and SLIVER datasets. For the liver, it obtained dice similarity coefficients of 97.03%, 96.11%, and 97.40%, surface dice of 81.98%, 82.53%, and 86.29%, 95% hausdorff distances of 8.96 mm, 8.26 mm, and 3.79 mm, and average surface distances of 1.54 mm, 1.19 mm, and 0.81 mm. Additionally, it also achieved precise tumor segmentation, which with dice scores of 87.81% and 87.50%, surface dice of 89.63% and 84.26%, 95% hausdorff distance of 12.96 mm and 16.55 mm, and average surface distances of 1.11 mm and 3.04 mm on LITS and 3DIRCADb, respectively. CONCLUSION: The experimental results show that the proposed method is effective and superior to some other methods. Therefore, this method can provide technical support for liver and liver tumor segmentation in clinical practice.

ISA-Net: Improved spatial attention network for PET-CT tumor segmentation

ASE-Net: A tumor segmentation method based on image pseudo enhancement and adaptive-scale attention supervision module

MRLA-Net: A Tumor Segmentation Network Embedded with a Multiple Receptive-Field Lesion Attention Module in PET-CT Images.

A Spatial Squeeze and Multimodal Feature Fusion Attention Network for Multiple Tumor Segmentation from PET–CT Volumes

Multimodal Spatial Attention Module for Targeting Multimodal PET-CT Lung Tumor Segmentation

MSRA-Net: Tumor segmentation network based on Multi-scale Residual Attention

LSAM: L2-norm self-attention and latent space feature interaction for automatic 3D multi-modal head and neck tumor segmentation

Attention in Attention for PET-CT Modality Consensus Lung Tumor Segmentation

Adaptive Attention Convolutional Neural Network for Liver Tumor Segmentation

SADSNet: A robust 3D synchronous segmentation network for liver and liver tumors based on spatial attention mechanism and deep supervision

Self-channel-and-spatial-attention Neural Network for Automated Multi-Organ Segmentation on Head and Neck CT Images.

Tumor co-segmentation in PET/CT using multi-modality fully convolutional neural network

A Novel Brain Tumor Segmentation Method Based on Im-proved Spatial Attention Mechanism and Multi-path Deep Neural Network

Joint segmentation of tumors in 3D PET-CT images with a network fusing multi-view and multi-modal information

Improved automatic segmentation of brain metastasis gross tumor volume in computed tomography images for radiotherapy: a position attention module for U-Net architecture

HSA-net with a novel CAD pipeline boosts both clinical brain tumor MR image classification and segmentation

Automated Lung Tumor Delineation on Positron Emission Tomography/computed Tomography Via a Hybrid Regional Network

DS-MSFF-Net: Dual-path Self-Attention Multi-Scale Feature Fusion Network for CT Image Segmentation

MTA-Net: A Multi-task Assisted Network for Whole-Body Lymphoma Segmentation

PA-Net: A phase attention network fusing venous and arterial phase features of CT images for liver tumor segmentation

Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation