Abstract:Background and Objective: Achieving accurate and automated tumor segmentation plays an important role in both clinical practice and radiomics research. Segmentation in medicine is now often performed manually by experts, which is a laborious, expensive and error-prone task. Manual annotation relies heavily on the experience and knowledge of these experts. In addition, there is much intra- and interobserver variation. Therefore, it is of great significance to develop a method that can automatically segment tumor target regions. Methods: In this paper, we propose a deep learning segmentation method based on multimodal positron emission tomography-computed tomography (PET-CT), which combines the high sensitivity of PET and the precise anatomical information of CT. We design an improved spatial attention network(ISA-Net) to increase the accuracy of PET or CT in detecting tumors, which uses multi-scale convolution operation to extract feature information and can highlight the tumor region location information and suppress the non-tumor region location information. In addition, our network uses dual-channel inputs in the coding stage and fuses them in the decoding stage, which can take advantage of the differences and complementarities between PET and CT. Results: We validated the proposed ISA-Net method on two clinical datasets, a soft tissue sarcoma(STS) and a head and neck tumor(HECKTOR) dataset, and compared with other attention methods for tumor segmentation. The DSC score of 0.8378 on STS dataset and 0.8076 on HECKTOR dataset show that ISA-Net method achieves better segmentation performance and has better generalization. Conclusions: The method proposed in this paper is based on multi-modal medical image tumor segmentation, which can effectively utilize the difference and complementarity of different modes. The method can also be applied to other multi-modal data or single-modal data by proper adjustment.

Position Prior Attention Network for Pancreas Tumor Segmentation.

Tri-PANet: Triplanar Ensemble Network with Parallelly Aggregating Global and Local Information for Brain Tumor Segmentation

Position-aware representation learning with anatomical priors for enhanced pancreas tumor segmentation

Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation

Prior Attention Network for Multi-Lesion Segmentation in Medical Images

CT-based Pancreatic Multi-organ Segmentation by a 3D Deep Attention U-Net Network

Application of a pyramid pooling Unet model with integrated attention mechanism and Inception module in pancreatic tumor segmentation

Attention-guided duplex adversarial U-net for pancreatic segmentation from computed tomography images

Multi-target segmentation of pancreas and pancreatic tumor based on fusion of attention mechanism

Priori and Posteriori Attention for Generalizing Head and Neck Tumors Segmentation.

Asymmetric multi-task attention network for prostate bed segmentation in computed tomography images

Dense attentional network for pancreas segmentation in abdominal CT scans

PEA-U-Net: Parallel Embedded Attention for Liver and Tumor Segmentation in CT Volumes.

Harnessing 2D Networks and 3D Features for Automated Pancreas Segmentation from Volumetric CT Images

Graph-enhanced U-Net for semi-supervised segmentation of pancreas from abdomen CT scan

Automatic multi-tissue segmentation in pancreatic pathological images with selected multi-scale attention network

DPAFNet: A Residual Dual-Path Attention-Fusion Convolutional Neural Network for Multimodal Brain Tumor Segmentation

Learning a Discriminative Feature Attention Network for Pancreas CT Segmentation

Target-aware U-Net with fuzzy skip connections for refined pancreas segmentation

SCPMan: Shape context and prior constrained multi-scale attention network for pancreatic segmentation

ISA-Net: Improved spatial attention network for PET-CT tumor segmentation