Abstract:Purpose Medical image segmentation is critical for many medical image analysis applications. 3D convolutional neural networks (CNNs) have been widely adopted in the segmentation of volumetric medical images. The recent development of channelwise and spatialwise attentions achieves the state-of-the-art feature representation performance. However, these attention strategies have not explicitly modeled interdependencies among slices in 3D medical volumes. In this work, we propose a novel attention module called progressive attention module (PAM) to explicitly model the slicewise importance for 3D medical image analysis. Methods The proposed method is composed of three parts: Slice Attention (SA) block, Key-Slice-Selection (KSS) block, and Channel Attention (CA) block. First, the SA is a novel attention block to explore the correlation among slices for 3D medical image segmentation. SA is designed to explicitly reweight the importance of each slice in the 3D medical image scan. Second, the KSS block, cooperating with the SA block, is designed to adaptively emphasize the critical slice features while suppressing the irrelevant slice features, which helps the model focus on the slices with rich structural and contextual information. Finally, the CA block receives the output of KSS as input for further feature recalibration. Our proposed PAM organically combines SA, KSS, and CA, progressively highlights the key slices containing rich information for the relevant tasks while suppressing those irrelevant slices. Results To demonstrate the effectiveness of PAM, we embed it into 3D CNNs architectures and evaluate the segmentation performance on three public challenging data sets: BraTS 2018 data set, MALC data set, and HVSMR data set. We achieve 80.34%, 88.98%, and 84.43% of the Dice similarity coefficient on these three data sets, respectively. Experimental results show that the proposed PAM not only boosts the segmentation accuracy of the standard 3D CNNs methods consistently, but also outperforms the other attention mechanisms with slight extra costs. Conclusions We propose a new PAM to identify the most informative slices and recalibrate channelwise feature responses for volumetric medical image segmentation. The proposed method is evaluated on three public data sets, and the results show improvements over other methods. This proposed technique can effectively assist physicians in many medical image analysis. It is also anticipated to be generalizable and transferable to assist physicians in a wider range of medical imaging applications to produce greater value and impact to health.

PnP-AE: A Plug-and-Play Module for Volumetric Medical Image Segmentation

Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation.

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

A Lightweight Deep Network for 3D Medical Image Segmentation.

One Network to Segment Them All: A General, Lightweight System for Accurate 3D Medical Image Segmentation

PAM: A Propagation-Based Model for Segmenting Any 3D Objects across Multi-Modal Medical Images

PnP-3D: A Plug-and-Play for 3D Point Clouds

Cascaded 3D Object Segmentation with Volumetric Propagation Network

Tri-Plane Mamba: Efficiently Adapting Segment Anything Model for 3D Medical Images

Progressive Attention Module for Segmentation of Volumetric Medical Images.

Volumetric memory network for interactive medical image segmentation

PLN: Parasitic-Like Network for Barely Supervised Medical Image Segmentation

EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

Bridging 2D and 3D Segmentation Networks for Computation Efficient Volumetric Medical Image Segmentation: An Empirical Study of 2.5D Solutions

Sli2Vol+: Segmenting 3D Medical Images Based on an Object Estimation Guided Correspondence Flow Network

Deep learning network for medical volume data segmentation based on multi axial plane fusion

A deep learning-based strategy for producing dense 3D segmentations from sparsely annotated 2D images

PIS-Net: Efficient Medical Image Segmentation Network with Multivariate Downsampling for Point-of-Care

PnPNet: Pull-and-Push Networks for Volumetric Segmentation with Boundary Confusion

V-NAS: Neural Architecture Search for Volumetric Medical Image Segmentation

Point-Unet: A Context-aware Point-based Neural Network for Volumetric Segmentation