MADR-Net: multi-level attention dilated residual neural network for segmentation of medical images

Keerthiveena Balraj,Manojkumar Ramteke,Shachi Mittal,Rohit Bhargava,Anurag S. Rathore

DOI: https://doi.org/10.1038/s41598-024-63538-2

IF: 4.6

2024-06-05

Scientific Reports

Abstract:Medical image segmentation has made a significant contribution towards delivering affordable healthcare by facilitating the automatic identification of anatomical structures and other regions of interest. Although convolution neural networks have become prominent in the field of medical image segmentation, they suffer from certain limitations. In this study, we present a reliable framework for producing performant outcomes for the segmentation of pathological structures of 2D medical images. Our framework consists of a novel deep learning architecture, called deep multi-level attention dilated residual neural network (MADR-Net), designed to improve the performance of medical image segmentation. MADR-Net uses a U-Net encoder/decoder backbone in combination with multi-level residual blocks and atrous pyramid scene parsing pooling. To improve the segmentation results, channel-spatial attention blocks were added in the skip connection to capture both the global and local features and superseded the bottleneck layer with an ASPP block. Furthermore, we introduce a hybrid loss function that has an excellent convergence property and enhances the performance of the medical image segmentation task. We extensively validated the proposed MADR-Net on four typical yet challenging medical image segmentation tasks: (1) Left ventricle, left atrium, and myocardial wall segmentation from Echocardiogram images in the CAMUS dataset, (2) Skin cancer segmentation from dermoscopy images in ISIC 2017 dataset, (3) Electron microscopy in FIB-SEM dataset, and (4) Fluid attenuated inversion recovery abnormality from MR images in LGG segmentation dataset. The proposed algorithm yielded significant results when compared to state-of-the-art architectures such as U-Net, Residual U-Net, and Attention U-Net. The proposed MADR-Net consistently outperformed the classical U-Net by 5.43%, 3.43%, and 3.92% relative improvement in terms of dice coefficient, respectively, for electron microscopy, dermoscopy, and MRI. The experimental results demonstrate superior performance on single and multi-class datasets and that the proposed MADR-Net can be utilized as a baseline for the assessment of cross-dataset and segmentation tasks.

multidisciplinary sciences

What problem does this paper attempt to address?

The main objective of this paper is to propose a new deep learning architecture, called Multi-level Attention Dilated Residual Neural Network (MADR-Net), to address challenging issues in medical image segmentation tasks. Specifically, the study aims to overcome the limitations of traditional Convolutional Neural Networks (CNNs) in medical image segmentation, such as spatial information loss and limited ability to handle image variations.

The key contributions of MADR-Net include:
1. **Improvement based on the classic U-Net**: Overcoming the problem of spatial information loss by replacing the convolutional blocks in U-Net with multi-level dilated residual blocks.
2. **Introduction of channel-spatial attention mechanism**: Extracting shallow and deep feature maps and enhancing the focus on regions of interest for target segmentation, thereby achieving higher accuracy throughout the experiments.
3. **Use of a hybrid loss function**: Combining cross-entropy, Dice loss, and focal Tversky loss to accelerate convergence and improve the performance of the segmentation task.
4. **Generality across multiple image modalities**: Validating the effectiveness of MADR-Net on various medical image modalities, including electron microscopy images, dermoscopy images, echocardiography images, and Magnetic Resonance Imaging (MRI).
5. **Comparison with existing technologies**: Comparing the proposed MADR-Net with current state-of-the-art architectures such as U-Net and Attention U-Net, demonstrating its superiority.

Through the aforementioned improvements, MADR-Net aims to become a reliable and widely applicable solution that can be applied to different medical image segmentation tasks.