Abstract:The understanding of long-range pixel–pixel dependencies plays a vital role in image segmentation. The use of a CNN plus an attention mechanism still has room for improvement, since existing transformer-based architectures require many thousands of annotated training samples to model long-range spatial dependencies. This paper presents a smooth attention branch (SAB), a novel architecture that simplifies the understanding of long-range pixel–pixel dependencies for biomedical image segmentation in small datasets. The SAB is essentially a modified attention operation that implements a subnetwork via reshaped feature maps instead of directly calculating a softmax value over the attention score for each input. The SAB fuses multilayer attentive feature maps to learn visual attention in multilevel features. We also introduce position blurring and inner cropping specifically for small-scale datasets to prevent overfitting. Furthermore, we redesign the skip pathway for the reduction of the semantic gap between every captured feature of the contracting and expansive path. We evaluate the architecture of U-Net with the SAB (SAB-Net) by comparing it with the original U-Net and widely used transformer-based models across multiple biomedical image segmentation tasks related to the Brain MRI, Heart MRI, Liver CT, Spleen CT, and Colonoscopy datasets. Our training set was made of random 100 images of the original training set, since our goal was to adopt attention mechanisms for biomedical image segmentation tasks with small-scale labeled data. An ablation study conducted on the brain MRI test set demonstrated that every proposed method achieved an improvement in biomedical image segmentation. Integrating the proposed methods helped the resulting models consistently achieve outstanding performance on the above five biomedical segmentation tasks. In particular, the proposed method with U-Net improved its segmentation performance over that of the original U-Net by 13.76% on the Brain MRI dataset. We proposed several novel methods to address the need for modeling long-range pixel–pixel dependencies in small-scale biomedical image segmentation. The experimental results illustrated that each method could improve the medical image segmentation accuracy to various degrees. Moreover, SAB-Net, which integrated all proposed methods, consistently achieved outstanding performance on the five biomedical segmentation tasks.

Influence of contrast and texture based image modifications on the performance and attention shift of U-Net models for brain tissue segmentation

Image Segmentation Using Improved U-Net Model and Convolutional Block Attention Module Based on Cardiac Magnetic Resonance Imaging

Contrast Adaptive Tissue Classification by Alternating Segmentation and Synthesis

Improved Unet brain tumor image segmentation based on GSConv module and ECA attention mechanism

Improving Whole-Heart CT Image Segmentation by Attention Mechanism

Performance Analysis of UNet and Variants for Medical Image Segmentation

Focal vs Diffuse: Mechanisms of attention mediated performance enhancement in a hierarchical model of the visual system

Effect of learning parameters on the performance of U-Net Model in segmentation of Brain tumor

Reducing Textural Bias Improves Robustness of Deep Segmentation Models

A Comparative Analysis of U-Net-based models for Segmentation of Cardiac MRI

Can a single image processing algorithm work equally well across all phases of DCE-MRI?

Alternating Segmentation and Simulation for Contrast Adaptive Tissue Classification

Automatic Cardiac MRI Segmentation Using Deep Learning

SEL-Net: a Multimodal Image Segmentation Method Based on Spatial Attention Mechanism

Benchmarking of Deep Architectures for Segmentation of Medical Images

U-Net-Based Models towards Optimal MR Brain Image Segmentation

Attention Mechanism Trained with Small Datasets for Biomedical Image Segmentation

Residual-Attention UNet++: A Nested Residual-Attention U-Net for Medical Image Segmentation

Attention Deep Residual Networks for MR Image Analysis.

Attention-based convolutional neural network for perfusion T2-weighted MR images preprocessing

A Medical Image Segmentation Algorithm Based on Spatial and Channel Attention Mechanisms and Data Augmentation