BAAF: A Benchmark Attention Adaptive Framework for Medical Ultrasound Image Segmentation Tasks

Gongping Chen,Lei Zhao,Xiaotao Yin,Liang Cui,Jianxun Zhang,Yu Dai

2023-10-02

Abstract:The AI-based assisted diagnosis programs have been widely investigated on medical ultrasound images. Complex scenario of ultrasound image, in which the coupled interference of internal and external factors is severe, brings a unique challenge for localize the object region automatically and precisely in ultrasound images. In this study, we seek to propose a more general and robust Benchmark Attention Adaptive Framework (BAAF) to assist doctors segment or diagnose lesions and tissues in ultrasound images more quickly and accurately. Different from existing attention schemes, the BAAF consists of a parallel hybrid attention module (PHAM) and an adaptive calibration mechanism (ACM). Specifically, BAAF first coarsely calibrates the input features from the channel and spatial dimensions, and then adaptively selects more robust lesion or tissue characterizations from the coarse-calibrated feature maps. The design of BAAF further optimizes the "what" and "where" focus and selection problems in CNNs and seeks to improve the segmentation accuracy of lesions or tissues in medical ultrasound images. The method is evaluated on four medical ultrasound segmentation tasks, and the adequate experimental results demonstrate the remarkable performance improvement over existing state-of-the-art methods. In addition, the comparison with existing attention mechanisms also demonstrates the superiority of BAAF. This work provides the possibility for automated medical ultrasound assisted diagnosis and reduces reliance on human accuracy and precision.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The paper primarily addresses the issue of automatic segmentation of medical ultrasound images and proposes a new framework called the Benchmark Attention Adaptive Framework (BAAF). Specifically, the study aims to solve the following key problems: 1. **Automatic localization and precise segmentation in complex scenarios**: Due to the coupling interference of internal and external factors in ultrasound images, automatically and accurately locating the region of interest (such as lesions or tissues) in ultrasound images is a unique challenge. 2. **Improving diagnostic efficiency and reducing misdiagnosis**: Manually annotating medical ultrasound images is time-consuming and prone to errors, especially when dealing with similar intensity distributions, variable target morphologies, and fuzzy boundaries. Therefore, developing automatic segmentation methods is crucial for improving efficiency and reducing misdiagnosis. 3. **Limitations of existing methods**: Although convolutional neural network (CNN)-based methods (such as U-Net and fully convolutional networks FCNN) have made significant progress, they still have limitations when dealing with medical ultrasound images with the aforementioned complexities. To address these issues, the paper proposes the BAAF framework, which includes two main components: - **Parallel Hybrid Attention Module (PHAM)**: Used to calibrate input features from channel and spatial dimensions. - **Adaptive Calibration Mechanism (ACM)**: Selects more robust target representations from the calibrated feature maps. Through these mechanisms, BAAF aims to optimize the focus issues in CNNs and improve the segmentation accuracy of lesions or tissues in medical ultrasound images. Additionally, the study evaluates the performance of BAAF on four medical ultrasound segmentation tasks and compares it with existing state-of-the-art methods. The results show that BAAF achieves significant performance improvements in all tasks. This indicates that BAAF provides possibilities for medical ultrasound-assisted diagnosis and reduces the reliance on manual precision and accuracy.

BAAF: A Benchmark Attention Adaptive Framework for Medical Ultrasound Image Segmentation Tasks

Balancing Regional and Global Information: an Interactive Segmentation Framework for Ultrasound Breast Lesion.

AAU-Net: An Adaptive Attention U-Net for Breast Lesions Segmentation in Ultrasound Images

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

Simultaneous Segmentation of Fetal Hearts and Lungs for Medical Ultrasound Images Via an Efficient Multi-scale Model Integrated with Attention Mechanism

SAA-NET: A Medical Image Segmentation Framework Based on Stream-Across Attention

ACA U-Net: Asymmetric Channel Attention Mechanism for Semantic Segmentation of Breast Ultrasound Images

Label-Aware Attention Network with Multi-Scale Boosting for Medical Image Segmentation

Spatial Attention Lesion Detection On Automated Breast Ultrasound

Segmentation Information with Attention Integration for Classification of Breast Tumor in Ultrasound Image

Hybrid Intelligent-Annotation Organ Segmentation on Medical Datasets

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

AHU-MultiNet: Adaptive loss balancing based on homoscedastic uncertainty in multi-task medical image segmentation network

Ultrasound Median Nerve Image Instance Segmentation Via Nesting Attention and Boundary-guided Segmentation Mechanism.

Boundary-aware Segmentation Network Using Multi-Task Enhancement for Ultrasound Image.

BAF-Net: bidirectional attention-aware fluid pyramid feature integrated multimodal fusion network for diagnosis and prognosis

Learning Rich Attention for Pediatric Bone Age Assessment

Target area distillation and section attention segmentation network for accurate 3D medical image segmentation

An efficient framework for lesion segmentation in ultrasound images using global adversarial learning and region-invariant loss

NFMPAtt-Unet: Neighborhood Fuzzy C-means Multi-scale Pyramid Hybrid Attention Unet for medical image segmentation

A comparative study of attention mechanism based deep learning methods for bladder tumor segmentation