Abstract:Accurate medical image segmentation is essential for diagnosis and treatment planning of diseases. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they are still challenged by complicated conditions where the segmentation target has large variations of position, shape and scale, and existing CNNs have a poor explainability that limits their application to clinical decisions. In this work, we make extensive use of multiple attentions in a CNN architecture and propose a comprehensive attention-based CNN (CA-Net) for more accurate and explainable medical image segmentation that is aware of the most important spatial positions, channels and scales at the same time. In particular, we first propose a joint spatial attention module to make the network focus more on the foreground region. Then, a novel channel attention module is proposed to adaptively recalibrate channel-wise feature responses and highlight the most relevant feature channels. Also, we propose a scale attention module implicitly emphasizing the most salient feature maps among multiple scales so that the CNN is adaptive to the size of an object. Extensive experiments on skin lesion segmentation from ISIC 2018 and multi-class segmentation of fetal MRI found that our proposed CA-Net significantly improved the average segmentation Dice score from 87.77% to 92.08% for skin lesion, 84.79% to 87.08% for the placenta and 93.20% to 95.88% for the fetal brain respectively compared with U-Net. It reduced the model size to around 15 times smaller with close or even better accuracy compared with state-of-the-art DeepLabv3+. In addition, it has a much higher explainability than existing networks by visualizing the attention weight maps. Our code is available at https://github.com/HiLab-git/CA-Net.

Segmentation and Attention Network for Complicated X-Ray Images

Automatic Defect Segmentation in X-Ray Images Based on Deep Learning

A deep learning-based recognition for dangerous objects imaged in X-ray security inspection device.

Segmentation-Based X-Ray Multi-Objective Quality Assessment Network

Multi-Object Detection in Security Screening Scene Based on Convolutional Neural Network

Interactive Defect Segmentation in X-Ray Images Based on Deep Learning

Attention‐based prohibited item detection in X‐ray images during security checking

A Robust Segmentation Method Based on Improved U-Net

Is Segment Anything Model Ready for X-Ray Object Segmentation?

Automatic and Robust Object Detection in X-Ray Baggage Inspection Using Deep Convolutional Neural Networks

Multi-Target Prohibited Item Recognition Algorithm for X-Ray Security Scene

On the impact of using X-ray energy response imagery for object detection via Convolutional Neural Networks

Full‐scale Attention Network for Automated Organ Segmentation on Head and Neck CT and MR Images

X-YOLO: An Efficient Detection Network of Dangerous Objects in X-Ray Baggage Images

Material-Aware Path Aggregation Network and Shape Decoupled SIoU for X-ray Contraband Detection

SC2Net: A Novel Segmentation-Based Classification Network for Detection of COVID-19 in Chest X-Ray Images

H-SegNet: hybrid segmentation network for lung segmentation in chest radiographs using mask region-based convolutional neural network and adaptive closed polyline searching method

Target area distillation and section attention segmentation network for accurate 3D medical image segmentation

CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentation

Enhanced Security Contraband Detection Through Integration of Attention Mechanism in R3Det

Smoother Soft-Nms For Overlapping Object Detection In X-Ray Images