Abstract:BACKGROUND AND OBJECTIVE:Acute ischemic stroke (AIS) is a common neurological disorder characterized by the sudden onset of cerebral ischemia, leading to functional impairments. Swift and precise detection of AIS lesions is crucial for stroke diagnosis and treatment but poses a significant challenge. This study aims to leverage multimodal fusion technology to combine complementary information from various modalities, thereby enhancing the detection performance of AIS target detection models.METHODS:In this retrospective study of AIS, we collected data from 316 AIS patients and created a multi-modality magnetic resonance imaging (MRI) dataset. We propose a Multi-Scale Attention-based YOLOv5 (MSA-YOLOv5), targeting challenges such as small lesion size and blurred borders at low resolutions. Specifically, we augment YOLOv5 with a prediction head to detect objects at various scales. Next, we replace the original prediction head with a Multi-Scale Swin Transformer Prediction Head (MS-STPH), which reduces computational complexity to linear levels and enhances the ability to detect small lesions. We incorporate a Second-Order channel attention (SOCA) module to adaptively rescale channel features by employing second-order feature statistics for more discriminative representations. Finally, we further validate the effectiveness of our method using the ISLES 2022 dataset.RESULTS:On our in-house AIS dataset, MSA-YOLOv5 achieves a 79.0% mAP0.5, substantially surpassing other single-stage models. Compared to two-stage models, it maintains a comparable performance level while significantly reducing the number of parameters and resolution. On the ISLES 2022 dataset, MSA-YOLOv5 attains an 80.0% mAP0.5, outperforming other network models by a considerable margin. MS-STPH and SOCA modules can significantly increase mAP0.5 by 2.7% and 1.9%, respectively. Visualization interpretability results show that the proposed MSA-YOLOv5 restricts high attention in the small regions of AIS lesions.CONCLUSIONS:The proposed MSA-YOLOv5 is capable of automatically and effectively detecting acute ischemic stroke lesions in multimodal images, particularly for small lesions and artifacts. Our enhanced model reduces the number of parameters while improving detection accuracy. This model can potentially assist radiologists in providing more accurate diagnosis, and enable clinicians to develop better treatment plans.

MBH-Net: Multi-branch Hybrid Network with Auxiliary Attention Guidance for Large Vessel Occlusion Detection

Novel Prehospital Prediction Model of Large Vessel Occlusion Using Artificial Neural Network

LVONet: automatic classification model for large vessel occlusion based on the difference information between left and right hemispheres

Prediction of large vessel occlusion for ischaemic stroke by using the machine learning model random forests

MSA-YOLOv5: Multi-scale Attention-Based YOLOv5 for Automatic Detection of Acute Ischemic Stroke from Multi-Modality MRI Images.

Deep learning-assisted diagnosis of large vessel occlusion in acute ischemic stroke based on four-dimensional computed tomography angiography

Building Brains: Subvolume Recombination for Data Augmentation in Large Vessel Occlusion Detection

Spatial Multi-Scale Attention U-improved Network for Blood Vessel Segmentation

Automatic Evaluating of Multi-Phase Cranial CTA Collateral Circulation Based on Feature Fusion Attention Network Model.

Automatic vessel crossing and bifurcation detection based on multi-attention network vessel segmentation and directed graph search

C2MA-Net: Cross-Modal Cross-Attention Network for Acute Ischemic Stroke Lesion Segmentation Based on CT Perfusion Scans

CCA4CTA: A Hybrid Attention Mechanism Based Convolutional Network for Analysing Collateral Circulation Via Multi-phase Cranial CTA.

MDSU-Net: A Multi-attention and Depthwise Separable Convolution Network for Stroke Lesion Segmentation

Multiscale Attention Network Via Topology Learning for Cerebral Vessel Segmentation in Angiography Images

Development and Validation of Automated Software for the Detection of Large Vessel Occlusion on Noncontrast CT

A deep learning method to identify and localize large‐vessel occlusions from cerebral digital subtraction angiography

Strategies to combine 3D vasculature and brain CTA with deep neural networks: Application to LVO

Learning Spatiotemporal Features of DSA Using 3D CNN and BiConvGRU for Ischemic Moyamoya Disease Detection.

The Automatic Evaluation of Steno-Occlusive Changes in Time-of-flight Magnetic Resonance Angiography of Moyamoya Patients Using a 3D Coordinate Attention Residual Network.

Merging Multiphase CTA Images and Training Them Simultaneously with a Deep Learning Algorithm Could Improve the Efficacy of AI Models for Lateral Circulation Assessment in Ischemic Stroke

Parallel Multi-Path Network for Ocular Disease Detection Inspired by Visual Cognition Mechanism