Abstract:BACKGROUND AND OBJECTIVE:Acute ischemic stroke (AIS) is a common neurological disorder characterized by the sudden onset of cerebral ischemia, leading to functional impairments. Swift and precise detection of AIS lesions is crucial for stroke diagnosis and treatment but poses a significant challenge. This study aims to leverage multimodal fusion technology to combine complementary information from various modalities, thereby enhancing the detection performance of AIS target detection models.METHODS:In this retrospective study of AIS, we collected data from 316 AIS patients and created a multi-modality magnetic resonance imaging (MRI) dataset. We propose a Multi-Scale Attention-based YOLOv5 (MSA-YOLOv5), targeting challenges such as small lesion size and blurred borders at low resolutions. Specifically, we augment YOLOv5 with a prediction head to detect objects at various scales. Next, we replace the original prediction head with a Multi-Scale Swin Transformer Prediction Head (MS-STPH), which reduces computational complexity to linear levels and enhances the ability to detect small lesions. We incorporate a Second-Order channel attention (SOCA) module to adaptively rescale channel features by employing second-order feature statistics for more discriminative representations. Finally, we further validate the effectiveness of our method using the ISLES 2022 dataset.RESULTS:On our in-house AIS dataset, MSA-YOLOv5 achieves a 79.0% mAP0.5, substantially surpassing other single-stage models. Compared to two-stage models, it maintains a comparable performance level while significantly reducing the number of parameters and resolution. On the ISLES 2022 dataset, MSA-YOLOv5 attains an 80.0% mAP0.5, outperforming other network models by a considerable margin. MS-STPH and SOCA modules can significantly increase mAP0.5 by 2.7% and 1.9%, respectively. Visualization interpretability results show that the proposed MSA-YOLOv5 restricts high attention in the small regions of AIS lesions.CONCLUSIONS:The proposed MSA-YOLOv5 is capable of automatically and effectively detecting acute ischemic stroke lesions in multimodal images, particularly for small lesions and artifacts. Our enhanced model reduces the number of parameters while improving detection accuracy. This model can potentially assist radiologists in providing more accurate diagnosis, and enable clinicians to develop better treatment plans.

Intelligent Diagnosis of Pediatric Vascular Diseases Based on Multimodal Fusion of Ultrasound Images

Intelligent Diagnosis of Vascular Anomalies with Deep Learning

CMIR: A Unified Cross-Modality Framework for Preoperative Accurate Prediction of Microvascular Invasion in Hepatocellular Carcinoma.

Identifying Pediatric Vascular Anomalies With Deep Learning

Intelligent Detection of Left Ventricular Hypertrophy from Pediatric Echocardiography Videos

MUVF-YOLOX: A Multi-modal Ultrasound Video Fusion Network for Renal Tumor Diagnosis

Enhancing YOLO5 for the Assessment of Irregular Pelvic Radiographs with Multimodal Information

Deep learning segmentation, classification, and risk prediction of complex vascular lesions on intravascular ultrasound images

Multi-View Feature Transformation Based SVM+ for Computer-Aided Diagnosis of Liver Cancers With Ultrasound Images

Improving artificial intelligence pipeline for liver malignancy diagnosis using ultrasound images and video frames

Deep Infantile Hemangiomas and Early Venous Malformations

Computer-aided diagnosis for fetal brain ultrasound images using deep convolutional neural networks

Intelligent contour extraction approach for accurate segmentation of medical ultrasound images

Multimodal Ultrasound Imaging Based Diagnosis of Liver Cancers with a Two-Stage Multi-View Learning Framework.

Application and visualization study of an intelligence-assisted classification model for common eye diseases using B-mode ultrasound images

An Infantile Hemangioma Dataset IH-2021 and a Deep Learning Based Recognition Method on It

Muiqa: Image Quality Assessment Database and Algorithm for Medical Ultrasound Images

MSA-YOLOv5: Multi-scale Attention-Based YOLOv5 for Automatic Detection of Acute Ischemic Stroke from Multi-Modality MRI Images.

A mutual promotion encoder-decoder method for ultrasonic hydronephrosis diagnosis

Deep Multi-modal Fusion of Image and Non-image Data in Disease Diagnosis and Prognosis: A Review

Joint Lesion Detection and Classification of Breast Ultrasound Video Via a Clinical Knowledge-Aware Framework