Abstract:Purpose: Computed tomography (CT) has the advantages of being low cost and noninvasive and is a primary diagnostic method for brain diseases. However, it is a challenge for junior radiologists to diagnose CT images accurately and comprehensively. It is necessary to build a system that can help doctors diagnose and provide an explanation of the predictions. Despite the success of deep learning algorithms in the field of medical image analysis, the task of brain disease classification still faces challenges: Researchers lack attention to complex manual labeling requirements and the incompleteness of prediction explanations. More importantly, most studies only measure the performance of the algorithm, but do not measure the effectiveness of the algorithm in the actual diagnosis of doctors. Methods: In this paper, we propose a model called DrCT2 that can detect brain diseases without using image-level labels and provide a more comprehensive explanation at both the slice and sequence levels. This model achieves reliable performance by imitating human expert reading habits: targeted scaling of primary images from the full slice scans and observation of suspicious lesions for diagnosis. We evaluated our model on two open-access data sets: CQ500 and the RSNA Intracranial Hemorrhage Detection Challenge. In addition, we defined three tasks to comprehensively evaluate model interpretability by measuring whether the algorithm can select key images with lesions. To verify the algorithm from the perspective of practical application, three junior radiologists were invited to participate in the experiments, comparing the effects before and after human-computer cooperation in different aspects. Results: The method achieved F1-scores of 0.9370 on CQ500 and 0.8700 on the RSNA data set. The results show that our model has good interpretability under the premise of good performance. Human radiologist evaluation experiments have proven that our model can effectively improve the accuracy of the diagnosis and improve efficiency. Conclusions: We proposed a model that can simultaneously detect multiple brain diseases. The report generated by the model can assist doctors in avoiding missed diagnoses, and it has good clinical application value.

Research on the Prediction Method of Disease Classification Based on Imaging Features

Integrating Medical Imaging and Clinical Reports Using Multimodal Deep Learning for Advanced Disease Analysis

Disease Classification Model Based on Multi-Modal Feature Fusion

Medical code prediction via capsule networks and ICD knowledge

A General Framework for Diagnosis Prediction Via Incorporating Medical Code Descriptions

Disease prediction based on multi-type data fusion from Chinese electronic health record.

Incorporating Medical Code Descriptions for Diagnosis Prediction in Healthcare

Diagnosis after Zooming In: A Multilabel Classification Model by Imitating Doctor Reading Habits to Diagnose Brain Diseases.

Fuzzy System Based Medical Image Processing for Brain Disease Prediction

Auxiliary Diagnosis Study of Integrated Electronic Medical Record Text and CT Images

An Investigation on Disease Diagnosis and Prediction by Using Modified K-Mean clustering and Combined CNN and ELM Classification Techniques

Simple Words over Rich Imaging: Accurate Brain Disease Classification via Language Model Analysis of Radiological Reports

A deep image classification model based on prior feature knowledge embedding and application in medical diagnosis

A disease category feature database construction method of brain image based on deep convolutional neural network.

K-Diag: Knowledge-enhanced Disease Diagnosis in Radiographic Imaging

MFISN: Modality Fuzzy Information Separation Network for Disease Classification

Medical image fusion based on machine learning for health diagnosis and monitoring of colorectal cancer

Automatic Assistance Method for Disease Diagnosis Based on a Deep Learning Fusion Model and Chinese Electronic Medical Record

Fusion Model for Tentative Diagnosis Inference Based on Clinical Narratives

Fusing Medical Image Features and Clinical Features with Deep Learning for Computer-Aided Diagnosis

Image-Text Fusion Network for Incomplete Multi-Label Brain Cognitive Risk Prediction