[Rehabilitation of aged patients with medullary lesions].

J. Glaesener,H. Gerner,P. Kluger,B. Meister

1988-03-01

Soins

Abstract:

What problem does this paper attempt to address?

Multi-Label Annotation of Chest Abdomen Pelvis Computed Tomography Text Reports Using Deep Learning

Vincent M. D'Anniballe,Fakrul Islam Tushar,Khrystyna Faryna,Songyue Han,Maciej A. Mazurowski,Geoffrey D. Rubin,Joseph Y. Lo

DOI: https://doi.org/10.48550/arXiv.2102.02959

2022-03-08

Abstract:Purpose: To develop high throughput multi-label annotators for body (chest, abdomen, and pelvis) Computed Tomography (CT) reports that can be applied across a variety of abnormalities, organs, and disease states. Approach: We used a dictionary approach to develop rule-based algorithms (RBA) for extraction of disease labels from radiology text reports. We targeted three organ systems (lungs/pleura, liver/gallbladder, kidneys/ureters) with four diseases per system based on their prevalence in our dataset. To expand the algorithms beyond pre-defined keywords, attention-guided recurrent neural networks (RNN) were trained using the RBA-extracted labels to classify reports as being positive for one or more diseases or normal for each organ system. Confounding effects on model performance were evaluated using random initialization or pre-trained embedding as well as different sizes of training datasets. Performance was evaluated using the receiver operating characteristic (ROC) area under the curve (AUC) against 2,158 manually obtained labels. Results: Our models extracted disease labels from 261,229 radiology reports of 112,501 unique subjects. Pre-trained models outperformed random initialization across all diseases. As the training dataset size was reduced, performance was robust except for a few diseases with relatively small number of cases. Pre-trained classification AUCs achieved > 0.95 for all five disease outcomes across all three organ systems. Conclusions: Our label-extracting pipeline was able to encompass a variety of cases and diseases by generalizing beyond strict rules with exceptional accuracy. This method can be easily adapted to enable automated labeling of hospital-scale medical data sets for training image-based disease classifiers.

Artificial Intelligence,Computation and Language,Machine Learning
Classification of Multiple Diseases on Body CT Scans using Weakly Supervised Deep Learning

Fakrul Islam Tushar,Vincent M. D'Anniballe,Rui Hou,Maciej A. Mazurowski,Wanyi Fu,Ehsan Samei,Geoffrey D. Rubin,Joseph Y. Lo

DOI: https://doi.org/10.1148/ryai.210026

2021-11-17

Abstract:Purpose: To design multi-disease classifiers for body CT scans for three different organ systems using automatically extracted labels from radiology text <a class="link-external link-http" href="http://reports.Materials" rel="external noopener nofollow">this http URL</a> & Methods: This retrospective study included a total of 12,092 patients (mean age 57 +- 18; 6,172 women) for model development and testing (from 2012-2017). Rule-based algorithms were used to extract 19,225 disease labels from 13,667 body CT scans from 12,092 patients. Using a three-dimensional DenseVNet, three organ systems were segmented: lungs and pleura; liver and gallbladder; and kidneys and ureters. For each organ, a three-dimensional convolutional neural network classified no apparent disease versus four common diseases for a total of 15 different labels across all three models. Testing was performed on a subset of 2,158 CT volumes relative to 2,875 manually derived reference labels from 2133 patients (mean age 58 +- 18;1079 women). Performance was reported as receiver operating characteristic area under the curve (AUC) with 95% confidence intervals by the DeLong method. Results: Manual validation of the extracted labels confirmed 91% to 99% accuracy across the 15 different labels. AUCs for lungs and pleura labels were: atelectasis 0.77 (95% CI: 0.74, 0.81), nodule 0.65 (0.61, 0.69), emphysema 0.89 (0.86, 0.92), effusion 0.97 (0.96, 0.98), and no apparent disease 0.89 (0.87, 0.91). AUCs for liver and gallbladder were: hepatobiliary calcification 0.62 (95% CI: 0.56, 0.67), lesion 0.73 (0.69, 0.77), dilation 0.87 (0.84, 0.90), fatty 0.89 (0.86, 0.92), and no apparent disease 0.82 (0.78, 0.85). AUCs for kidneys and ureters were: stone 0.83 (95% CI: 0.79, 0.87), atrophy 0.92 (0.89, 0.94), lesion 0.68 (0.64, 0.72), cyst 0.70 (0.66, 0.73), and no apparent disease 0.79 (0.75, 0.83). Conclusion: Weakly-supervised deep learning models were able to classify diverse diseases in multiple organ systems.

Computer Vision and Pattern Recognition,Machine Learning,Image and Video Processing
Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumes

Rachel Lea Draelos,David Dov,Maciej A. Mazurowski,Joseph Y. Lo,Ricardo Henao,Geoffrey D. Rubin,Lawrence Carin

DOI: https://doi.org/10.1016/j.media.2020.101857

2020-10-13

Abstract:Machine learning models for radiology benefit from large-scale data sets with high quality labels for abnormalities. We curated and analyzed a chest computed tomography (CT) data set of 36,316 volumes from 19,993 unique patients. This is the largest multiply-annotated volumetric medical imaging data set reported. To annotate this data set, we developed a rule-based method for automatically extracting abnormality labels from free-text radiology reports with an average F-score of 0.976 (min 0.941, max 1.0). We also developed a model for multi-organ, multi-disease classification of chest CT volumes that uses a deep convolutional neural network (CNN). This model reached a classification performance of AUROC greater than 0.90 for 18 abnormalities, with an average AUROC of 0.773 for all 83 abnormalities, demonstrating the feasibility of learning from unfiltered whole volume CT data. We show that training on more labels improves performance significantly: for a subset of 9 labels - nodule, opacity, atelectasis, pleural effusion, consolidation, mass, pericardial effusion, cardiomegaly, and pneumothorax - the model's average AUROC increased by 10% when the number of training labels was increased from 9 to all 83. All code for volume preprocessing, automated label extraction, and the volume abnormality prediction model will be made publicly available. The 36,316 CT volumes and labels will also be made publicly available pending institutional approval.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Annotation-free multi-organ anomaly detection in abdominal CT using free-text radiology reports: A multi-center retrospective study

Junya Sato,Kento Sugimoto,Yuki Suzuki,Tomohiro Wataya,Kosuke Kita,Daiki Nishigaki,Miyuki Tomiyama,Yu Hiraoka,Masatoshi Hori,Toshihiro Takeda,Shoji Kido,Noriyuki Tomiyama

DOI: https://doi.org/10.1101/2024.06.10.24308633

2024-06-11

Abstract:SUMMARY Background Artificial intelligence (AI) systems designed to detect abnormalities in abdominal computed tomography (CT) could reduce radiologists' workload and improve diagnostic processes. However, development of such models has been hampered by the shortage of large expert-annotated datasets. Here, we used information from free-text radiology reports, rather than manual annotations, to develop a deep-learning-based pipeline for comprehensive detection of abdominal CT abnormalities. Methods In this multicenter retrospective study, we developed a deep-learning-based pipeline to detect abnormalities in the liver, gallbladder, pancreas, spleen, and kidneys. Abdominal CT exams and related free-text reports obtained during routine clinical practice collected from three institutions were used for training and internal testing, while data collected from six institutions were used for external testing. A multi-organ segmentation model and an information extraction schema were used to extract specific organ images and disease information, CT images and radiology reports, respectively, which were used to train a multiple-instance learning model for anomaly detection. Its performance was evaluated using the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, and F1 score against radiologists' ground-truth labels. Findings We trained the model for each organ on images selected from 66,684 exams (39,255 patients) and tested it on 300 (295 patients) and 600 (596 patients) exams for internal and external validation, respectively. In the external test cohort, the overall AUC for detecting organ abnormalities was 0.886. Whereas models trained on human-annotated labels performed better with the same number of exams, those trained on larger datasets with labels auto-extracted via the information extraction schema significantly outperformed human-annotated label-derived models. Interpretation Using disease information from routine clinical free-text radiology reports allows development of accurate anomaly detection models without requiring manual annotations. This approach is applicable to various anatomical sites and could streamline diagnostic processes. Funding Japan Science and Technology Agency.

Radiology and Imaging
Deep learning to automate the labelling of head MRI datasets for computer vision applications

David A Wood,Sina Kafiabadi,Aisha Al Busaidi,Emily L Guilhem,Jeremy Lynch,Matthew K Townend,Antanas Montvila,Martin Kiik,Juveria Siddiqui,Naveen Gadapa,Matthew D Benger,Asif Mazumder,Gareth Barker,Sebastian Ourselin,James H Cole,Thomas C Booth

DOI: https://doi.org/10.1007/s00330-021-08132-0

Abstract:Objectives: The purpose of this study was to build a deep learning model to derive labels from neuroradiology reports and assign these to the corresponding examinations, overcoming a bottleneck to computer vision model development. Methods: Reference-standard labels were generated by a team of neuroradiologists for model training and evaluation. Three thousand examinations were labelled for the presence or absence of any abnormality by manually scrutinising the corresponding radiology reports ('reference-standard report labels'); a subset of these examinations (n = 250) were assigned 'reference-standard image labels' by interrogating the actual images. Separately, 2000 reports were labelled for the presence or absence of 7 specialised categories of abnormality (acute stroke, mass, atrophy, vascular abnormality, small vessel disease, white matter inflammation, encephalomalacia), with a subset of these examinations (n = 700) also assigned reference-standard image labels. A deep learning model was trained using labelled reports and validated in two ways: comparing predicted labels to (i) reference-standard report labels and (ii) reference-standard image labels. The area under the receiver operating characteristic curve (AUC-ROC) was used to quantify model performance. Accuracy, sensitivity, specificity, and F1 score were also calculated. Results: Accurate classification (AUC-ROC > 0.95) was achieved for all categories when tested against reference-standard report labels. A drop in performance (ΔAUC-ROC > 0.02) was seen for three categories (atrophy, encephalomalacia, vascular) when tested against reference-standard image labels, highlighting discrepancies in the original reports. Once trained, the model assigned labels to 121,556 examinations in under 30 min. Conclusions: Our model accurately classifies head MRI examinations, enabling automated dataset labelling for downstream computer vision applications. Key points: • Deep learning is poised to revolutionise image recognition tasks in radiology; however, a barrier to clinical adoption is the difficulty of obtaining large labelled datasets for model training. • We demonstrate a deep learning model which can derive labels from neuroradiology reports and assign these to the corresponding examinations at scale, facilitating the development of downstream computer vision models. • We rigorously tested our model by comparing labels predicted on the basis of neuroradiology reports with two sets of reference-standard labels: (1) labels derived by manually scrutinising each radiology report and (2) labels derived by interrogating the actual images.
Highly accurate classification of chest radiographic reports using a deep learning natural language model pre-trained on 3.8 million text reports

Keno K Bressem,Lisa C Adams,Robert A Gaudin,Daniel Tröltzsch,Bernd Hamm,Marcus R Makowski,Chan-Yong Schüle,Janis L Vahldiek,Stefan M Niehues

DOI: https://doi.org/10.1093/bioinformatics/btaa668

IF: 5.8

2020-07-23

Bioinformatics

Abstract:Abstract Motivation The development of deep, bidirectional transformers such as Bidirectional Encoder Representations from Transformers (BERT) led to an outperformance of several Natural Language Processing (NLP) benchmarks. Especially in radiology, large amounts of free-text data are generated in daily clinical workflow. These report texts could be of particular use for the generation of labels in machine learning, especially for image classification. However, as report texts are mostly unstructured, advanced NLP methods are needed to enable accurate text classification. While neural networks can be used for this purpose, they must first be trained on large amounts of manually labelled data to achieve good results. In contrast, BERT models can be pre-trained on unlabelled data and then only require fine tuning on a small amount of manually labelled data to achieve even better results. Results Using BERT to identify the most important findings in intensive care chest radiograph reports, we achieve areas under the receiver operation characteristics curve of 0.98 for congestion, 0.97 for effusion, 0.97 for consolidation and 0.99 for pneumothorax, surpassing the accuracy of previous approaches with comparatively little annotation effort. Our approach could therefore help to improve information extraction from free-text medical reports. Availability and implementation We make the source code for fine-tuning the BERT-models freely available at https://github.com/fast-raidiology/bert-for-radiology. Supplementary information Supplementary data are available at Bioinformatics online.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Deep Learning Body Region Classification of MRI and CT examinations

Philippe Raffy,Jean-François Pambrun,Ashish Kumar,David Dubois,Jay Waldron Patti,Robyn Alexandra Cairns,Ryan Young

DOI: https://doi.org/10.1007/s10278-022-00767-9

2021-06-29

Abstract:Standardized body region labelling of individual images provides data that can improve human and computer use of medical images. A CNN-based classifier was developed to identify body regions in CT and MRI. 17 CT (18 MRI) body regions covering the entire human body were defined for the classification task. Three retrospective databases were built for the AI model training, validation, and testing, with a balanced distribution of studies per body region. The test databases originated from a different healthcare network. Accuracy, recall and precision of the classifier was evaluated for patient age, patient gender, institution, scanner manufacturer, contrast, slice thickness, MRI sequence, and CT kernel. The data included a retrospective cohort of 2,934 anonymized CT cases (training: 1,804 studies, validation: 602 studies, test: 528 studies) and 3,185 anonymized MRI cases (training: 1,911 studies, validation: 636 studies, test: 638 studies). 27 institutions from primary care hospitals, community hospitals and imaging centers contributed to the test datasets. The data included cases of all genders in equal proportions and subjects aged from a few months old to +90 years old. An image-level prediction accuracy of 91.9% (90.2 - 92.1) for CT, and 94.2% (92.0 - 95.6) for MRI was achieved. The classification results were robust across all body regions and confounding factors. Due to limited data, performance results for subjects under 10 years-old could not be reliably evaluated. We show that deep learning models can classify CT and MRI images by body region including lower and upper extremities with high accuracy.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Supervised and unsupervised language modelling in Chest X-Ray radiological reports

Ignat Drozdov,Daniel Forbes,Benjamin Szubert,Mark Hall,Chris Carlin,David J Lowe

DOI: https://doi.org/10.1371/journal.pone.0229963

IF: 3.7

2020-03-10

PLoS ONE

Abstract:Chest radiography (CXR) is the most commonly used imaging modality and deep neural network (DNN) algorithms have shown promise in effective triage of normal and abnormal radiograms. Typically, DNNs require large quantities of expertly labelled training exemplars, which in clinical contexts is a major bottleneck to effective modelling, as both considerable clinical skill and time is required to produce high-quality ground truths. In this work we evaluate thirteen supervised classifiers using two large free-text corpora and demonstrate that bi-directional long short-term memory (BiLSTM) networks with attention mechanism effectively identify Normal, Abnormal, and Unclear CXR reports in internal (n = 965 manually-labelled reports, f1-score = 0.94) and external (n = 465 manually-labelled reports, f1-score = 0.90) testing sets using a relatively small number of expert-labelled training observations (n = 3,856 annotated reports). Furthermore, we introduce a general unsupervised approach that accurately distinguishes Normal and Abnormal CXR reports in a large unlabelled corpus. We anticipate that the results presented in this work can be used to automatically extract standardized clinical information from free-text CXR radiological reports, facilitating the training of clinical decision support systems for CXR triage.
Automated Identification of Thoracic Pathology from Chest Radiographs with Enhanced Training Pipeline

Adora M. DSouza,Anas Z. Abidin,Axel Wismüller

DOI: https://doi.org/10.48550/arXiv.2006.06805

2020-06-11

Image and Video Processing

Abstract:Chest x-rays are the most common radiology studies for diagnosing lung and heart disease. Hence, a system for automated pre-reporting of pathologic findings on chest x-rays would greatly enhance radiologists' productivity. To this end, we investigate a deep-learning framework with novel training schemes for classification of different thoracic pathology labels from chest x-rays. We use the currently largest publicly available annotated dataset ChestX-ray14 of 112,120 chest radiographs of 30,805 patients. Each image was annotated with either a 'NoFinding' class, or one or more of 14 thoracic pathology labels. Subjects can have multiple pathologies, resulting in a multi-class, multi-label problem. We encoded labels as binary vectors using k-hot encoding. We study the ResNet34 architecture, pre-trained on ImageNet, where two key modifications were incorporated into the training framework: (1) Stochastic gradient descent with momentum and with restarts using cosine annealing, (2) Variable image sizes for fine-tuning to prevent overfitting. Additionally, we use a heuristic algorithm to select a good learning rate. Learning with restarts was used to avoid local minima. Area Under receiver operating characteristics Curve (AUC) was used to quantitatively evaluate diagnostic quality. Our results are comparable to, or outperform the best results of current state-of-the-art methods with AUCs as follows: Atelectasis:0.81, Cardiomegaly:0.91, Consolidation:0.81, Edema:0.92, Effusion:0.89, Emphysema: 0.92, Fibrosis:0.81, Hernia:0.84, Infiltration:0.73, Mass:0.85, Nodule:0.76, Pleural Thickening:0.81, Pneumonia:0.77, Pneumothorax:0.89 and NoFinding:0.79. Our results suggest that, in addition to using sophisticated network architectures, a good learning rate, scheduler and a robust optimizer can boost performance.
Multi-Label Classification of Lung Diseases Using Deep Learning

Muhammad Irtaza,Arshad Ali,Maryam Gulzar,Aamir Wali

DOI: https://doi.org/10.1109/access.2024.3454537

IF: 3.9

2024-09-14

IEEE Access

Abstract:Assistance for doctors in disease detection can be very useful in environments with scarce resources and personnel. Historically, many patients could have been cured with early detection of the disease. The application of deep learning techniques in the fields of medical imaging, on large datasets, has allowed computer algorithms to produce as effective results as medical professionals. To assist doctors, it is essential to have a versatile system that can timely detect multiple diseases in the lungs with high accuracy. Over time, although many classifiers and algorithms have been implemented, however, deep learning models (i.e., CNN, Deep-CNN, and R-CNN) are known to offer better results. After a thorough literature review of the state-of-the-art techniques, this work applies various models such as MobileNet, DenseNet, VGG-16, EfficientNet, Xception, and InceptionV3 to the selected large dataset. The goal is to enhance the accuracy of these algorithms by experimenting with parameter optimizations. We observe that MobileNet produces better results as compared to other models. We implement a deep convolutional GAN to produce synthetic X-ray images containing various pathologies already included in the chosen imbalanced dataset namely NIH Chest X-ray containing 14 classes. The synthetic dataset contains 1193 samples belonging to five classes. We test the suggested model using evaluation measures like recall, precision, and F1-score, along with binary accuracy. The suggested deep learning model produces recall as high as 57%, binary accuracy as 93.4%, F1-Score as 0.553, and AUC as 81. After the inclusion of generated synthetic samples, the value of the F1-score becomes 0.582 resulting in a 5% increase. Though, Generative Adversarial Network (GAN) shows lower performance, however, we encourage further research and experiments to find the versatility of GANs in the field of medical imaging.

computer science, information systems,telecommunications,engineering, electrical & electronic
Deep Learning to Classify Radiology Free-Text Reports

Matthew C Chen,Robyn L Ball,Lingyao Yang,Nathaniel Moradzadeh,Brian E Chapman,David B Larson,Curtis P Langlotz,Timothy J Amrhein,Matthew P Lungren,Matthew C. Chen,Robyn L. Ball,Brian E. Chapman,David B. Larson,Curtis P. Langlotz,Timothy J. Amrhein,Matthew P. Lungren

DOI: https://doi.org/10.1148/radiol.2017171115

IF: 19.7

2018-03-01

Radiology

Abstract:Purpose To evaluate the performance of a deep learning convolutional neural network (CNN) model compared with a traditional natural language processing (NLP) model in extracting pulmonary embolism (PE) findings from thoracic computed tomography (CT) reports from two institutions. Materials and Methods Contrast material-enhanced CT examinations of the chest performed between January 1, 1998, and January 1, 2016, were selected. Annotations by two human radiologists were made for three categories: the presence, chronicity, and location of PE. Classification of performance of a CNN model with an unsupervised learning algorithm for obtaining vector representations of words was compared with the open-source application PeFinder. Sensitivity, specificity, accuracy, and F1 scores for both the CNN model and PeFinder in the internal and external validation sets were determined. Results The CNN model demonstrated an accuracy of 99% and an area under the curve value of 0.97. For internal validation report data, the CNN model had a statistically significant larger F1 score (0.938) than did PeFinder (0.867) when classifying findings as either PE positive or PE negative, but no significant difference in sensitivity, specificity, or accuracy was found. For external validation report data, no statistical difference between the performance of the CNN model and PeFinder was found. Conclusion A deep learning CNN model can classify radiology free-text reports with accuracy equivalent to or beyond that of an existing traditional NLP model. © RSNA, 2017 Online supplemental material is available for this article.

radiology, nuclear medicine & medical imaging
Multi-task Learning for Chest X-ray Abnormality Classification on Noisy Labels

Sebastian Guendel,Florin C. Ghesu,Sasa Grbic,Eli Gibson,Bogdan Georgescu,Andreas Maier,Dorin Comaniciu

DOI: https://doi.org/10.48550/arXiv.1905.06362

2019-05-15

Computer Vision and Pattern Recognition

Abstract:Chest X-ray (CXR) is the most common X-ray examination performed in daily clinical practice for the diagnosis of various heart and lung abnormalities. The large amount of data to be read and reported, with 100+ studies per day for a single radiologist, poses a challenge in maintaining consistently high interpretation accuracy. In this work, we propose a method for the classification of different abnormalities based on CXR scans of the human body. The system is based on a novel multi-task deep learning architecture that in addition to the abnormality classification, supports the segmentation of the lungs and heart and classification of regions where the abnormality is located. We demonstrate that by training these tasks concurrently, one can increase the classification performance of the model. Experiments were performed on an extensive collection of 297,541 chest X-ray images from 86,876 patients, leading to a state-of-the-art performance level of 0.883 AUC on average for 12 different abnormalities. We also conducted a detailed performance analysis and compared the accuracy of our system with 3 board-certified radiologists. In this context, we highlight the high level of label noise inherent to this problem. On a reduced subset containing only cases with high confidence reference labels based on the consensus of the 3 radiologists, our system reached an average AUC of 0.945.
Learning to diagnose common thorax diseases on chest radiographs from radiology reports in Vietnamese

Thao T.B. Nguyen,Tam M. Vo,Thang V. Nguyen,Hieu H. Pham,Ha Q. Nguyen

DOI: https://doi.org/10.1371/journal.pone.0276545

2022-09-11

Abstract:We propose a data collecting and annotation pipeline that extracts information from Vietnamese radiology reports to provide accurate labels for chest X-ray (CXR) images. This can benefit Vietnamese radiologists and clinicians by annotating data that closely match their endemic diagnosis categories which may vary from country to country. To assess the efficacy of the proposed labeling technique, we built a CXR dataset containing 9,752 studies and evaluated our pipeline using a subset of this dataset. With an F1-score of at least 0.9923, the evaluation demonstrates that our labeling tool performs precisely and consistently across all classes. After building the dataset, we train deep learning models that leverage knowledge transferred from large public CXR datasets. We employ a variety of loss functions to overcome the curse of imbalanced multi-label datasets and conduct experiments with various model architectures to select the one that delivers the best performance. Our best model (CheXpert-pretrained EfficientNet-B2) yields an F1-score of 0.6989 (95% CI 0.6740, 0.7240), AUC of 0.7912, sensitivity of 0.7064 and specificity of 0.8760 for the abnormal diagnosis in general. Finally, we demonstrate that our coarse classification (based on five specific locations of abnormalities) yields comparable results to fine classification (twelve pathologies) on the benchmark CheXpert dataset for general anomaly detection while delivering better performance in terms of the average performance of all classes.

Image and Video Processing,Computer Vision and Pattern Recognition
Robust classification from noisy labels: Integrating additional knowledge for chest radiography abnormality assessment

Sebastian Gündel,Arnaud A A Setio,Florin C Ghesu,Sasa Grbic,Bogdan Georgescu,Andreas Maier,Dorin Comaniciu,Arnaud A.A. Setio,Florin C. Ghesu

DOI: https://doi.org/10.1016/j.media.2021.102087

IF: 10.9

2021-08-01

Medical Image Analysis

Abstract:Chest radiography is the most common radiographic examination performed in daily clinical practice for the detection of various heart and lung abnormalities. The large amount of data to be read and reported, with more than 100 studies per day for a single radiologist, poses a challenge in consistently maintaining high interpretation accuracy. The introduction of large-scale public datasets has led to a series of novel systems for automated abnormality classification. However, the labels of these datasets were obtained using natural language processed medical reports, yielding a large degree of label noise that can impact the performance. In this study, we propose novel training strategies that handle label noise from such suboptimal data. Prior label probabilities were measured on a subset of training data re-read by 4 board-certified radiologists and were used during training to increase the robustness of the training model to the label noise. Furthermore, we exploit the high comorbidity of abnormalities observed in chest radiography and incorporate this information to further reduce the impact of label noise. Additionally, anatomical knowledge is incorporated by training the system to predict lung and heart segmentation, as well as spatial knowledge labels. To deal with multiple datasets and images derived from various scanners that apply different post-processing techniques, we introduce a novel image normalization strategy. Experiments were performed on an extensive collection of 297,541 chest radiographs from 86,876 patients, leading to a state-of-the-art performance level for 17 abnormalities from 2 datasets. With an average AUC score of 0.880 across all abnormalities, our proposed training strategies can be used to significantly improve performance scores.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Automatic Annotation of Narrative Radiology Reports

Ivan Krsnik,Goran Glavaš,Marina Krsnik,Damir Miletić,Ivan Štajduhar

DOI: https://doi.org/10.3390/diagnostics10040196

IF: 3.6

2020-04-01

Diagnostics

Abstract:Narrative texts in electronic health records can be efficiently utilized for building decision support systems in the clinic, only if they are correctly interpreted automatically in accordance with a specified standard. This paper tackles the problem of developing an automated method of labeling free-form radiology reports, as a precursor for building query-capable report databases in hospitals. The analyzed dataset consists of 1295 radiology reports concerning the condition of a knee, retrospectively gathered at the Clinical Hospital Centre Rijeka, Croatia. Reports were manually labeled with one or more labels from a set of 10 most commonly occurring clinical conditions. After primary preprocessing of the texts, two sets of text classification methods were compared: (1) traditional classification models—Naive Bayes (NB), Logistic Regression (LR), Support Vector Machine (SVM), and Random Forests (RF)—coupled with Bag-of-Words (BoW) features (i.e., symbolic text representation) and (2) Convolutional Neural Network (CNN) coupled with dense word vectors (i.e., word embeddings as a semantic text representation) as input features. We resorted to nested 10-fold cross-validation to evaluate the performance of competing methods using accuracy, precision, recall, and F 1 score. The CNN with semantic word representations as input yielded the overall best performance, having a micro-averaged F 1 score of 86 . 7 % . The CNN classifier yielded particularly encouraging results for the most represented conditions: degenerative disease ( 95 . 9 % ), arthrosis ( 93 . 3 % ), and injury ( 89 . 2 % ). As a data-hungry deep learning model, the CNN, however, performed notably worse than the competing models on underrepresented classes with fewer training instances such as multicausal disease or metabolic disease. LR, RF, and SVM performed comparably well, with the obtained micro-averaged F 1 scores of 84 . 6 % , 82 . 2 % , and 82 . 1 % , respectively.

medicine, general & internal
Deep Learning with Weak Annotation from Diagnosis Reports for Detection of Multiple Head Disorders: a Prospective, Multicentre Study

Yuchen Guo,Yuwei He,Jinhao Lyu,Zhanping Zhou,Dong Yang,Liangdi Ma,Hao-tian Tan,Changjian Chen,Wei Zhang,Jianxing Hu,Dongshan Han,Guiguang Ding,Shixia Liu,Hui Qiao,Feng Xu,Xin Lou,Qionghai Dai

DOI: https://doi.org/10.1016/s2589-7500(22)00090-5

2022-01-01

Abstract:Background A large training dataset with high-quality annotations is necessary for building an accurate and generalisable deep learning system, which can be difficult and expensive to prepare in medical applications. We present a novel deep-learning-based system, requiring no annotator but weak annotation from a diagnosis report, for accurate and generalisable performance in detecting multiple head disorders from CT scans, including ischaemia, haemorrhage, tumours, and skull fractures. Methods Our system was developed on 104 597 head CT scans from the Chinese PLA General Hospital, with associated textual diagnosis reports. Without expert annotation, we used keyword matching on the reports to automatically generate disorder labels for each scan. The labels were inaccurate because of the unreliable annotator-free strategy and inexact because of scan-level annotation. We proposed RoLo, a novel weakly supervised learning algorithm, with a noise-tolerant mechanism and a multi-instance learning strategy to address these issues. RoLo was tested on retrospective (2357 scans from the Chinese PLA General Hospital), prospective (650 scans from the Chinese PLA General Hospital), cross-centre (1525 scans from the Brain Hospital of Hunan Province), cross-equipment (1484 scans from the Chinese PLA General Hospital), and cross-nation (CQ500 public dataset from India) test datasets. Four radiologists were tested on the prospective test dataset before and after viewing system recommendations to assess whether the system could improve diagnostic performance. Findings The area under the receiver operating characteristic curve for detecting the four disorder types was 0.976 (95% CI 0.976-0.976) for retrospective, 0.975 (0.974-0.976) for prospective, 0.965 (0.964-0.966) for cross-centre, and 0.971 (0.971-0.972) for cross-equipment test datasets, and 0.964 (0.964-0.966) for CQ500 (with only haemorrhage and fracture). The system achieved similar performance to four radiologists and helped to improve sensitivity and specificity by 0.109 (95% CI 0.086-0.131) and 0.022 (0.017-0.026), respectively. Interpretation Without expert annotated data, our system achieved accurate and generalisable performance for head disorder detection. The system improved the diagnostic performance of radiologists. Because of its accuracy and generalisability, our computer-aided diganostic system could be used in clinical practice to improve the accuracy and efficiency of radiologists in different hospitals. (C) 2022 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY-NC-ND 4.0 license.
Robust breast cancer detection in mammography and digital breast tomosynthesis using an annotation-efficient deep learning approach

William Lotter,Abdul Rahman Diab,Bryan Haslam,Jiye G. Kim,Giorgia Grisot,Eric Wu,Kevin Wu,Jorge Onieva Onieva,Yun Boyer,Jerrold L. Boxerman,Meiyun Wang,Mack Bandler,Gopal R. Vijayaraghavan,A. Gregory Sorensen

DOI: https://doi.org/10.1038/s41591-020-01174-9

IF: 82.9

2021-01-11

Nature Medicine

Abstract:Breast cancer remains a global challenge, causing over 600,000 deaths in 2018 (ref. <a href="/articles/s41591-020-01174-9#ref-CR1">1</a>). To achieve earlier cancer detection, health organizations worldwide recommend screening mammography, which is estimated to decrease breast cancer mortality by 20–40% (refs. <a href="/articles/s41591-020-01174-9#ref-CR2">2</a>,<a href="/articles/s41591-020-01174-9#ref-CR3">3</a>). Despite the clear value of screening mammography, significant false positive and false negative rates along with non-uniformities in expert reader availability leave opportunities for improving quality and access<a href="/articles/s41591-020-01174-9#ref-CR4">4</a>,<a href="/articles/s41591-020-01174-9#ref-CR5">5</a>. To address these limitations, there has been much recent interest in applying deep learning to mammography<a href="#ref-CR6">6</a>,<a href="#ref-CR7">7</a>,<a href="#ref-CR8">8</a>,<a href="#ref-CR9">9</a>,<a href="#ref-CR10">10</a>,<a href="#ref-CR11">11</a>,<a href="#ref-CR12">12</a>,<a href="#ref-CR13">13</a>,<a href="#ref-CR14">14</a>,<a href="#ref-CR15">15</a>,<a href="#ref-CR16">16</a>,<a href="#ref-CR17">17</a>,<a href="/articles/s41591-020-01174-9#ref-CR18">18</a>, and these efforts have highlighted two key difficulties: obtaining large amounts of annotated training data and ensuring generalization across populations, acquisition equipment and modalities. Here we present an annotation-efficient deep learning approach that (1) achieves state-of-the-art performance in mammogram classification, (2) successfully extends to digital breast tomosynthesis (DBT; '3D mammography'), (3) detects cancers in clinically negative prior mammograms of patients with cancer, (4) generalizes well to a population with low screening rates and (5) outperforms five out of five full-time breast-imaging specialists with an average increase in sensitivity of 14%. By creating new 'maximum suspicion projection' (MSP) images from DBT data, our progressively trained, multiple-instance learning approach effectively trains on DBT exams using only breast-level labels while maintaining localization-based interpretability. Altogether, our results demonstrate promise towards software that can improve the accuracy of and access to screening mammography worldwide.

biochemistry & molecular biology,cell biology,medicine, research & experimental
High Throughput Image Labeling on Chest Computed Tomography by Deep Learning.

Xiaoyong Wang,Pangyu Teng,Ashley Ontiveros,Jonathan G. Goldin,Matthew S. Brown

DOI: https://doi.org/10.1117/1.jmi.7.2.024501

2020-01-01

Journal of Medical Imaging

Abstract:When mining image data from PACs or clinical trials or processing large volumes of data without curation, the relevant scans must be identified among irrelevant or redundant data. Only images acquired with appropriate technical factors, patient positioning, and physiological conditions may be applicable to a particular image processing or machine learning task. Automatic labeling is important to make big data mining practical by replacing conventional manual review of every single-image series. Digital imaging and communications in medicine headers usually do not provide all the necessary labels and are sometimes incorrect. We propose an image-based high throughput labeling pipeline using deep learning, aimed at identifying scan direction, scan posture, lung coverage, contrast usage, and breath-hold types. They were posed as different classification problems and some of them involved further segmentation and identification of anatomic landmarks. Images of different view planes were used depending on the specific classification problem. All of our models achieved accuracy > 99 % on test set across different tasks using a research database from multicenter clinical trials.
Multi-Disease Diagnosis Using Medical Images

Aparnaa R,E. Mohanraj,Anantha Ganapatheeswaran K,Dinesh R

DOI: https://doi.org/10.1109/AIMLA59606.2024.10531493

2024-03-15

Abstract:This work presents a novel approach for disease diagnosis using medical imaging modalities—MRI, X-ray, and CT scans—to classify heart, brain, and lung disorders. Leveraging "Deep learning" techniques, particularly "Convolutional Neural Networks" (CNNs), this work focuses on accurately identifying anomalies within these organs. A diverse dataset is prepared, encompassing varied cases of cardiovascular, neurological, and pulmonary conditions, enabling the model’s training and validation. The methodology involves collecting images, employing transfer learning, and implementing data augmentation techniques to enhance the model’s robustness. Evaluation metrics including accuracy, sensitivity, specificity, and AUC demonstrate the model’s efficacy in differentiating between disease categories and healthy instances. This research contributes to advancing healthcare by providing a tool for precise and timely diagnosis, potentially improving patient outcomes across these critical medical domains.

Medicine,Computer Science
Multi-label neural architecture search for chest radiography image classification

Yi Yang,Jiaxuan Wei,Zhixuan Yu,Ruisheng Zhang

DOI: https://doi.org/10.1007/s00530-023-01215-6

IF: 3.9

2024-01-15

Multimedia Systems

Abstract:Chest radiography remain the global standard for diagnosing pulmonary diseases. Despite numerous research efforts, medical professionals still face challenges in rapidly and accurately analyzing multiple diseases on a single chest radiography. Moreover, traditional deep learning methods suffer from complexities in design and prolonged processing times. To address these issues, we propose a multi-label neural architecture search (MLNAS) approach. Primarily intended for multi-label chest radiography image classification, MLNAS employs automated modeling, data augmentation, and threshold calculation strategies to improve the accuracy of chest radiography image classification and enhance result interpretation. Furthermore, MLNAS demonstrates the potential for application in other multi-label medical image classification domains. Experimental results indicate that MLNAS achieves state-of-the-art prediction accuracy for 9 out of 14 lung diseases. This novel approach presents a new solution for computer-aided diagnosis of chest X-rays.

computer science, information systems, theory & methods

[Rehabilitation of aged patients with medullary lesions].

Multi-Label Annotation of Chest Abdomen Pelvis Computed Tomography Text Reports Using Deep Learning

Classification of Multiple Diseases on Body CT Scans using Weakly Supervised Deep Learning

Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumes

Annotation-free multi-organ anomaly detection in abdominal CT using free-text radiology reports: A multi-center retrospective study

Deep learning to automate the labelling of head MRI datasets for computer vision applications

Highly accurate classification of chest radiographic reports using a deep learning natural language model pre-trained on 3.8 million text reports

Deep Learning Body Region Classification of MRI and CT examinations

Supervised and unsupervised language modelling in Chest X-Ray radiological reports

Automated Identification of Thoracic Pathology from Chest Radiographs with Enhanced Training Pipeline

Multi-Label Classification of Lung Diseases Using Deep Learning

Deep Learning to Classify Radiology Free-Text Reports

Multi-task Learning for Chest X-ray Abnormality Classification on Noisy Labels

Learning to diagnose common thorax diseases on chest radiographs from radiology reports in Vietnamese

Robust classification from noisy labels: Integrating additional knowledge for chest radiography abnormality assessment

Automatic Annotation of Narrative Radiology Reports

Deep Learning with Weak Annotation from Diagnosis Reports for Detection of Multiple Head Disorders: a Prospective, Multicentre Study

Robust breast cancer detection in mammography and digital breast tomosynthesis using an annotation-efficient deep learning approach

High Throughput Image Labeling on Chest Computed Tomography by Deep Learning.

Multi-Disease Diagnosis Using Medical Images

Multi-label neural architecture search for chest radiography image classification