IgA subclass responses to lipopolysaccharide in humans.

Z. Moldoveanu,T. A. Brown,M. Ventura,S. Michalek,J. Mcghee,J. Mestecky

Advances in experimental medicine and biology

Abstract:

What problem does this paper attempt to address?

Semi-Supervised Natural Language Approach for Fine-Grained Classification of Medical Reports

Neil Deshmukh,Selin Gumustop,Romane Gauriau,Varun Buch,Bradley Wright,Christopher Bridge,Ram Naidu,Katherine Andriole,Bernardo Bizzo

DOI: https://doi.org/10.48550/arXiv.1910.13573

2019-11-14

Abstract:Although machine learning has become a powerful tool to augment doctors in clinical analysis, the immense amount of labeled data that is necessary to train supervised learning approaches burdens each development task as time and resource intensive. The vast majority of dense clinical information is stored in written reports, detailing pertinent patient information. The challenge with utilizing natural language data for standard model development is due to the complex nature of the modality. In this research, a model pipeline was developed to utilize an unsupervised approach to train an encoder-language model, a recurrent network, to generate document encodings; which then can be used as features passed into a decoder-classifier model that requires magnitudes less labeled data than previous approaches to differentiate between fine-grained disease classes accurately. The language model was trained on unlabeled radiology reports from the Massachusetts General Hospital Radiology Department (n=218,159) and terminated with a loss of 1.62. The classification models were trained on three labeled datasets of head CT studies of reported patients, presenting large vessel occlusion (n=1403), acute ischemic strokes (n=331), and intracranial hemorrhage (n=4350), to identify a variety of different findings directly from the radiology report data; resulting in AUCs of 0.98, 0.95, and 0.99, respectively, for the large vessel occlusion, acute ischemic stroke, and intracranial hemorrhage datasets. The output encodings are able to be used in conjunction with imaging data, to create models that can process a multitude of different modalities. The ability to automatically extract relevant features from textual data allows for faster model development and integration of textual modality, overall, allowing clinical reports to become a more viable input for more encompassing and accurate deep learning models.

Machine Learning,Computation and Language
An Explainable Classification Method Based on Complex Scaling in Histopathology Images for Lung and Colon Cancer

Sudhakar Tummala,Seifedine Kadry,Ahmed Nadeem,Hafiz Tayyab Rauf,Nadia Gul

DOI: https://doi.org/10.3390/diagnostics13091594

IF: 3.6

2023-04-30

Diagnostics

Abstract:Lung and colon cancers are among the leading causes of human mortality and morbidity. Early diagnostic work up of these diseases include radiography, ultrasound, magnetic resonance imaging, and computed tomography. Certain blood tumor markers for carcinoma lung and colon also aid in the diagnosis. Despite the lab and diagnostic imaging, histopathology remains the gold standard, which provides cell-level images of tissue under examination. To read these images, a histopathologist spends a large amount of time. Furthermore, using conventional diagnostic methods involve high-end equipment as well. This leads to limited number of patients getting final diagnosis and early treatment. In addition, there are chances of inter-observer errors. In recent years, deep learning has shown promising results in the medical field. This has helped in early diagnosis and treatment according to severity of disease. With the help of EfficientNetV2 models that have been cross-validated and tested fivefold, we propose an automated method for detecting lung (lung adenocarcinoma, lung benign, and lung squamous cell carcinoma) and colon (colon adenocarcinoma and colon benign) cancer subtypes from LC25000 histopathology images. A state-of-the-art deep learning architecture based on the principles of compound scaling and progressive learning, EfficientNetV2 large, medium, and small models. An accuracy of 99.97%, AUC of 99.99%, F1-score of 99.97%, balanced accuracy of 99.97%, and Matthew's correlation coefficient of 99.96% were obtained on the test set using the EffcientNetV2-L model for the 5-class classification of lung and colon cancers, outperforming the existing methods. Using gradCAM, we created visual saliency maps to precisely locate the vital regions in the histopathology images from the test set where the models put more attention during cancer subtype predictions. This visual saliency maps may potentially assist pathologists to design better treatment strategies. Therefore, it is possible to use the proposed pipeline in clinical settings for fully automated lung and colon cancer detection from histopathology images with explainability.

medicine, general & internal
Natural Language Processing to Identify Abnormal Breast, Lung, and Cervical Cancer Screening Test Results from Unstructured Reports to Support Timely Follow-up.

Courtney J Diamond,John Laurentiev,Jie Yang,Amy Wint,Kimberly A Harris,Tin H Dang,Amrita Mecker,Emily B Carpenter,Anna N Tosteson,Adam Wright,Jennifer S Haas,Steven J Atlas,Li Zhou

DOI: https://doi.org/10.3233/shti220112

2022-01-01

Abstract:Cancer screening and timely follow-up of abnormal results can reduce mortality. One barrier to follow-up is the failure to identify abnormal results. While EHRs have coded results for certain tests, cancer screening results are often stored in free-text reports, which limit capabilities for automated decision support. As part of the multilevel Follow-up of Cancer Screening (mFOCUS) trial, we developed and implemented a natural language processing (NLP) tool to assist with real-time detection of abnormal cancer screening test results (including mammograms, low-dose chest CT scans, and Pap smears) and identification of gynecological follow-up for higher risk abnormalities (i.e. colposcopy) from free-text reports. We demonstrate the integration and implementation of NLP, within the mFOCUS system, to improve the follow-up of abnormal cancer screening results in a large integrated healthcare system. The NLP pipelines have detected scenarios when guideline-recommended care was not delivered, in part because the provider mis-identified the text-based result reports.
Automating Clinical Chart Review: An Open-Source Natural Language Processing Pipeline Developed on Free-Text Radiology Reports From Patients With Glioblastoma

Joeky T Senders,Logan D Cho,Paola Calvachi,John J McNulty,Joanna L Ashby,Isabelle S Schulte,Ahmad Kareem Almekkawi,Alireza Mehrtash,William B Gormley,Timothy R Smith,Marike L D Broekman,Omar Arnaout

DOI: https://doi.org/10.1200/CCI.19.00060

Abstract:Purpose: The aim of this study was to develop an open-source natural language processing (NLP) pipeline for text mining of medical information from clinical reports. We also aimed to provide insight into why certain variables or reports are more suitable for clinical text mining than others. Materials and methods: Various NLP models were developed to extract 15 radiologic characteristics from free-text radiology reports for patients with glioblastoma. Ten-fold cross-validation was used to optimize the hyperparameter settings and estimate model performance. We examined how model performance was associated with quantitative attributes of the radiologic characteristics and reports. Results: In total, 562 unique brain magnetic resonance imaging reports were retrieved. NLP extracted 15 radiologic characteristics with high to excellent discrimination (area under the curve, 0.82 to 0.98) and accuracy (78.6% to 96.6%). Model performance was correlated with the inter-rater agreement of the manually provided labels (ρ = 0.904; P < .001) but not with the frequency distribution of the variables of interest (ρ = 0.179; P = .52). All variables labeled with a near perfect inter-rater agreement were classified with excellent performance (area under the curve > 0.95). Excellent performance could be achieved for variables with only 50 to 100 observations in the minority group and class imbalances up to a 9:1 ratio. Report-level classification accuracy was not associated with the number of words or the vocabulary size in the distinct text documents. Conclusion: This study provides an open-source NLP pipeline that allows for text mining of narratively written clinical reports. Small sample sizes and class imbalance should not be considered as absolute contraindications for text mining in clinical research. However, future studies should report measures of inter-rater agreement whenever ground truth is based on a consensus label and use this measure to identify clinical variables eligible for text mining.
Inhibition of epidermal growth factor-induced mitogenesis by amiloride and an analog: evidence against a requirement for Na+/H+ exchange.

J. Besterman,S. Tyrey,E. Cragoe,P. Cuatrecasas

DOI: https://doi.org/10.1073/PNAS.81.21.6762

1984-11-01

Abstract:We have tested the hypothesis that the rapid stimulation of Na+/H+ exchange by epidermal growth factor (EGF) is a requirement for induction of mitogenesis. BALB/c 3T3 cells exposed for 4 hr at 37 degrees C to both EGF at 1 ng/ml and either 0.2-1 mM amiloride (an inhibitor of Na+/H+ exchange) or 10 microM MK-685 (an amiloride analog and more potent inhibitor of Na+/H+ exchange) incorporated no less [methyl-3H]thymidine during a 1-hr pulse 20 hr later than did cells exposed for 4 hr to EGF alone. Control experiments utilizing low external pH (to dissociate EGF from its receptor) and anti-EGF antibodies indicated that the failure of amiloride to inhibit mitogenesis when copresent with EGF during the first 4 hr was not due to incomplete removal of EGF and complete removal of amiloride at t4. Cells incubated with 200 microM amiloride for 24 hr showed nearly complete inhibition of stimulation by EGF. In comparison, cells incubated with 10 microM MK-685 for 24 hr showed only a slight inhibition of stimulation by EGF. Incubations with amiloride or MK-685 for shorter periods of time indicated that only amiloride inhibited mitogenesis and that this inhibition happened between 4 (t4) and 10(t10) hr after EGF addition, during which time increases in RNA and protein synthesis (required for mitogenesis) occurred. Amiloride inhibited both RNA and protein syntheses in intact cells during this prereplicative period, while MK-685 was without effect. We conclude that (i) inhibition of EGF-induced mitogenesis by amiloride is due not to inhibition of EGF-stimulated Na+/H+ exchange but rather to inhibition of necessary events occurring during the hours immediately prior to the onset of DNA synthesis, these events probably being RNA and protein synthesis and (ii) in cell culture medium buffered with CO2/HCO3-, complete inhibition of EGF-stimulated Na+/H+ exchange does not inhibit EGF-induced mitogenesis and, thus, stimulation of Na+/H+ exchange is not necessary for induction of mitogenesis by EGF.
How Natural Language Processing Can Aid With Pulmonary Oncology Tumor Node Metastasis Staging From Free-Text Radiology Reports: Algorithm Development and Validation

Sander Puts,Martijn Nobel,Catharina Zegers,Iñigo Bermejo,Simon Robben,Andre Dekker

DOI: https://doi.org/10.2196/38125

2023-03-22

Abstract:Background: Natural language processing (NLP) is thought to be a promising solution to extract and store concepts from free text in a structured manner for data mining purposes. This is also true for radiology reports, which still consist mostly of free text. Accurate and complete reports are very important for clinical decision support, for instance, in oncological staging. As such, NLP can be a tool to structure the content of the radiology report, thereby increasing the report's value. Objective: This study describes the implementation and validation of an N-stage classifier for pulmonary oncology. It is based on free-text radiological chest computed tomography reports according to the tumor, node, and metastasis (TNM) classification, which has been added to the already existing T-stage classifier to create a combined TN-stage classifier. Methods: SpaCy, PyContextNLP, and regular expressions were used for proper information extraction, after additional rules were set to accurately extract N-stage. Results: The overall TN-stage classifier accuracy scores were 0.84 and 0.85, respectively, for the training (N=95) and validation (N=97) sets. This is comparable to the outcomes of the T-stage classifier (0.87-0.92). Conclusions: This study shows that NLP has potential in classifying pulmonary oncology from free-text radiological reports according to the TNM classification system as both the T- and N-stages can be extracted with high accuracy.
Using Recurrent Neural Networks to Extract High-Quality Information From Lung Cancer Screening Computerized Tomography Reports for Inter-Radiologist Audit and Feedback Quality Improvement

Yucheng Zhang,Benjamin M M Grant,Andrew J Hope,Rayjean J Hung,Matthew T Warkentin,Andrew C L Lam,Reenika Aggawal,Maria Xu,Frances A Shepherd,Ming-Sound Tsao,Wei Xu,Mini Pakkal,Geoffrey Liu,Micheal C McInnis

DOI: https://doi.org/10.1200/CCI.22.00153

Abstract:Purpose: Lung cancer screening programs generate a high volume of low-dose computed tomography (LDCT) reports that contain valuable information, typically in a free-text format. High-performance named-entity recognition (NER) models can extract relevant information from these reports automatically for inter-radiologist quality control. Methods: Using LDCT report data from a longitudinal lung cancer screening program (8,305 reports; 3,124 participants; 2006-2019), we trained a rule-based model and two bidirectional long short-term memory (Bi-LSTM) NER neural network models to detect clinically relevant information from LDCT reports. Model performance was tested using F1 scores and compared with a published open-source radiology NER model (Stanza) in an independent evaluation set of 150 reports. The top performing model was applied to a data set of 6,948 reports for an inter-radiologist quality control assessment. Results: The best performing model, a Bi-LSTM NER recurrent neural network model, had an overall F1 score of 0.950, which outperformed Stanza (F1 score = 0.872) and a rule-based NER model (F1 score = 0.809). Recall (sensitivity) for the best Bi-LSTM model ranged from 0.916 to 0.991 for different entity types; precision (positive predictive value) ranged from 0.892 to 0.997. Test performance remained stable across time periods. There was an average of a 2.86-fold difference in the number of identified entities between the most and the least detailed radiologists. Conclusion: We built an open-source Bi-LSTM NER model that outperformed other open-source or rule-based radiology NER models. This model can efficiently extract clinically relevant information from lung cancer screening computerized tomography reports with high accuracy, enabling efficient audit and feedback to improve quality of patient care.
Use of Natural Language Processing to Infer Sites of Metastatic Disease From Radiology Reports at Scale

See Boon Tay,Guat Hwa Low,Gillian Jing En Wong,Han Jieh Tey,Fun Loon Leong,Constance Li,Melvin Lee Kiang Chua,Daniel Shao Weng Tan,Choon Hua Thng,Iain Bee Huat Tan,Ryan Shea Ying Cong Tan

DOI: https://doi.org/10.1200/CCI.23.00122

Abstract:Purpose: To evaluate natural language processing (NLP) methods to infer metastatic sites from radiology reports. Methods: A set of 4,522 computed tomography (CT) reports of 550 patients with 14 types of cancer was used to fine-tune four clinical large language models (LLMs) for multilabel classification of metastatic sites. We also developed an NLP information extraction (IE) system (on the basis of named entity recognition, assertion status detection, and relation extraction) for comparison. Model performances were measured by F1 scores on test and three external validation sets. The best model was used to facilitate analysis of metastatic frequencies in a cohort study of 6,555 patients with 53,838 CT reports. Results: The RadBERT, BioBERT, GatorTron-base, and GatorTron-medium LLMs achieved F1 scores of 0.84, 0.87, 0.89, and 0.91, respectively, on the test set. The IE system performed best, achieving an F1 score of 0.93. F1 scores of the IE system by individual cancer type ranged from 0.89 to 0.96. The IE system attained F1 scores of 0.89, 0.83, and 0.81, respectively, on external validation sets including additional cancer types, positron emission tomography-CT ,and magnetic resonance imaging scans, respectively. In our cohort study, we found that for colorectal cancer, liver-only metastases were higher in de novo stage IV versus recurrent patients (29.7% v 12.2%; P < .001). Conversely, lung-only metastases were more frequent in recurrent versus de novo stage IV patients (17.2% v 7.3%; P < .001). Conclusion: We developed an IE system that accurately infers metastatic sites in multiple primary cancers from radiology reports. It has explainable methods and performs better than some clinical LLMs. The inferred metastatic phenotypes could enhance cancer research databases and clinical trial matching, and identify potential patients for oligometastatic interventions.
Automatic Extraction of Lung Cancer Staging Information from Computed Tomography Reports: Deep Learning Approach.

Danqing Hu,Huanyao Zhang,Shaolei Li,Yuhong Wang,Nan Wu,Xudong Lu

DOI: https://doi.org/10.2196/27955

IF: 3.2

2021-01-01

JMIR Medical Informatics

Abstract:BACKGROUND:Lung cancer is the leading cause of cancer deaths worldwide. Clinical staging of lung cancer plays a crucial role in making treatment decisions and evaluating prognosis. However, in clinical practice, approximately one-half of the clinical stages of lung cancer patients are inconsistent with their pathological stages. As one of the most important diagnostic modalities for staging, chest computed tomography (CT) provides a wealth of information about cancer staging, but the free-text nature of the CT reports obstructs their computerization. OBJECTIVE:We aimed to automatically extract the staging-related information from CT reports to support accurate clinical staging of lung cancer. METHODS:In this study, we developed an information extraction (IE) system to extract the staging-related information from CT reports. The system consisted of the following three parts: named entity recognition (NER), relation classification (RC), and postprocessing (PP). We first summarized 22 questions about lung cancer staging based on the TNM staging guideline. Next, three state-of-the-art NER algorithms were implemented to recognize the entities of interest. Next, we designed a novel RC method using the relation sign constraint (RSC) to classify the relations between entities. Finally, a rule-based PP module was established to obtain the formatted answers using the results of NER and RC. RESULTS:We evaluated the developed IE system on a clinical data set containing 392 chest CT reports collected from the Department of Thoracic Surgery II in the Peking University Cancer Hospital. The experimental results showed that the bidirectional encoder representation from transformers (BERT) model outperformed the iterated dilated convolutional neural networks-conditional random field (ID-CNN-CRF) and bidirectional long short-term memory networks-conditional random field (Bi-LSTM-CRF) for NER tasks with macro-F1 scores of 80.97% and 90.06% under the exact and inexact matching schemes, respectively. For the RC task, the proposed RSC showed better performance than the baseline methods. Further, the BERT-RSC model achieved the best performance with a macro-F1 score of 97.13% and a micro-F1 score of 98.37%. Moreover, the rule-based PP module could correctly obtain the formatted results using the extractions of NER and RC, achieving a macro-F1 score of 94.57% and a micro-F1 score of 96.74% for all the 22 questions. CONCLUSIONS:We conclude that the developed IE system can effectively and accurately extract information about lung cancer staging from CT reports. Experimental results show that the extracted results have significant potential for further use in stage verification and prediction to facilitate accurate clinical staging.
Empirical evaluation of language modeling to ascertain cancer outcomes from clinical text reports

Haitham A Elmarakeby,Pavel S Trukhanov,Vidal M Arroyo,Irbaz Bin Riaz,Deborah Schrag,Eliezer M Van Allen,Kenneth L Kehl

DOI: https://doi.org/10.1186/s12859-023-05439-1

IF: 3.307

2023-09-02

BMC Bioinformatics

Abstract:Background: Longitudinal data on key cancer outcomes for clinical research, such as response to treatment and disease progression, are not captured in standard cancer registry reporting. Manual extraction of such outcomes from unstructured electronic health records is a slow, resource-intensive process. Natural language processing (NLP) methods can accelerate outcome annotation, but they require substantial labeled data. Transfer learning based on language modeling, particularly using the Transformer architecture, has achieved improvements in NLP performance. However, there has been no systematic evaluation of NLP model training strategies on the extraction of cancer outcomes from unstructured text. Results: We evaluated the performance of nine NLP models at the two tasks of identifying cancer response and cancer progression within imaging reports at a single academic center among patients with non-small cell lung cancer. We trained the classification models under different conditions, including training sample size, classification architecture, and language model pre-training. The training involved a labeled dataset of 14,218 imaging reports for 1112 patients with lung cancer. A subset of models was based on a pre-trained language model, DFCI-ImagingBERT, created by further pre-training a BERT-based model using an unlabeled dataset of 662,579 reports from 27,483 patients with cancer from our center. A classifier based on our DFCI-ImagingBERT, trained on more than 200 patients, achieved the best results in most experiments; however, these results were marginally better than simpler "bag of words" or convolutional neural network models. Conclusion: When developing AI models to extract outcomes from imaging reports for clinical cancer research, if computational resources are plentiful but labeled training data are limited, large language models can be used for zero- or few-shot learning to achieve reasonable performance. When computational resources are more limited but labeled training data are readily available, even simple machine learning architectures can achieve good performance for such tasks.
Towards radiologist-level cancer risk assessment in CT lung screening using deep learning

Stojan Trajanovski,Dimitrios Mavroeidis,Christine Leon Swisher,Binyam Gebrekidan Gebre,Bastiaan S. Veeling,Rafael Wiemker,Tobias Klinder,Amir Tahmasebi,Shawn M. Regis,Christoph Wald,Brady J. McKee,Sebastian Flacke,Heber MacMahon,Homer Pien

DOI: https://doi.org/10.1016/j.compmedimag.2021.101883

2019-04-12

Abstract:Importance: Lung cancer is the leading cause of cancer mortality in the US, responsible for more deaths than breast, prostate, colon and pancreas cancer combined and it has been recently demonstrated that low-dose computed tomography (CT) screening of the chest can significantly reduce this death rate. Objective: To compare the performance of a deep learning model to state-of-the-art automated algorithms and radiologists as well as assessing the robustness of the algorithm in heterogeneous datasets. Design, Setting, and Participants: Three low-dose CT lung cancer screening datasets from heterogeneous sources were used, including National Lung Screening Trial (NLST, n=3410), Lahey Hospital and Medical Center (LHMC, n=3174) data, Kaggle competition data (from both stages, n=1595+505) and the University of Chicago data (UCM, a subset of NLST, annotated by radiologists, n=197). Relevant works on automated methods for Lung Cancer malignancy estimation have used significantly less data in size and diversity. At the first stage, our framework employs a nodule detector; while in the second stage, we use both the image area around the nodules and nodule features as inputs to a neural network that estimates the malignancy risk for the entire CT scan. We trained our two-stage algorithm on a part of the NLST dataset, and validated it on the other datasets. Results, Conclusions, and Relevance: The proposed deep learning model: (a) generalizes well across all three data sets, achieving AUC between 86% to 94%; (b) has better performance than the widely accepted PanCan Risk Model, achieving 11% better AUC score; (c) has improved performance compared to the state-of-the-art represented by the winners of the Kaggle Data Science Bowl 2017 competition on lung cancer screening; (d) has comparable performance to radiologists in estimating cancer risk at a patient level.

Computer Vision and Pattern Recognition
The effect of associative strength on priming in the cerebral hemispheres

J. Coney

DOI: https://doi.org/10.1016/S0278-2626(02)00507-9

IF: 2.682

2002-11-01

Brain and Cognition

Abstract:
Natural language processing for automated breast cancer recurrence detection and classification in computed tomography reports.

Jaimie Lee,Andres Zepeda,Gregory Arbour,Kathryn V. Isaac,Raymond T. Ng,Alan Nichol

DOI: https://doi.org/10.1200/jco.2024.42.16_suppl.e13591

IF: 45.3

2024-05-31

Journal of Clinical Oncology

Abstract:e13591 Background: Relapse is a major concern for oncologists and breast cancer survivors that necessitates additional treatment and often leads to mortality. Cancer registries routinely track cancer mortality, but few monitor for relapse because of logistical challenges and prohibitive costs. In this context, Natural Language Processing (NLP) is a promising tool. Merging artificial intelligence with linguistics, NLP can rapidly analyze vast volumes of text in electronic health records. This capability of NLP is particularly valuable for Computed Tomography (CT) scans used in breast cancer care. CT scans are routinely used to characterize breast cancer progression and are described in transcribed dictations by radiologists. We aimed to apply NLP to these text reports to identify breast cancer relapses. Objective: To automate breast cancer relapse detection and classification in CT text reports using NLP. Methods: We analyzed 1,445 CT text reports from patients diagnosed with breast cancer between January 1, 2005, and December 31, 2014. These reports underwent manual review by trained human annotators. Text was annotated to identify terminology defining local, regional, and distant breast cancer relapses. Annotated reports were partitioned into a training-validation set (90% cohort) and a test set (10% cohort) for NLP model development. Results: In our dataset of 1,445 CT text reports, 72 (5.0%) were classified as local relapse, 97 (6.7%) as regional relapse, and 743 (51.4%) as distant relapse. The performance of our NLP model using the training-validation dataset can be summarized by the following metrics and 95% confidence intervals: 94% (±3.2) accuracy for detection and 96% (±2.9) accuracy for classification. The performance of our NLP model was confirmed using the test dataset, with 90% (±4.5) accuracy for detection and 91% (±6.3) accuracy for classification. For reference, all metrics are outlined (Table). Conclusions: Our model for identifying regional and distant relapses in CT reports had excellent performance, but had lower sensitivity for local relapses, posing a risk of false negatives. Automating the identification and classification of breast cancer relapses, if used retrospectively, can enhance cancer registry data about patient outcomes and, if used prospectively, holds the potential for enhancing patient care. [Table: see text]

oncology
Cross-Institutional Structured Radiology Reporting for Lung Cancer Screening Using a Dynamic Template-Constrained Large Language Model

Chuang Niu,Parisa Kaviani,Qing Lyu,Mannudeep K. Kalra,Christopher T. Whitlow,Ge Wang

2024-09-27

Abstract:Structured radiology reporting is advantageous for optimizing clinical workflows and patient outcomes. Current LLMs in creating structured reports face the challenges of formatting errors, content hallucinations, and privacy leakage concerns when uploaded to external servers. We aim to develop an enhanced open-source LLM for creating structured and standardized LCS reports from free-text descriptions. After institutional IRB approvals, 5,442 de-identified LCS reports from two institutions were retrospectively analyzed. 500 reports were randomly selected from the two institutions evenly and then manually labeled for evaluation. Two radiologists from the two institutions developed a standardized template including 29 features for lung nodule reporting. We proposed template-constrained decoding to enhance state-of-the-art open-source LLMs, including LLAMA, Qwen, and Mistral. The LLM performance was extensively evaluated in terms of F1 score, confidence interval, McNemar test, and z-test. Based on the structured reports created from the large-scale dataset, a nodule-level retrieval system was prototyped and an automatic statistical analysis was performed. Our software, vLLM-structure, is publicly available for local deployment with enhanced LLMs. Our template-constrained decoding approach consistently enhanced the LLM performance on multi-institutional datasets, with neither formatting errors nor content hallucinations. Our method improved the best open-source LLAMA-3.1 405B by up to 10.42%, and outperformed GPT-4o by 17.19%. A novel nodule retrieval system was successfully prototyped and demonstrated on a large-scale multimodal database using our enhanced LLM technologies. The automatically derived statistical distributions were closely consistent with the prior findings in terms of nodule type, location, size, status, and Lung-RADS.

Artificial Intelligence,Computation and Language
Selective killing of B‐cell hybridomas targeting proteinase 3, Wegener's autoantigen

K. Reiners,H. Hansen,A. Krüssmann,G. Schön,E. Csernok,W. Gross,A. Engert,E. P. von Strandmann

DOI: https://doi.org/10.1111/j.1365-2567.2004.01875.x

2004-06-01

Immunology

Abstract:Wegener's granulomatosis (WG) is a rare disease characterized by granulomatous lesions, small vessel vasculitis and the presence of anti‐neutrophil cytoplasmic autoantibodies (C‐ANCAs) in the sera of affected patients. Their main target antigen is proteinase 3 (PR3), a neutrophil and monocyte‐derived neutral serine protease. Since the standard treatment of this severe autoimmune disease, with cyclophosphamide and corticosteroids, is associated with potential side‐effects, the development of a more specific immunotherapeutic agent is warranted. The key role of ANCA in the pathogenesis of vasculitis and the effectiveness of anti‐CD20 antibodies in patients with refractory WG points towards the importance of B cells in WG. We thus evaluated a new approach to selectively eliminate PR3‐specific autoreactive B cells by targeting the B‐cell receptor. For this purpose we used a bifunctional recombinant fusion protein consisting of the antigen PR3 and a toxin. The cytotoxic component of this novel fusion protein was the ribonuclease angiogenin, a human toxin with low immunogenicity. The toxin was stabilized by exchanging the catalytically relevant histidine in position 44 with glutamine to eliminate the autoproteolytic activity. PR3H44Q was fused either to the N terminus or to the C terminus of angiogenin. The recombinant proteins were expressed in 293T cells. Binding assays demonstrated the appropriate size and recognition by anti‐PR3 antibodies. Using TUNEL technology, we demonstrated that these autoantigen toxins kill proteinase 3‐specific B‐cell hybridomas selectively by inducing apoptosis. The data indicate that autoantigen‐toxins are promising tools in the treatment or co‐treatment of autoimmune diseases in which the antigen is known.
Novel approach to implementing natural language processing for clinical staging of non-small-cell lung cancer.

Manan P Shah,Laura Prichard,John A Glaspy,Vu Vu,Jason Wang,Alex V Gelvezon,Amy Lauren Cummings

DOI: https://doi.org/10.1200/jco.2024.42.16_suppl.e13624

IF: 45.3

2024-05-31

Journal of Clinical Oncology

Abstract:e13624 Background: Cancer staging is instrumental in driving clinical management and trial enrollment, but staging data are generally unreliable and unstructured in the electronic health record (EHR). Advances in natural language processing (NLP) may facilitate clinical staging and documentation [1], but challenges to real-world implementation include (1) automatically identifying appropriate patients and reports from the EHR and (2) developing an unbiased dataset for training and validation [2]. We describe our institution’s novel approach to overcome these barriers while building an in-house NLP pipeline for clinical tumor staging of non-small-cell lung cancer (NSCLC). Methods: We identified patients by searching our EHR (Epic) for a molecular analysis test ordered specifically for pathological diagnoses of NSCLC at our institution. We used the test order date as the diagnosis proxy date (DPD). For each patient, we extracted imaging reports up to 16 weeks before and 6 weeks after the DPD. To derive primary tumor size, we analyzed the CT Chest or PET/CT report closest to the DPD using an oncology-trained NLP text extraction and labeling tool (John Snow Labs). We cleaned all extracted tumor size entities and identified the largest measurement linked to the lungs. We compared primary tumor measurements from the NLP pipeline to those in a preexisting, manually compiled cancer registry (CNEXT). We manually analyzed discrepancies through chart review. Results: 542 patients with a DPD between 11/2016 - 9/2023 were processed through the NLP pipeline. Of 443 patients with valid values in both the pipeline and CNEXT, 53% (234) were exact matches, and 20% (90) had a close match (within 0-5mm), yielding a 73% accuracy rate for values within 5mm. When mismatched values were manually reviewed, several cases in CNEXT were found to have a DPD differing by more than 3 months and tumor sizes derived from external reports. When these cases were excluded, 320 of the remaining 349 patients had valid values in both the pipeline and the updated manual review. In this refined population, 66% (213) were exact matches, and 15% (48) had a close match, yielding an 82% accuracy rate for values within 5mm. Conclusions: To our knowledge, this is the first report of a pathology-based method to automatically and reliably identify patients with NSCLC and their relevant imaging reports directly from the EHR. We used a prebuilt NLP tool to derive primary tumor sizes with relatively high accuracy and found that adding flags for timeline discrepancies and external reports can further improve validity. As we near completion of analogous pipelines for node and metastasis staging, we will develop methodology to identify subgroups of patients that can be clinically staged with near-perfect accuracy, ultimately aiming to substantially limit manual staging of uncomplicated cases. 1. Puts 2023. 2. Wang 2022.

oncology
Automated Detection of Radiology Reports that Require Follow-up Imaging Using Natural Language Processing Feature Engineering and Machine Learning Classification

Robert Lou,Darco Lalevic,Charles Chambers,Hanna M. Zafar,Tessa S. Cook

DOI: https://doi.org/10.1007/s10278-019-00271-7

IF: 4.903

2019-09-03

Journal of Digital Imaging

Abstract:While radiologists regularly issue follow-up recommendations, our preliminary research has shown that anywhere from 35 to 50% of patients who receive follow-up recommendations for findings of possible cancer on abdominopelvic imaging do not return for follow-up. As such, they remain at risk for adverse outcomes related to missed or delayed cancer diagnosis. In this study, we develop an algorithm to automatically detect free text radiology reports that have a follow-up recommendation using natural language processing (NLP) techniques and machine learning models. The data set used in this study consists of 6000 free text reports from the author's institution. NLP techniques are used to engineer 1500 features, which include the most informative unigrams, bigrams, and trigrams in the training corpus after performing tokenization and Porter stemming. On this data set, we train naive Bayes, decision tree, and maximum entropy models. The decision tree model, with an F1 score of 0.458 and accuracy of 0.862, outperforms both the naive Bayes (F1 score of 0.381) and maximum entropy (F1 score of 0.387) models. The models were analyzed to determine predictive features, with term frequency of n-grams such as "renal neoplasm" and "evalu with enhanc" being most predictive of a follow-up recommendation. Key to maximizing performance was feature engineering that extracts predictive information and appropriate selection of machine learning algorithms based on the feature set.

radiology, nuclear medicine & medical imaging
A Natural Language Processing Pipeline of Chinese Free-text Radiology Reports for Liver Cancer Diagnosis

Honglei Liu,Yan Xu,Zhiqiang Zhang,Ni Wang,Yanqun Huang,Yanjun Hu,Zhenghan Yang,Rui Jiang,Hui Chen

DOI: https://doi.org/10.48550/arXiv.2004.13848

2020-04-10

Computation and Language

Abstract:Despite the rapid development of natural language processing (NLP) implementation in electronic medical records (EMRs), Chinese EMRs processing remains challenging due to the limited corpus and specific grammatical characteristics, especially for radiology reports. In this study, we designed an NLP pipeline for the direct extraction of clinically relevant features from Chinese radiology reports, which is the first key step in computer-aided radiologic diagnosis. The pipeline was comprised of named entity recognition, synonyms normalization, and relationship extraction to finally derive the radiological features composed of one or more terms. In named entity recognition, we incorporated lexicon into deep learning model bidirectional long short-term memory-conditional random field (BiLSTM-CRF), and the model finally achieved an F1 score of 93.00%. With the extracted radiological features, least absolute shrinkage and selection operator and machine learning methods (support vector machine, random forest, decision tree, and logistic regression) were used to build the classifiers for liver cancer prediction. For liver cancer diagnosis, random forest had the highest predictive performance in liver cancer diagnosis (F1 score 86.97%, precision 87.71%, and recall 86.25%). This work was a comprehensive NLP study focusing on Chinese radiology reports and the application of NLP in cancer risk prediction. The proposed NLP pipeline for the radiological feature extraction could be easily implemented in other kinds of Chinese clinical texts and other disease predictive tasks.
Supervised and unsupervised language modelling in Chest X-Ray radiological reports

Ignat Drozdov,Daniel Forbes,Benjamin Szubert,Mark Hall,Chris Carlin,David J Lowe

DOI: https://doi.org/10.1371/journal.pone.0229963

IF: 3.7

2020-03-10

PLoS ONE

Abstract:Chest radiography (CXR) is the most commonly used imaging modality and deep neural network (DNN) algorithms have shown promise in effective triage of normal and abnormal radiograms. Typically, DNNs require large quantities of expertly labelled training exemplars, which in clinical contexts is a major bottleneck to effective modelling, as both considerable clinical skill and time is required to produce high-quality ground truths. In this work we evaluate thirteen supervised classifiers using two large free-text corpora and demonstrate that bi-directional long short-term memory (BiLSTM) networks with attention mechanism effectively identify Normal, Abnormal, and Unclear CXR reports in internal (n = 965 manually-labelled reports, f1-score = 0.94) and external (n = 465 manually-labelled reports, f1-score = 0.90) testing sets using a relatively small number of expert-labelled training observations (n = 3,856 annotated reports). Furthermore, we introduce a general unsupervised approach that accurately distinguishes Normal and Abnormal CXR reports in a large unlabelled corpus. We anticipate that the results presented in this work can be used to automatically extract standardized clinical information from free-text CXR radiological reports, facilitating the training of clinical decision support systems for CXR triage.
Deep Learning to Classify Radiology Free-Text Reports

Matthew C Chen,Robyn L Ball,Lingyao Yang,Nathaniel Moradzadeh,Brian E Chapman,David B Larson,Curtis P Langlotz,Timothy J Amrhein,Matthew P Lungren,Matthew C. Chen,Robyn L. Ball,Brian E. Chapman,David B. Larson,Curtis P. Langlotz,Timothy J. Amrhein,Matthew P. Lungren

DOI: https://doi.org/10.1148/radiol.2017171115

IF: 19.7

2018-03-01

Radiology

Abstract:Purpose To evaluate the performance of a deep learning convolutional neural network (CNN) model compared with a traditional natural language processing (NLP) model in extracting pulmonary embolism (PE) findings from thoracic computed tomography (CT) reports from two institutions. Materials and Methods Contrast material-enhanced CT examinations of the chest performed between January 1, 1998, and January 1, 2016, were selected. Annotations by two human radiologists were made for three categories: the presence, chronicity, and location of PE. Classification of performance of a CNN model with an unsupervised learning algorithm for obtaining vector representations of words was compared with the open-source application PeFinder. Sensitivity, specificity, accuracy, and F1 scores for both the CNN model and PeFinder in the internal and external validation sets were determined. Results The CNN model demonstrated an accuracy of 99% and an area under the curve value of 0.97. For internal validation report data, the CNN model had a statistically significant larger F1 score (0.938) than did PeFinder (0.867) when classifying findings as either PE positive or PE negative, but no significant difference in sensitivity, specificity, or accuracy was found. For external validation report data, no statistical difference between the performance of the CNN model and PeFinder was found. Conclusion A deep learning CNN model can classify radiology free-text reports with accuracy equivalent to or beyond that of an existing traditional NLP model. <sup>©</sup> RSNA, 2017 Online supplemental material is available for this article.

radiology, nuclear medicine & medical imaging

IgA subclass responses to lipopolysaccharide in humans.

Semi-Supervised Natural Language Approach for Fine-Grained Classification of Medical Reports

An Explainable Classification Method Based on Complex Scaling in Histopathology Images for Lung and Colon Cancer

Natural Language Processing to Identify Abnormal Breast, Lung, and Cervical Cancer Screening Test Results from Unstructured Reports to Support Timely Follow-up.

Automating Clinical Chart Review: An Open-Source Natural Language Processing Pipeline Developed on Free-Text Radiology Reports From Patients With Glioblastoma

Inhibition of epidermal growth factor-induced mitogenesis by amiloride and an analog: evidence against a requirement for Na+/H+ exchange.

How Natural Language Processing Can Aid With Pulmonary Oncology Tumor Node Metastasis Staging From Free-Text Radiology Reports: Algorithm Development and Validation

Using Recurrent Neural Networks to Extract High-Quality Information From Lung Cancer Screening Computerized Tomography Reports for Inter-Radiologist Audit and Feedback Quality Improvement

Use of Natural Language Processing to Infer Sites of Metastatic Disease From Radiology Reports at Scale

Automatic Extraction of Lung Cancer Staging Information from Computed Tomography Reports: Deep Learning Approach.

Empirical evaluation of language modeling to ascertain cancer outcomes from clinical text reports

Towards radiologist-level cancer risk assessment in CT lung screening using deep learning

The effect of associative strength on priming in the cerebral hemispheres

Natural language processing for automated breast cancer recurrence detection and classification in computed tomography reports.

Cross-Institutional Structured Radiology Reporting for Lung Cancer Screening Using a Dynamic Template-Constrained Large Language Model

Selective killing of B‐cell hybridomas targeting proteinase 3, Wegener's autoantigen

Novel approach to implementing natural language processing for clinical staging of non-small-cell lung cancer.

Automated Detection of Radiology Reports that Require Follow-up Imaging Using Natural Language Processing Feature Engineering and Machine Learning Classification

A Natural Language Processing Pipeline of Chinese Free-text Radiology Reports for Liver Cancer Diagnosis

Supervised and unsupervised language modelling in Chest X-Ray radiological reports

Deep Learning to Classify Radiology Free-Text Reports