Leukemia among uranium miners--late effects of exposure to uranium dust?

L. Tomášek

Health Physics

Abstract:

What problem does this paper attempt to address?

Large-scale Identification of Patients with Cerebral Aneurysms Using Natural Language Processing

Victor M. Castro,Dmitriy Dligach,Sean Finan,Sheng Yu,Anil Can,Muhammad Abd-El-Barr,Vivian Gainer,Nancy A. Shadick,Shawn Murphy,Tianxi Cai,Guergana Savova,Scott T. Weiss,Rose Du

DOI: https://doi.org/10.1212/wnl.0000000000003490

IF: 9.9

2016-01-01

Neurology

Abstract:Objective: To use natural language processing (NLP) in conjunction with the electronic medical record (EMR) to accurately identify patients with cerebral aneurysms and their matched controls. Methods: ICD-9 and Current Procedural Terminology codes were used to obtain an initial data mart of potential aneurysm patients from the EMR. NLP was then used to train a classification algorithm with .632 bootstrap cross-validation used for correction of overfitting bias. The classification rule was then applied to the full data mart. Additional validation was performed on 300 patients classified as having aneurysms. Controls were obtained by matching age, sex, race, and healthcare use. Results: We identified 55,675 patients of 4.2 million patients with ICD-9 and Current Procedural Terminology codes consistent with cerebral aneurysms. Of those, 16,823 patients had the term aneurysm occur near relevant anatomic terms. After training, a final algorithm consisting of 8 coded and 14 NLP variables was selected, yielding an overall area under the receiver-operating characteristic curve of 0.95. After the final algorithm was applied, 5,589 patients were classified as having aneurysms, and 54,952 controls were matched to those patients. The positive predictive value based on a validation cohort of 300 patients was 0.86. Conclusions: We harnessed the power of the EMR by applying NLP to obtain a large cohort of patients with intracranial aneurysms and their matched controls. Such algorithms can be generalized to other diseases for epidemiologic and genetic studies.
Natural Language Processing to Identify Abnormal Breast, Lung, and Cervical Cancer Screening Test Results from Unstructured Reports to Support Timely Follow-up.

Courtney J Diamond,John Laurentiev,Jie Yang,Amy Wint,Kimberly A Harris,Tin H Dang,Amrita Mecker,Emily B Carpenter,Anna N Tosteson,Adam Wright,Jennifer S Haas,Steven J Atlas,Li Zhou

DOI: https://doi.org/10.3233/shti220112

2022-01-01

Abstract:Cancer screening and timely follow-up of abnormal results can reduce mortality. One barrier to follow-up is the failure to identify abnormal results. While EHRs have coded results for certain tests, cancer screening results are often stored in free-text reports, which limit capabilities for automated decision support. As part of the multilevel Follow-up of Cancer Screening (mFOCUS) trial, we developed and implemented a natural language processing (NLP) tool to assist with real-time detection of abnormal cancer screening test results (including mammograms, low-dose chest CT scans, and Pap smears) and identification of gynecological follow-up for higher risk abnormalities (i.e. colposcopy) from free-text reports. We demonstrate the integration and implementation of NLP, within the mFOCUS system, to improve the follow-up of abnormal cancer screening results in a large integrated healthcare system. The NLP pipelines have detected scenarios when guideline-recommended care was not delivered, in part because the provider mis-identified the text-based result reports.
Automating Stroke Data Extraction From Free-Text Radiology Reports Using Natural Language Processing: Instrument Validation Study

Amy Y X Yu,Zhongyu A Liu,Chloe Pou-Prom,Kaitlyn Lopes,Moira K Kapral,Richard I Aviv,Muhammad Mamdani

DOI: https://doi.org/10.2196/24381

IF: 3.2

2021-05-04

JMIR Medical Informatics

Abstract:Background Diagnostic neurovascular imaging data are important in stroke research, but obtaining these data typically requires laborious manual chart reviews. Objective We aimed to determine the accuracy of a natural language processing (NLP) approach to extract information on the presence and location of vascular occlusions as well as other stroke-related attributes based on free-text reports. Methods From the full reports of 1320 consecutive computed tomography (CT), CT angiography, and CT perfusion scans of the head and neck performed at a tertiary stroke center between October 2017 and January 2019, we manually extracted data on the presence of proximal large vessel occlusion (primary outcome), as well as distal vessel occlusion, ischemia, hemorrhage, Alberta stroke program early CT score (ASPECTS), and collateral status (secondary outcomes). Reports were randomly split into training (n=921) and validation (n=399) sets, and attributes were extracted using rule-based NLP. We reported the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and the overall accuracy of the NLP approach relative to the manually extracted data. Results The overall prevalence of large vessel occlusion was 12.2%. In the training sample, the NLP approach identified this attribute with an overall accuracy of 97.3% (95.5% sensitivity, 98.1% specificity, 84.1% PPV, and 99.4% NPV). In the validation set, the overall accuracy was 95.2% (90.0% sensitivity, 97.4% specificity, 76.3% PPV, and 98.5% NPV). The accuracy of identifying distal or basilar occlusion as well as hemorrhage was also high, but there were limitations in identifying cerebral ischemia, ASPECTS, and collateral status. Conclusions NLP may improve the efficiency of large-scale imaging data collection for stroke surveillance and research.

medical informatics
The effect of associative strength on priming in the cerebral hemispheres

J. Coney

DOI: https://doi.org/10.1016/S0278-2626(02)00507-9

IF: 2.682

2002-11-01

Brain and Cognition

Abstract:
Developing a natural language processing system using transformer-based models for adverse drug event detection in electronic health records

Jingyuan Wu,Xiaodi Ruan,Elizabeth McNeer,Katelyn M. Rossow,Leena Choi

DOI: https://doi.org/10.1101/2024.07.09.24310100

2024-07-10

Abstract:Objective: To develop a transformer-based natural language processing (NLP) system for detecting adverse drug events (ADEs) from clinical notes in electronic health records (EHRs). Materials and Methods: We fine-tuned BERT Short-Formers and Clinical-Longformer using the processed dataset of the 2018 National NLP Clinical Challenges (n2c2) shared task Track 2. We investigated two data processing methods, window-based and split-based approaches, to find an optimal processing method. We evaluated the generalization capabilities on a dataset extracted from Vanderbilt University Medical Center (VUMC) EHRs. Results: On the n2c2 dataset, the best average macro F-scores of 0.832 and 0.868 were achieved using a 15-word window with PubMedBERT and a 10-chunk split with Clinical-Longformer. On the VUMC dataset, the best average macro F-scores of 0.720 and 0.786 were achieved using a 4-chunk split with PubMedBERT and Clinical-Longformer. Discussion: Our study provided a comparative analysis of data processing methods. The fine-tuned transformer models showed good performance for ADE-related tasks. Especially, Clinical-Longformer model with split-based approach had a great potential for practical implementation of ADE detection. While the token limit was crucial, the chunk size also significantly influenced model performance, even when the text length was within the token limit. Conclusion: We provided guidance on model development, including data processing methods for ADE detection from clinical notes using transformer-based models. Our results on two datasets indicated that data processing methods and models should be carefully selected based on the type of clinical notes and the allocation trade-offs of human and computational power in annotation and model fine-tuning.

Health Informatics
Implementing engineering education on the WWW: 3 case studies

C. Gale,J. Bourne,M. Dawant,D. Quinn

Abstract:
Accurately Identifying Cerebroarterial Stenosis from Angiography Reports Using Natural Language Processing Approaches

Ching-Heng Lin,Kai-Cheng Hsu,Chih-Kuang Liang,Tsong-Hai Lee,Ching-Sen Shih,Yang C Fann

DOI: https://doi.org/10.3390/diagnostics12081882

2022-08-03

Abstract:Patients with intracranial artery stenosis show high incidence of stroke. Angiography reports contain rich but underutilized information that can enable the detection of cerebrovascular diseases. This study evaluated various natural language processing (NLP) techniques to accurately identify eleven intracranial artery stenosis from angiography reports. Three NLP models, including a rule-based model, a recurrent neural network (RNN), and a contextualized language model, XLNet, were developed and evaluated by internal-external cross-validation. In this study, angiography reports from two independent medical centers (9614 for training and internal validation testing and 315 as external validation) were assessed. The internal testing results showed that XLNet had the best performance, with a receiver operating characteristic curve (AUROC) ranging from 0.97 to 0.99 using eleven targeted arteries. The rule-based model attained an AUROC from 0.92 to 0.96, and the RNN long short-term memory model attained an AUROC from 0.95 to 0.97. The study showed the potential application of NLP techniques such as the XLNet model for the routine and automatic screening of patients with high risk of intracranial artery stenosis using angiography reports. However, the NLP models were investigated based on relatively small sample sizes with very different report writing styles and a prevalence of stenosis case distributions, revealing challenges for model generalization.
[Concerning the relationship between alveolar hypocapnia and bronchial obstruction (author's transl)].

R. Redhammer,J. Murín,M. Ondrejicka

1979-03-01

Bratislava Medical Journal

Abstract:
A novel heterocyclic compound: catena-poly[[[diaquasodium(I)]-di-mu-aqua] hemi(1,5-dihydroxy-4,8,9-trioxa-2,6-diazabicyclo[3.3.1]nona-2,6-diene-3,7-diolate)].

Rui-qin Fang,Zhu-Ping Xiao,P. Cao,D. Shi,Hailiang Zhu

DOI: https://doi.org/10.1107/s0108270107001977

Abstract:In the title compound, {[Na(H2O)4]2(C(4)H(2)N(2)O(7))}n, the 1,5-dihydroxy-4,8,9-trioxa-2,6-diazabicyclo[3.3.1]nona-2,6-diene-3,7-diolate anion lies across a twofold axis in the space group C2/c; there are two independent Na sites, one on a twofold axis and the other on a centre of inversion. Hydrogen bonds link the {[Na(H2O)4]+}n chains and diolate anions into a three-dimensional framework.
Reshaping Free-Text Radiology Notes Into Structured Reports With Generative Transformers

Laura Bergomi,Tommaso M. Buonocore,Paolo Antonazzo,Lorenzo Alberghi,Riccardo Bellazzi,Lorenzo Preda,Chandra Bortolotto,Enea Parimbelli

2024-03-28

Abstract:BACKGROUND: Radiology reports are typically written in a free-text format, making clinical information difficult to extract and use. Recently the adoption of structured reporting (SR) has been recommended by various medical societies thanks to the advantages it offers, e.g. standardization, completeness and information retrieval. We propose a pipeline to extract information from free-text radiology reports, that fits with the items of the reference SR registry proposed by a national society of interventional and medical radiology, focusing on CT staging of patients with lymphoma. METHODS: Our work aims to leverage the potential of Natural Language Processing (NLP) and Transformer-based models to deal with automatic SR registry filling. With the availability of 174 radiology reports, we investigate a rule-free generative Question Answering approach based on a domain-specific version of T5 (IT5). Two strategies (batch-truncation and ex-post combination) are implemented to comply with the model's context length limitations. Performance is evaluated in terms of strict accuracy, F1, and format accuracy, and compared with the widely used GPT-3.5 Large Language Model. A 5-point Likert scale questionnaire is used to collect human-expert feedback on the similarity between medical annotations and generated answers. RESULTS: The combination of fine-tuning and batch splitting allows IT5 to achieve notable results; it performs on par with GPT-3.5 albeit its size being a thousand times smaller in terms of parameters. Human-based assessment scores show a high correlation (Spearman's correlation coefficients>0.88, p-values<0.001) with AI performance metrics (F1) and confirm the superior ability of LLMs (i.e., GPT-3.5, 175B of parameters) in generating plausible human-like statements.

Computation and Language,Artificial Intelligence
Natural language processing for automated breast cancer recurrence detection and classification in computed tomography reports.

Jaimie Lee,Andres Zepeda,Gregory Arbour,Kathryn V. Isaac,Raymond T. Ng,Alan Nichol

DOI: https://doi.org/10.1200/jco.2024.42.16_suppl.e13591

IF: 45.3

2024-05-31

Journal of Clinical Oncology

Abstract:e13591 Background: Relapse is a major concern for oncologists and breast cancer survivors that necessitates additional treatment and often leads to mortality. Cancer registries routinely track cancer mortality, but few monitor for relapse because of logistical challenges and prohibitive costs. In this context, Natural Language Processing (NLP) is a promising tool. Merging artificial intelligence with linguistics, NLP can rapidly analyze vast volumes of text in electronic health records. This capability of NLP is particularly valuable for Computed Tomography (CT) scans used in breast cancer care. CT scans are routinely used to characterize breast cancer progression and are described in transcribed dictations by radiologists. We aimed to apply NLP to these text reports to identify breast cancer relapses. Objective: To automate breast cancer relapse detection and classification in CT text reports using NLP. Methods: We analyzed 1,445 CT text reports from patients diagnosed with breast cancer between January 1, 2005, and December 31, 2014. These reports underwent manual review by trained human annotators. Text was annotated to identify terminology defining local, regional, and distant breast cancer relapses. Annotated reports were partitioned into a training-validation set (90% cohort) and a test set (10% cohort) for NLP model development. Results: In our dataset of 1,445 CT text reports, 72 (5.0%) were classified as local relapse, 97 (6.7%) as regional relapse, and 743 (51.4%) as distant relapse. The performance of our NLP model using the training-validation dataset can be summarized by the following metrics and 95% confidence intervals: 94% (±3.2) accuracy for detection and 96% (±2.9) accuracy for classification. The performance of our NLP model was confirmed using the test dataset, with 90% (±4.5) accuracy for detection and 91% (±6.3) accuracy for classification. For reference, all metrics are outlined (Table). Conclusions: Our model for identifying regional and distant relapses in CT reports had excellent performance, but had lower sensitivity for local relapses, posing a risk of false negatives. Automating the identification and classification of breast cancer relapses, if used retrospectively, can enhance cancer registry data about patient outcomes and, if used prospectively, holds the potential for enhancing patient care. [Table: see text]

oncology
Natural Language Processing of Radiology Reports to Detect Complications of Ischemic Stroke

Miller, Matthew I.,Orfanoudaki, Agni,Cronin, Michael,Saglam, Hanife,So Yeon Kim, Ivy,Balogun, Oluwafemi,Tzalidi, Maria,Vasilopoulos, Kyriakos,Fanaropoulou, Georgia,Fanaropoulou, Nina M.,Kalin, Jack,Hutch, Meghan,Prescott, Brenton R.,Brush, Benjamin,Benjamin, Emelia J.,Shin, Min,Mian, Asim,Greer, David M.,Smirnakis, Stelios M.,Ong, Charlene J.

DOI: https://doi.org/10.1007/s12028-022-01513-3

2022-05-09

Neurocritical Care

Abstract:Abstraction of critical data from unstructured radiologic reports using natural language processing (NLP) is a powerful tool to automate the detection of important clinical features and enhance research efforts. We present a set of NLP approaches to identify critical findings in patients with acute ischemic stroke from radiology reports of computed tomography (CT) and magnetic resonance imaging (MRI). We trained machine learning classifiers to identify categorical outcomes of edema, midline shift (MLS), hemorrhagic transformation, and parenchymal hematoma, as well as rule-based systems (RBS) to identify intraventricular hemorrhage (IVH) and continuous MLS measurements within CT/MRI reports. Using a derivation cohort of 2289 reports from 550 individuals with acute middle cerebral artery territory ischemic strokes, we externally validated our models on reports from a separate institution as well as from patients with ischemic strokes in any vascular territory. In all data sets, a deep neural network with pretrained biomedical word embeddings (BioClinicalBERT) achieved the highest discrimination performance for binary prediction of edema (area under precision recall curve [AUPRC] > 0.94), MLS (AUPRC > 0.98), hemorrhagic conversion (AUPRC > 0.89), and parenchymal hematoma (AUPRC > 0.76). BioClinicalBERT outperformed lasso regression (p < 0.001) for all outcomes except parenchymal hematoma (p = 0.755). Tailored RBS for IVH and continuous MLS outperformed BioClinicalBERT (p < 0.001) and linear regression, respectively (p < 0.001). Our study demonstrates robust performance and external validity of a core NLP tool kit for identifying both categorical and continuous outcomes of ischemic stroke from unstructured radiographic text data. Medically tailored NLP methods have multiple important big data applications, including scalable electronic phenotyping, augmentation of clinical risk prediction models, and facilitation of automatic alert systems in the hospital setting.

clinical neurology,critical care medicine
Identification of patients with carotid stenosis using natural language processing

Xiao Wu,Yuzhe Zhao,Dragomir Radev,Ajay Malhotra

DOI: https://doi.org/10.1007/s00330-020-06721-z

Abstract:Purpose: The highly structured nature of medical reports makes them feasible for automated large-scale patient identification. This study aimed to develop a natural language processing (NLP) model to retrospectively retrieve patients with presence and history of carotid stenosis (CS) using their ultrasound reports. Methods: Ultrasound reports from our institution between January 2016 and December 2017 were selected. To process the texts, we developed a parser to divide the raw text into fields. For baseline method, we used bag-of-n-grams and term frequency inverse document frequency as the features and used linear classifiers. Logistic regression was performed as the baseline model. Convolution and recurrent neural networks (CNN; RNN) with attention mechanism were applied to the dataset to improve the classification accuracy. Results: We had 1220 ultrasound reports for training and 307 for testing, totaling to 1527 reports. For predicting history of CS, both CNN and RNN-attention models had a significantly higher specificity than logistic regression. In addition, RNN-attention also had a significantly higher F1 score and accuracy. For predicting presence of carotid stenosis, all models achieved above 93% accuracy. RNN-attention achieved a 95.4% accuracy, although the difference with logistic regression was not statistically significant. RNN-attention had a statistically significant higher specificity than logistic regression. Conclusions: We developed linear, CNN, and RNN models to predict history and presence of CS from ultrasound reports. We have demonstrated NLP to be an efficient, accurate approach for large-scale retrospective patient identification, with applications in long-term follow-up of patients and clinical research studies. Key points: • Natural language processing models using both linear classifiers and neural networks can achieve a good performance, with an overall accuracy above 90% in predicting history and presence of carotid stenosis. • Convolution and recurrent neural networks, especially with additional features including field awareness and attention mechanism, have superior performance than traditional linear classifiers. • NLP is shown to be an efficient approach for large-scale retrospective patient identification, with applications in long-term follow-up of patients and further clinical research studies.
Validation of a natural language processing algorithm using national reporting data to improve identification of anesthesia-related ADVerse evENTs: The "ADVENTURE" study

Paul M Mertes,Claire Morgand,Paul Barach,Geoffrey Jurkolow,Karen E Assmann,Edouard Dufetelle,Vincent Susplugas,Bilal Alauddin,Patrick Georges Yavordios,Jean Tourres,Jean-Marc Dumeix,Xavier Capdevila

DOI: https://doi.org/10.1016/j.accpm.2024.101390

Abstract:Background: Reporting and analysis of adverse events (AE) is associated with improved health system learning, quality outcomes, and patient safety. Manual text analysis is time-consuming, costly, and prone to human errors. We aimed to demonstrate the feasibility of novel machine learning and natural language processing (NLP) approaches for early predictions of adverse events and provide input to direct quality improvement and patient safety initiatives. Methods: We used machine learning to analyze 9559 continuously reported AE by clinicians and healthcare systems to the French National Health accreditor (HAS) between January 1, 2009, and December 31, 2020 . We validated the labeling of 135,000 unique de-identified AE reports and determined the associations between different system's root causes and patient consequences. The model was validated by independent expert anesthesiologists. Results: The machine learning (ML) and Artificial Intelligence (AI) model trained on 9559 AE datasets accurately categorized 8800 (88%) of reported AE. The three most frequent AE types were "difficult orotracheal intubation" (16.9% of AE reports), "medication error" (10.5%), and "post-induction hypotension" (6.9%). The accuracy of the AI model reached 70.9% sensitivity, 96.6% specificity for "difficult intubation", 43.2% sensitivity, and 98.9% specificity for "medication error." Conclusions: This unsupervised ML method provides an accurate, automated, AI-supported search algorithm that ranks and helps to understand complex risk patterns and has greater speed, precision, and clarity when compared to manual human data extraction. Machine learning and Natural language processing (NLP) models can effectively be used to process natural language AE reports and augment expert clinician input. This model can support clinical applications and methodological standards and used to better inform and enhance decision-making for improved risk management and patient safety. Trial registration: The study was approved by the ethics committee of the French Society of Anesthesiology (IRB 00010254-2020-20) and the CNIL (CNIL: 118 58 95) and the study was registered with ClinicalTrials.gov (NCT: NCT05185479).
Novel methodology for the evaluation of symptoms reported by patients with newly diagnosed atrial fibrillation: Application of natural language processing to electronic medical records data

Matthew R Reynolds,Thomas Jared Bunch,Benjamin A Steinberg,Christopher J Ronk,Hankyul Kim,Mattias Wieloch,Gregory Y H Lip

DOI: https://doi.org/10.1111/jce.15784

Abstract:Introduction: Understanding symptom patterns in atrial fibrillation (AF) can help in disease management. We report on the application of natural language processing (NLP) to electronic medical records (EMRs) to capture symptom reports in patients with newly diagnosed (incident) AF. Methods and results: This observational retrospective study included adult patients with an index diagnosis of incident AF during January 1, 2016 through June 30, 2018, in the Optum datasets. The baseline and follow-up periods were 1 year before/after the index date, respectively. The primary objective was identification of the following predefined symptom reports: dyspnea or shortness of breath; syncope, presyncope, lightheadedness, or dizziness; chest pain; fatigue; and palpitations. In an exploratory analysis, the incidence rates of symptom reports and cardiovascular hospitalization were assessed in propensity-matched patient cohorts with incident AF receiving first-line dronedarone or sotalol. Among 30 447 patients with an index AF diagnosis, the NLP algorithm identified at least 1 predefined symptom in 9734 (31.9%) patients. The incidence rate of symptom reports was highest at 0-3 months post-diagnosis and lower at >3-6 and >6-12 months (pre-defined timepoints). Across all time periods, the most common symptoms were dyspnea or shortness of breath, followed by syncope, presyncope, lightheadedness, or dizziness. Similar temporal patterns of symptom reports were observed among patients with prescriptions for dronedarone or sotalol as first-line treatment. Conclusion: This study illustrates that NLP can be applied to EMR data to characterize symptom reports in patients with incident AF, and the potential for these methods to inform comparative effectiveness.
Automated medical chart review for breast cancer outcomes research: a novel natural language processing extraction system

Yifu Chen,Lucy Hao,Vito Z Zou,Zsuzsanna Hollander,Raymond T Ng,Kathryn V Isaac

DOI: https://doi.org/10.1186/s12874-022-01583-z

2022-05-12

Abstract:Background: Manually extracted data points from health records are collated on an institutional, provincial, and national level to facilitate clinical research. However, the labour-intensive clinical chart review process puts an increasing burden on healthcare system budgets. Therefore, an automated information extraction system is needed to ensure the timeliness and scalability of research data. Methods: We used a dataset of 100 synoptic operative and 100 pathology reports, evenly split into 50 reports in training and test sets for each report type. The training set guided our development of a Natural Language Processing (NLP) extraction pipeline system, which accepts scanned images of operative and pathology reports. The system uses a combination of rule-based and transfer learning methods to extract numeric encodings from text. We also developed visualization tools to compare the manual and automated extractions. The code for this paper was made available on GitHub. Results: A test set of 50 operative and 50 pathology reports were used to evaluate the extraction accuracies of the NLP pipeline. Gold standard, defined as manual extraction by expert reviewers, yielded accuracies of 90.5% for operative reports and 96.0% for pathology reports, while the NLP system achieved overall 91.9% (operative) and 95.4% (pathology) accuracy. The pipeline successfully extracted outcomes data pertinent to breast cancer tumor characteristics (e.g. presence of invasive carcinoma, size, histologic type), prognostic factors (e.g. number of lymph nodes with micro-metastases and macro-metastases, pathologic stage), and treatment-related variables (e.g. margins, neo-adjuvant treatment, surgical indication) with high accuracy. Out of the 48 variables across operative and pathology codebooks, NLP yielded 43 variables with F-scores of at least 0.90; in comparison, a trained human annotator yielded 44 variables with F-scores of at least 0.90. Conclusions: The NLP system achieves near-human-level accuracy in both operative and pathology reports using a minimal curated dataset. This system uniquely provides a robust solution for transparent, adaptable, and scalable automation of data extraction from patient health records. It may serve to advance breast cancer clinical research by facilitating collection of vast amounts of valuable health data at a population level.
Automatic Extraction of Imaging Observation and Assessment Categories from Breast Magnetic Resonance Imaging Reports with Natural Language Processing

Yi Liu,Li-Na Zhu,Qing Liu,Chao Han,Xiao-Dong Zhang,Xiao-Ying Wang

DOI: https://doi.org/10.1097/cm9.0000000000000301

IF: 6.133

2019-01-01

Chinese Medical Journal

Abstract:Background: Structured reports are not widely used and thus most reports exist in the form of free text. The process of data extraction by experts is time-consuming and error-prone, whereas data extraction by natural language processing (NIP) is a potential solution that could improve diagnosis efficiency and accuracy. The purpose of this study was to evaluate an NLP program that determines American College of Radiology Breast Imaging Reporting and Data System (BI-RADS) descriptors and final assessment categories from breast magnetic resonance imaging (MRI) reports. Methods: This cross-sectional study involved 2330 breast MRI reports in the electronic medical record from 2009 to 2017. We used 1635 reports for the creation of a revised BI-RADS MRI lexicon and synonyms lists as well as the iterative development of an NLP system. The remaining 695 reports that were not used for developing the system were used as an independent test set for the final evaluation of the NLP system. The recall and precision of an NLP algorithm to detect the revised BI-RADS MRI descriptors and BI-RADS categories from the free-text reports were evaluated against a standard reference of manual human review. Results: There was a high level of agreement between two manual reviewers, with a kappa value of 0.95. For all breast imaging reports, the NLP algorithm demonstrated a recall of 78.5% and a precision of 86.1% for correct identification of the revised BI-RADS MRI descriptors and the BI-RADS categories. NLP generated the total results in <1 s, whereas the manual reviewers averaged 3.38 and 3.23 min per report, respectively. Conclusions: The NLP algorithm demonstrates high recall and precision for information extraction from free-text reports. This approach will help to narrow the gap between unstructured report text and structured data, which is needed in decision support and other applications.
Ultrasound investigation prior to organ donation.

E. M. Lang,T. Lang,D. Henne-Bruns,B. Kremer

IF: 1.014

1990-04-01

Transplantation Proceedings

Abstract:
Development and validation of a novel AI framework using NLP with LLM integration for relevant clinical data extraction through automated chart review

Mert Marcel Dagli,Yohannes Ghenbot,Hasan S. Ahmad,Daksh Chauhan,Ryan Turlip,Patrick Wang,William C. Welch,Ali K. Ozturk,Jang W Yoon

DOI: https://doi.org/10.1038/s41598-024-77535-y

IF: 4.6

2024-11-07

Scientific Reports

Abstract:The accurate extraction of surgical data from electronic health records (EHRs), particularly operative notes through manual chart review (MCR), is complex, crucial, and time-intensive, limited by human error due to fatigue and the level of training. This study aimed to develop and validate a novel Natural Language Processing (NLP) algorithm integrated with a Large Language Model (LLM; GPT4-Turbo) to automate the extraction of spinal surgery data from EHRs. The algorithm employed a two-stage approach. Initially, a rule-based NLP framework reviewed and classified candidate segments from the text, preserving their reference segments. These segments were then verified in the second stage through the LLM. The primary outcomes of this study were the accurate extraction of surgical data, including the type of surgery, levels operated, number of disks removed, and presence of intraoperative incidental durotomies. Secondary objectives explored time efficiency, tokenization lengths, and costs. The performance of the algorithm was assessed across two validation databases, analyzing metrics such as accuracy, sensitivity, discrimination, F1-score, and precision, with 95% confidence intervals calculated using percentile-based bootstrapping. The NLP + LLM algorithm markedly outperformed all performance metrics, demonstrating significant improvements in time and cost efficiency. These results suggest the potential for widespread adoption of this technology.

multidisciplinary sciences
Development and Evaluation of a Natural Language Processing System for Curating a Trans-Thoracic Echocardiogram (TTE) Database

Tim Dong,Nicholas Sunderland,Angus Nightingale,Daniel P Fudulu,Jeremy Chan,Ben Zhai,Alberto Freitas,Massimo Caputo,Arnaldo Dimagli,Stuart Mires,Mike Wyatt,Umberto Benedetto,Gianni D Angelini

DOI: https://doi.org/10.3390/bioengineering10111307

2023-11-10

Abstract:Background: Although electronic health records (EHR) provide useful insights into disease patterns and patient treatment optimisation, their reliance on unstructured data presents a difficulty. Echocardiography reports, which provide extensive pathology information for cardiovascular patients, are particularly challenging to extract and analyse, because of their narrative structure. Although natural language processing (NLP) has been utilised successfully in a variety of medical fields, it is not commonly used in echocardiography analysis. Objectives: To develop an NLP-based approach for extracting and categorising data from echocardiography reports by accurately converting continuous (e.g., LVOT VTI, AV VTI and TR Vmax) and discrete (e.g., regurgitation severity) outcomes in a semi-structured narrative format into a structured and categorised format, allowing for future research or clinical use. Methods: 135,062 Trans-Thoracic Echocardiogram (TTE) reports were derived from 146967 baseline echocardiogram reports and split into three cohorts: Training and Validation (n = 1075), Test Dataset (n = 98) and Application Dataset (n = 133,889). The NLP system was developed and was iteratively refined using medical expert knowledge. The system was used to curate a moderate-fidelity database from extractions of 133,889 reports. A hold-out validation set of 98 reports was blindly annotated and extracted by two clinicians for comparison with the NLP extraction. Agreement, discrimination, accuracy and calibration of outcome measure extractions were evaluated. Results: Continuous outcomes including LVOT VTI, AV VTI and TR Vmax exhibited perfect inter-rater reliability using intra-class correlation scores (ICC = 1.00, p < 0.05) alongside high R2 values, demonstrating an ideal alignment between the NLP system and clinicians. A good level (ICC = 0.75-0.9, p < 0.05) of inter-rater reliability was observed for outcomes such as LVOT Diam, Lateral MAPSE, Peak E Velocity, Lateral E' Velocity, PV Vmax, Sinuses of Valsalva and Ascending Aorta diameters. Furthermore, the accuracy rate for discrete outcome measures was 91.38% in the confusion matrix analysis, indicating effective performance. Conclusions: The NLP-based technique yielded good results when it came to extracting and categorising data from echocardiography reports. The system demonstrated a high degree of agreement and concordance with clinician extractions. This study contributes to the effective use of semi-structured data by providing a useful tool for converting semi-structured text to a structured echo report that can be used for data management. Additional validation and implementation in healthcare settings can improve data availability and support research and clinical decision-making.

Leukemia among uranium miners--late effects of exposure to uranium dust?

Large-scale Identification of Patients with Cerebral Aneurysms Using Natural Language Processing

Natural Language Processing to Identify Abnormal Breast, Lung, and Cervical Cancer Screening Test Results from Unstructured Reports to Support Timely Follow-up.

Automating Stroke Data Extraction From Free-Text Radiology Reports Using Natural Language Processing: Instrument Validation Study

The effect of associative strength on priming in the cerebral hemispheres

Developing a natural language processing system using transformer-based models for adverse drug event detection in electronic health records

Implementing engineering education on the WWW: 3 case studies

Accurately Identifying Cerebroarterial Stenosis from Angiography Reports Using Natural Language Processing Approaches

[Concerning the relationship between alveolar hypocapnia and bronchial obstruction (author's transl)].

A novel heterocyclic compound: catena-poly[[[diaquasodium(I)]-di-mu-aqua] hemi(1,5-dihydroxy-4,8,9-trioxa-2,6-diazabicyclo[3.3.1]nona-2,6-diene-3,7-diolate)].

Reshaping Free-Text Radiology Notes Into Structured Reports With Generative Transformers

Natural language processing for automated breast cancer recurrence detection and classification in computed tomography reports.

Natural Language Processing of Radiology Reports to Detect Complications of Ischemic Stroke

Identification of patients with carotid stenosis using natural language processing

Validation of a natural language processing algorithm using national reporting data to improve identification of anesthesia-related ADVerse evENTs: The "ADVENTURE" study

Novel methodology for the evaluation of symptoms reported by patients with newly diagnosed atrial fibrillation: Application of natural language processing to electronic medical records data

Automated medical chart review for breast cancer outcomes research: a novel natural language processing extraction system

Automatic Extraction of Imaging Observation and Assessment Categories from Breast Magnetic Resonance Imaging Reports with Natural Language Processing

Ultrasound investigation prior to organ donation.

Development and validation of a novel AI framework using NLP with LLM integration for relevant clinical data extraction through automated chart review

Development and Evaluation of a Natural Language Processing System for Curating a Trans-Thoracic Echocardiogram (TTE) Database