Preliminary toxicity assessment of water after treatment with UV-irradiation and UVC/H2O2.

A. Parkinson,M. J. Barry,F. Roddick,M. Hobday

DOI: https://doi.org/10.1016/S0043-1354(01)00096-3

IF: 12.8

2001-10-01

Water Research

Abstract:

What problem does this paper attempt to address?

MADEx: A System for Detecting Medications, Adverse Drug Events, and Their Relations from Clinical Notes

Xi Yang,Jiang Bian,Yan Gong,William R. Hogan,Yonghui Wu

DOI: https://doi.org/10.1007/s40264-018-0761-0

2019-01-01

Drug Safety

Abstract:Introduction Early detection of adverse drug events (ADEs) from electronic health records is an important, challenging task to support pharmacovigilance and drug safety surveillance. A well-known challenge to use clinical text for detection of ADEs is that much of the detailed information is documented in a narrative manner. Clinical natural language processing (NLP) is the key technology to extract information from unstructured clinical text. Objective We present a machine learning-based clinical NLP system—MADEx—for detecting medications, ADEs, and their relations from clinical notes. Methods We developed a recurrent neural network (RNN) model using a long short-term memory (LSTM) strategy for clinical name entity recognition (NER) and compared it with baseline conditional random fields (CRFs). We also developed a modified training strategy for the RNN, which outperformed the widely used early stop strategy. For relation extraction, we compared support vector machines (SVMs) and random forests on single-sentence relations and cross-sentence relations. In addition, we developed an integrated pipeline to extract entities and relations together by combining RNNs and SVMs. Results MADEx achieved the top-three best performances (F1 score of 0.8233) for clinical NER in the 2018 Medication and Adverse Drug Events (MADE1.0) challenge. The post-challenge evaluation showed that the relation extraction module and integrated pipeline (identify entity and relation together) of MADEx are comparable with the best systems developed in this challenge. Conclusion This study demonstrated the efficiency of deep learning methods for automatic extraction of medications, ADEs, and their relations from clinical text to support pharmacovigilance and drug safety surveillance.
DeepTag: inferring all-cause diagnoses from clinical notes in under-resourced medical domain

Allen Nie,Ashley Zehnder,Rodney L. Page,Arturo L. Pineda,Manuel A. Rivas,Carlos D. Bustamante,James Zou

DOI: https://doi.org/10.48550/arXiv.1806.10722

2018-06-28

Computation and Language

Abstract:Large scale veterinary clinical records can become a powerful resource for patient care and research. However, clinicians lack the time and resource to annotate patient records with standard medical diagnostic codes and most veterinary visits are captured in free text notes. The lack of standard coding makes it challenging to use the clinical data to improve patient care. It is also a major impediment to cross-species translational research, which relies on the ability to accurately identify patient cohorts with specific diagnostic criteria in humans and animals. In order to reduce the coding burden for veterinary clinical practice and aid translational research, we have developed a deep learning algorithm, DeepTag, which automatically infers diagnostic codes from veterinary free text notes. DeepTag is trained on a newly curated dataset of 112,558 veterinary notes manually annotated by experts. DeepTag extends multi-task LSTM with an improved hierarchical objective that captures the semantic structures between diseases. To foster human-machine collaboration, DeepTag also learns to abstain in examples when it is uncertain and defers them to human experts, resulting in improved performance. DeepTag accurately infers disease codes from free text even in challenging cross-hospital settings where the text comes from different clinical settings than the ones used for training. It enables automated disease annotation across a broad range of clinical diagnoses with minimal pre-processing. The technical framework in this work can be applied in other medical domains that currently lack medical coding resources.
Automatic extraction of social determinants of health from medical notes of chronic lower back pain patients

Dmytro S Lituiev,Benjamin Lacar,Sang Pak,Peter L Abramowitsch,Emilia H De Marchis,Thomas A Peterson

DOI: https://doi.org/10.1093/jamia/ocad054

2023-07-19

Abstract:Objective: We applied natural language processing and inference methods to extract social determinants of health (SDoH) information from clinical notes of patients with chronic low back pain (cLBP) to enhance future analyses of the associations between SDoH disparities and cLBP outcomes. Materials and methods: Clinical notes for patients with cLBP were annotated for 7 SDoH domains, as well as depression, anxiety, and pain scores, resulting in 626 notes with at least one annotated entity for 364 patients. We used a 2-tier taxonomy with these 10 first-level classes (domains) and 52 second-level classes. We developed and validated named entity recognition (NER) systems based on both rule-based and machine learning approaches and validated an entailment model. Results: Annotators achieved a high interrater agreement (Cohen's kappa of 95.3% at document level). A rule-based system (cTAKES), RoBERTa NER, and a hybrid model (combining rules and logistic regression) achieved performance of F1 = 47.1%, 84.4%, and 80.3%, respectively, for first-level classes. Discussion: While the hybrid model had a lower F1 performance, it matched or outperformed RoBERTa NER model in terms of recall and had lower computational requirements. Applying an untuned RoBERTa entailment model, we detected many challenging wordings missed by NER systems. Still, the entailment model may be sensitive to hypothesis wording. Conclusion: This study developed a corpus of annotated clinical notes covering a broad spectrum of SDoH classes. This corpus provides a basis for training machine learning models and serves as a benchmark for predictive models for NER for SDoH and knowledge extraction from clinical texts.
Accelerating Clinical Text Annotation in Underrepresented Languages: A Case Study on Text De-Identification

He A Xu,Valentin Loftsson,Bogdan Kulynych,Bayrem Kaabachi,Jean Louis Raisaro

DOI: https://doi.org/10.3233/SHTI240546

2024-08-22

Abstract:Clinical notes contain valuable information for research and monitoring quality of care. Named Entity Recognition (NER) is the process for identifying relevant pieces of information such as diagnoses, treatments, side effects, etc., and bring them to a more structured form. Although recent advancements in deep learning have facilitated automated recognition, particularly in English, NER can still be challenging due to limited specialized training data. This exacerbated in hospital settings where annotations are costly to obtain without appropriate incentives and often dependent on local specificities. In this work, we study whether this annotation process can be effectively accelerated by combining two practical strategies. First, we convert usually passive annotation tasks into a proactive contest to motivate human annotators in performing a task often considered tedious and time-consuming. Second, we provide pre-annotations for the participants to evaluate how recall and precision of the pre-annotations can boost or deteriorate annotation performance. We applied both strategies to a text de-identification task on French clinical notes and discharge summaries at a large Swiss university hospital. Our results show that proactive contest and average quality pre-annotations can significantly speed up annotation time and increase annotation quality, enabling us to develop a text de-identification model for French clinical notes with high performance (F1 score 0.94).
The Medical Scribe: Corpus Development and Model Performance Analyses

Izhak Shafran,Nan Du,Linh Tran,Amanda Perry,Lauren Keyes,Mark Knichel,Ashley Domin,Lei Huang,Yuhui Chen,Gang Li,Mingqiu Wang,Laurent El Shafey,Hagen Soltau,Justin S. Paul

DOI: https://doi.org/10.48550/arXiv.2003.11531

2020-03-12

Abstract:There is a growing interest in creating tools to assist in clinical note generation using the audio of provider-patient encounters. Motivated by this goal and with the help of providers and medical scribes, we developed an annotation scheme to extract relevant clinical concepts. We used this annotation scheme to label a corpus of about 6k clinical encounters. This was used to train a state-of-the-art tagging model. We report ontologies, labeling results, model performances, and detailed analyses of the results. Our results show that the entities related to medications can be extracted with a relatively high accuracy of 0.90 F-score, followed by symptoms at 0.72 F-score, and conditions at 0.57 F-score. In our task, we not only identify where the symptoms are mentioned but also map them to canonical forms as they appear in the clinical notes. Of the different types of errors, in about 19-38% of the cases, we find that the model output was correct, and about 17-32% of the errors do not impact the clinical note. Taken together, the models developed in this work are more useful than the F-scores reflect, making it a promising approach for practical applications.

Computation and Language
FasTag: Automatic text classification of unstructured medical narratives

Guhan Ram Venkataraman,Arturo Lopez Pineda,Oliver J. Bear Don’t Walk IV,Ashley M. Zehnder,Sandeep Ayyar,Rodney L. Page,Carlos D. Bustamante,Manuel A. Rivas

DOI: https://doi.org/10.1371/journal.pone.0234647

IF: 3.7

2020-06-22

PLoS ONE

Abstract:Unstructured clinical narratives are continuously being recorded as part of delivery of care in electronic health records, and dedicated tagging staff spend considerable effort manually assigning clinical codes for billing purposes. Despite these efforts, however, label availability and accuracy are both suboptimal. In this retrospective study, we aimed to automate the assignment of top-level International Classification of Diseases version 9 (ICD-9) codes to clinical records from human and veterinary data stores using minimal manual labor and feature curation. Automating top-level annotations could in turn enable rapid cohort identification, especially in a veterinary setting. To this end, we trained long short-term memory (LSTM) recurrent neural networks (RNNs) on 52,722 human and 89,591 veterinary records. We investigated the accuracy of both separate-domain and combined-domain models and probed model portability. We established relevant baseline classification performances by training Decision Trees (DT) and Random Forests (RF). We also investigated whether transforming the data using MetaMap Lite, a clinical natural language processing tool, affected classification performance. We showed that the LSTM-RNNs accurately classify veterinary and human text narratives into top-level categories with an average weighted macro F1 score of 0.74 and 0.68 respectively. In the "neoplasia" category, the model trained on veterinary data had a high validation accuracy in veterinary data and moderate accuracy in human data, with F1 scores of 0.91 and 0.70 respectively. Our LSTM method scored slightly higher than that of the DT and RF models. The use of LSTM-RNN models represents a scalable structure that could prove useful in cohort identification for comparative oncology studies. Digitization of human and veterinary health information will continue to be a reality, particularly in the form of unstructured narratives. Our approach is a step forward for these two domains to learn from and inform one another.

multidisciplinary sciences
medExtractR: A targeted, customizable approach to medication extraction from electronic health records

Hannah L Weeks,Cole Beck,Elizabeth McNeer,Michael L Williams,Cosmin A Bejan,Joshua C Denny,Leena Choi

DOI: https://doi.org/10.1093/jamia/ocz207

2020-01-16

Journal of the American Medical Informatics Association

Abstract:Abstract Objective We developed medExtractR, a natural language processing system to extract medication information from clinical notes. Using a targeted approach, medExtractR focuses on individual drugs to facilitate creation of medication-specific research datasets from electronic health records. Materials and Methods Written using the R programming language, medExtractR combines lexicon dictionaries and regular expressions to identify relevant medication entities (eg, drug name, strength, frequency). MedExtractR was developed on notes from Vanderbilt University Medical Center, using medications prescribed with varying complexity. We evaluated medExtractR and compared it with 3 existing systems: MedEx, MedXN, and CLAMP (Clinical Language Annotation, Modeling, and Processing). We also demonstrated how medExtractR can be easily tuned for better performance on an outside dataset using the MIMIC-III (Medical Information Mart for Intensive Care III) database. Results On 50 test notes per development drug and 110 test notes for an additional drug, medExtractR achieved high overall performance (F-measures >0.95), exceeding performance of the 3 existing systems across all drugs. MedExtractR achieved the highest F-measure for each individual entity, except drug name and dose amount for allopurinol. With tuning and customization, medExtractR achieved F-measures >0.90 in the MIMIC-III dataset. Discussion The medExtractR system successfully extracted entities for medications of interest. High performance in entity-level extraction provides a strong foundation for developing robust research datasets for pharmacological research. When working with new datasets, medExtractR should be tuned on a small sample of notes before being broadly applied. Conclusions The medExtractR system achieved high performance extracting specific medications from clinical text, leading to higher-quality research datasets for drug-related studies than some existing general-purpose medication extraction tools.

information science & library science,computer science, information systems, interdisciplinary applications,health care sciences & services,medical informatics
Standard NER Tagging Scheme for Big Data Healthcare Analytics Built on Unified Medical Corpora

Sarah Shafqat,Hammad Majeed,Qaisar Javaid,Hafiz Farooq Ahmad

DOI: https://doi.org/10.37965/jait.2022.0127

2022-08-22

Journal of Artificial Intelligence and Technology

Abstract:The motivation for this research comes from the gap found in discovering the common ground for medical context learning through analytics for different purposes of diagnosing, recommending, prescribing or treating patients for uniform phenotype features from patients’ profile. Authors of this paper while searching for possible solutions for medical context learning found that unified corpora tagged with medical nomenclature was missing to train the analytics for medical context learning. Therefore, here we demonstrated a mechanism to come up with uniform NER (Named Entity Recognition) tagged medical corpora that is fed with 14407 endocrine patients’ dataset in CSV format diagnosed with DM and comorbidity diseases. The other corpus is of ICD-10-CM coding scheme in text format taken from www.icd10data.com. ICD-10-CM corpus is to be tagged for understanding the medical context with uniformity for which we are conducting different experiments using common NLP techniques and frameworks like; TensorFlow, Keras, LSTM, and Bi-LSTM. In our preliminary experiments albeit label sets in form of (instance, label) pair were tagged with Sequential() model formed on TensorFlow.Keras and Bi-LSTM NLP algorithms. The maximum accuracy achieved for model validation was 0.8846.

English Else
Development and validation of a novel AI framework using NLP with LLM integration for relevant clinical data extraction through automated chart review

Mert Marcel Dagli,Yohannes Ghenbot,Hasan S. Ahmad,Daksh Chauhan,Ryan Turlip,Patrick Wang,William C. Welch,Ali K. Ozturk,Jang W Yoon

DOI: https://doi.org/10.1038/s41598-024-77535-y

IF: 4.6

2024-11-07

Scientific Reports

Abstract:The accurate extraction of surgical data from electronic health records (EHRs), particularly operative notes through manual chart review (MCR), is complex, crucial, and time-intensive, limited by human error due to fatigue and the level of training. This study aimed to develop and validate a novel Natural Language Processing (NLP) algorithm integrated with a Large Language Model (LLM; GPT4-Turbo) to automate the extraction of spinal surgery data from EHRs. The algorithm employed a two-stage approach. Initially, a rule-based NLP framework reviewed and classified candidate segments from the text, preserving their reference segments. These segments were then verified in the second stage through the LLM. The primary outcomes of this study were the accurate extraction of surgical data, including the type of surgery, levels operated, number of disks removed, and presence of intraoperative incidental durotomies. Secondary objectives explored time efficiency, tokenization lengths, and costs. The performance of the algorithm was assessed across two validation databases, analyzing metrics such as accuracy, sensitivity, discrimination, F1-score, and precision, with 95% confidence intervals calculated using percentile-based bootstrapping. The NLP + LLM algorithm markedly outperformed all performance metrics, demonstrating significant improvements in time and cost efficiency. These results suggest the potential for widespread adoption of this technology.

multidisciplinary sciences
Changes in fat-soluble vitamin levels after gastrectomy for gastric cancer

Y. Rino,T. Oshima,T. Yoshikawa

DOI: https://doi.org/10.1007/s00595-016-1341-5

2017-02-01

Abstract:
[Principles of surgical treatment of diabetic neuropathic osteoarthropathy].

S. Kessler,T. Kalteis,A. Botzlar

Der Internist

Abstract:
CACER: Clinical concept Annotations for Cancer Events and Relations

Yujuan Velvin Fu,Giridhar Kaushik Ramachandran,Ahmad Halwani,Bridget T McInnes,Fei Xia,Kevin Lybarger,Meliha Yetisgen,Özlem Uzuner

DOI: https://doi.org/10.1093/jamia/ocae231

2024-09-03

Abstract:Objective: Clinical notes contain unstructured representations of patient histories, including the relationships between medical problems and prescription drugs. To investigate the relationship between cancer drugs and their associated symptom burden, we extract structured, semantic representations of medical problem and drug information from the clinical narratives of oncology notes. Materials and methods: We present Clinical concept Annotations for Cancer Events and Relations (CACER), a novel corpus with fine-grained annotations for over 48 000 medical problems and drug events and 10 000 drug-problem and problem-problem relations. Leveraging CACER, we develop and evaluate transformer-based information extraction models such as Bidirectional Encoder Representations from Transformers (BERT), Fine-tuned Language Net Text-To-Text Transfer Transformer (Flan-T5), Large Language Model Meta AI (Llama3), and Generative Pre-trained Transformers-4 (GPT-4) using fine-tuning and in-context learning (ICL). Results: In event extraction, the fine-tuned BERT and Llama3 models achieved the highest performance at 88.2-88.0 F1, which is comparable to the inter-annotator agreement (IAA) of 88.4 F1. In relation extraction, the fine-tuned BERT, Flan-T5, and Llama3 achieved the highest performance at 61.8-65.3 F1. GPT-4 with ICL achieved the worst performance across both tasks. Discussion: The fine-tuned models significantly outperformed GPT-4 in ICL, highlighting the importance of annotated training data and model optimization. Furthermore, the BERT models performed similarly to Llama3. For our task, large language models offer no performance advantage over the smaller BERT models. Conclusions: We introduce CACER, a novel corpus with fine-grained annotations for medical problems, drugs, and their relationships in clinical narratives of oncology notes. State-of-the-art transformer models achieved performance comparable to IAA for several extraction tasks.
Immunodeficiency associated with recurrent infections and an isolated in vivo inability to respond to bacterial polysaccharides.

F. Gigliotti,H. Herrod,D. Kalwinsky,R. Insel

DOI: https://doi.org/10.1097/00006454-198806000-00010

1988-06-01

The Pediatric Infectious Disease Journal

Abstract:
Language Models and Retrieval Augmented Generation for Automated Structured Data Extraction from Diagnostic Reports

Mohamed Sobhi Jabal,Pranav Warman,Jikai Zhang,Kartikeye Gupta,Ayush Jain,Maciej Mazurowski,Walter Wiggins,Kirti Magudia,Evan Calabrese

2024-09-18

Abstract:Purpose: To develop and evaluate an automated system for extracting structured clinical information from unstructured radiology and pathology reports using open-weights large language models (LMs) and retrieval augmented generation (RAG), and to assess the effects of model configuration variables on extraction performance. Methods and Materials: The study utilized two datasets: 7,294 radiology reports annotated for Brain Tumor Reporting and Data System (BT-RADS) scores and 2,154 pathology reports annotated for isocitrate dehydrogenase (IDH) mutation status. An automated pipeline was developed to benchmark the performance of various LMs and RAG configurations. The impact of model size, quantization, prompting strategies, output formatting, and inference parameters was systematically evaluated. Results: The best performing models achieved over 98% accuracy in extracting BT-RADS scores from radiology reports and over 90% for IDH mutation status extraction from pathology reports. The top model being medical fine-tuned llama3. Larger, newer, and domain fine-tuned models consistently outperformed older and smaller models. Model quantization had minimal impact on performance. Few-shot prompting significantly improved accuracy. RAG improved performance for complex pathology reports but not for shorter radiology reports. Conclusions: Open LMs demonstrate significant potential for automated extraction of structured clinical data from unstructured clinical reports with local privacy-preserving application. Careful model selection, prompt engineering, and semi-automated optimization using annotated data are critical for optimal performance. These approaches could be reliable enough for practical use in research workflows, highlighting the potential for human-machine collaboration in healthcare data extraction.

Computation and Language,Information Retrieval,Machine Learning
Evaluation of a Data Annotation Platform for Large, Time-Series Datasets in Intensive Care: Mixed Methods Study

Marceli Wac,Raul Santos-Rodriguez,Chris McWilliams,Christopher Bourdeaux

2024-10-22

Abstract:Intensive Care Units are complex, data-rich environments where critically ill patients are treated using variety of clinical equipment. The data collected using this equipment can be used clinical staff to gain insight into the condition of the patients and provide adequate treatment, but it also provides ample opportunity for applications in machine learning and data science. While this data can frequently be used directly, complex problems may require additional annotations to provide context and meaning before it could be used to train the machine learning models. Annotating time-series datasets in clinical setting is a complex problem due to a large volume and complexity of the data, time-consuming nature of the process and the fact that clinicians' time is in both high demand and short supply. In this study, we present an evaluation of a bespoke tool designed to annotate large, clinical time-series datasets with staff from intensive care units. The software incorporates two modes for annotation: by annotating individual admissions and by generating rulesets which are applied to the entire dataset. Our study was split into two stages focusing on individual and semi-automated annotation and included 28 annotators across both stages who utilised 50 clinical parameters to guide their annotations. We experienced significant challenges in recruitment and engagement of the participants in the annotation activities and developed interventions which improved the participation over the course of the study. During the semi-automated annotation, we observed preferences for different parameter types (measured vs. observed), as well as relative agreement of participants across shared admissions to the decision-tree model trained using their rulesets.

Human-Computer Interaction
Extraction of Medication and Temporal Relation from Clinical Text using Neural Language Models

Hangyu Tu,Lifeng Han,Goran Nenadic

2023-10-09

Abstract:Clinical texts, represented in electronic medical records (EMRs), contain rich medical information and are essential for disease prediction, personalised information recommendation, clinical decision support, and medication pattern mining and measurement. Relation extractions between medication mentions and temporal information can further help clinicians better understand the patients' treatment history. To evaluate the performances of deep learning (DL) and large language models (LLMs) in medication extraction and temporal relations classification, we carry out an empirical investigation of \textbf{MedTem} project using several advanced learning structures including BiLSTM-CRF and CNN-BiLSTM for a clinical domain named entity recognition (NER), and BERT-CNN for temporal relation extraction (RE), in addition to the exploration of different word embedding techniques. Furthermore, we also designed a set of post-processing roles to generate structured output on medications and the temporal relation. Our experiments show that CNN-BiLSTM slightly wins the BiLSTM-CRF model on the i2b2-2009 clinical NER task yielding 75.67, 77.83, and 78.17 for precision, recall, and F1 scores using Macro Average. BERT-CNN model also produced reasonable evaluation scores 64.48, 67.17, and 65.03 for P/R/F1 using Macro Avg on the temporal relation extraction test set from i2b2-2012 challenges. Code and Tools from MedTem will be hosted at \url{<a class="link-external link-https" href="https://github.com/HECTA-UoM/MedTem" rel="external noopener nofollow">this https URL</a>}

Computation and Language,Artificial Intelligence
Med7: a transferable clinical natural language processing model for electronic health records

Andrey Kormilitzin,Nemanja Vaci,Qiang Liu,Alejo Nevado-Holgado

DOI: https://doi.org/10.48550/arXiv.2003.01271

2020-04-24

Abstract:The field of clinical natural language processing has been advanced significantly since the introduction of deep learning models. The self-supervised representation learning and the transfer learning paradigm became the methods of choice in many natural language processing application, in particular in the settings with the dearth of high quality manually annotated data. Electronic health record systems are ubiquitous and the majority of patients' data are now being collected electronically and in particular in the form of free text. Identification of medical concepts and information extraction is a challenging task, yet important ingredient for parsing unstructured data into structured and tabulated format for downstream analytical tasks. In this work we introduced a named-entity recognition model for clinical natural language processing. The model is trained to recognise seven categories: drug names, route, frequency, dosage, strength, form, duration. The model was first self-supervisedly pre-trained by predicting the next word, using a collection of 2 million free-text patients' records from MIMIC-III corpora and then fine-tuned on the named-entity recognition task. The model achieved a lenient (strict) micro-averaged F1 score of 0.957 (0.893) across all seven categories. Additionally, we evaluated the transferability of the developed model using the data from the Intensive Care Unit in the US to secondary care mental health records (CRIS) in the UK. A direct application of the trained NER model to CRIS data resulted in reduced performance of F1=0.762, however after fine-tuning on a small sample from CRIS, the model achieved a reasonable performance of F1=0.944. This demonstrated that despite a close similarity between the data sets and the NER tasks, it is essential to fine-tune on the target domain data in order to achieve more accurate results.

Computation and Language,Information Retrieval,Machine Learning
Randomized clinical trial of duct‐to‐mucosa versus invagination pancreaticojejunostomy after pancreatoduodenectomy

Y. Senda,Y. Shimizu,S. Natsume,S. Ito,K. Komori,T. Abe,K. Matsuo,T. Sano

DOI: https://doi.org/10.1002/bjs.10727

2018-01-01

Abstract:The postoperative pancreatic fistula (POPF) rate for duct‐to‐mucosa and invagination anastomosis after pancreatoduodenectomy is still debated. The aim of this RCT was to investigate the POPF rate for duct‐to‐mucosa versus invagination pancreaticojejunostomy.
Extracting periodontitis diagnosis in clinical notes with RoBERTa and regular expression

Yao-Shun Chuang,Chun-Teh Lee,Ryan Brandon,Trung Duong Tran,Oluwabunmi Tokede,Muhammad F. Walji,Xiaoqian Jiang

2023-11-18

Abstract:This study aimed to utilize text processing and natural language processing (NLP) models to mine clinical notes for the diagnosis of periodontitis and to evaluate the performance of a named entity recognition (NER) model on different regular expression (RE) methods. Two complexity levels of RE methods were used to extract and generate the training data. The SpaCy package and RoBERTa transformer models were used to build the NER model and evaluate its performance with the manual-labeled gold standards. The comparison of the RE methods with the gold standard showed that as the complexity increased in the RE algorithms, the F1 score increased from 0.3-0.4 to around 0.9. The NER models demonstrated excellent predictions, with the simple RE method showing 0.84-0.92 in the evaluation metrics, and the advanced and combined RE method demonstrating 0.95-0.99 in the evaluation. This study provided an example of the benefit of combining NER methods and NLP models in extracting target information from free-text to structured data and fulfilling the need for missing diagnoses from unstructured notes.

Artificial Intelligence

Preliminary toxicity assessment of water after treatment with UV-irradiation and UVC/H2O2.

MADEx: A System for Detecting Medications, Adverse Drug Events, and Their Relations from Clinical Notes

DeepTag: inferring all-cause diagnoses from clinical notes in under-resourced medical domain

Automatic extraction of social determinants of health from medical notes of chronic lower back pain patients

Accelerating Clinical Text Annotation in Underrepresented Languages: A Case Study on Text De-Identification

The Medical Scribe: Corpus Development and Model Performance Analyses

FasTag: Automatic text classification of unstructured medical narratives

medExtractR: A targeted, customizable approach to medication extraction from electronic health records

Standard NER Tagging Scheme for Big Data Healthcare Analytics Built on Unified Medical Corpora

Development and validation of a novel AI framework using NLP with LLM integration for relevant clinical data extraction through automated chart review

Changes in fat-soluble vitamin levels after gastrectomy for gastric cancer

[Principles of surgical treatment of diabetic neuropathic osteoarthropathy].

CACER: Clinical concept Annotations for Cancer Events and Relations

Immunodeficiency associated with recurrent infections and an isolated in vivo inability to respond to bacterial polysaccharides.

Language Models and Retrieval Augmented Generation for Automated Structured Data Extraction from Diagnostic Reports

Evaluation of a Data Annotation Platform for Large, Time-Series Datasets in Intensive Care: Mixed Methods Study

Extraction of Medication and Temporal Relation from Clinical Text using Neural Language Models

Med7: a transferable clinical natural language processing model for electronic health records

Randomized clinical trial of duct‐to‐mucosa versus invagination pancreaticojejunostomy after pancreatoduodenectomy

Extracting periodontitis diagnosis in clinical notes with RoBERTa and regular expression