Andrew Wen,Liwei Wang,Huan He,Sunyang Fu,Sijia Liu,David A Hanauer,Daniel R Harris,Ramakanth Kavuluru,Rui Zhang,Karthik Natarajan,Nishanth P Pavinkurve,Janos Hajagos,Sritha Rajupet,Veena Lingam,Mary Saltz,Corey Elowsky,Richard A Moffitt,Farrukh M Koraishy,Matvey B Palchuk,Jordan Donovan,Lora Lingrey,Garo Stone-DerHargopian,Robert T Miller,Andrew E Williams,Peter J Leese,Paul I Kovach,Emily R Pfaff,Mikhail Zemmel,Robert D Pates,Nick Guthe,Melissa A Haendel,Christopher G Chute,Hongfang Liu

Abstract:BACKGROUND A wealth of clinically relevant information is only obtainable within unstructured clinical narratives, leading to great interest in clinical natural language processing (NLP). While a multitude of approaches to NLP exist, current algorithm development approaches have limitations that can slow the development process. These limitations are exacerbated when the task is novel or evolving, as is the case currently for NLP extraction of signs and symptoms of COVID-19 and post-acute sequelae of SARS CoV-2 Infection (PASC). OBJECTIVE To highlight current limitations of existing NLP algorithm development approaches that are exacerbated by NLP tasks surrounding novel and evolving clinical concepts, and to illustrate our approach to addressing these issues through the use case of developing an NLP system for signs and symptoms of COVID-19 and PASC. METHODS Two pre-existing studies on PASC were used as a baseline to determine a set of concepts that should be extracted by NLP. This concept list was then used in conjunction with the Unified Medical Language System (UMLS) to autonomously generate an expanded lexicon to weakly annotate a training set, that was then reviewed by a human expert to generate a fine-tuned NLP algorithm. The annotations from a fully human-annotated test set were then compared with NLP results from the fine-tuned algorithm. The NLP algorithm was then deployed to 10 additional sites also running our NLP infrastructure. Of these 10 sites, 5 were used to conduct a federated evaluation of the NLP algorithm. RESULTS An NLP algorithm consisting of 12,234 unique normalized text strings corresponding to 2,366 unique concepts was developed to extract COVID-19/PASC signs and symptoms. An unweighted mean dictionary coverage of 77.8% was found for the five sites. CONCLUSIONS The evolutionary and time-critical nature of the PASC NLP task significantly complicates existing approaches to NLP algorithm development. In this work, we present a hybrid approach utilizing the Open Health Natural Language Processing (OHNLP) toolkit aimed at addressing these needs with a dictionary-based weak labeling step minimizing the need for additional expert annotation while still preserving the fine-tuning capabilities of expert involvement.

New perspectives in diagnosis and management of thrombophlebitis of the superficial dorsal vein of the penis.

From Phenotype to Gene: Detecting Disease-Specific Gene Functional Modules Via A Text-Based Human Disease Phenotype Network Construction

UCCB01-125, a dimeric inhibitor of PSD-95, reduces inflammatory pain without disrupting cognitive or motor performance: Comparison with the NMDA receptor antagonist MK-801

Developing a portable natural language processing based phenotyping system

A Corpus for Detecting High-Context Medical Conditions in Intensive Care Patient Notes Focusing on Frequently Readmitted Patients

PhenoID, a language model normalizer of physical examinations from genetics clinical notes

Hybrid deep learning methods for phenotype prediction from clinical notes

Telephone follow-up program evaluation: application of Orem's self-care model.

Unsupervised discovery of phenotype-specific multi-omics networks

Automatic extraction of social determinants of health from medical notes of chronic lower back pain patients

Comparing Rule-Based and Deep Learning Models for Patient Phenotyping

[Epidemiological and clinical characteristics and prognostic factors of ovarian carcinoma].

A Temporal Visualization of Chronic Obstructive Pulmonary Disease Progression Using Deep Learning and Unstructured Clinical Notes.

Automating Clinical Phenotyping Using Natural Language Processing: An Application for Crohn's Disease

Knowledge-Driven Online Multimodal Automated Phenotyping System

Identification of Novel Genes in Human Airway Epithelial Cells associated with Chronic Obstructive Pulmonary Disease (COPD) using Machine-Based Learning Algorithms

An NLP System for COVID/PASC: A Case Demonstration of the OHNLP Toolkit from the National COVID Cohort Collaborative and the RECOVER Programs (Preprint)

A Combined Manual Annotation and Deep-Learning Natural Language Processing Study on Accurate Entity Extraction in Hereditary Disease Related Biomedical Literature

Toward high-throughput phenotyping: unbiased automated feature extraction and selection from knowledge sources.

Machine diagnosis of chronic obstructive pulmonary disease using a novel fast-response capnometer

Using Recurrent Neural Networks to Extract High-Quality Information From Lung Cancer Screening Computerized Tomography Reports for Inter-Radiologist Audit and Feedback Quality Improvement