Abstract:BACKGROUND In the United States, rare diseases are defined as those affecting fewer than 200,000 patients at any given time. Patients with rare diseases are frequently either misdiagnosed or left undiagnosed, possibly due in part to a lack of knowledge or experience with the rare disease on the part of care providers. With an exponentially growing volume of electronically accessible medical data, a large volume of information on thousands of rare diseases and their potentially associated diagnostic information is buried in electronic medical records (EMRs) and medical literature. OBJECTIVE We hypothesize that patients’ phenotypic information available within these heterogeneous resources (e.g., electronic medical records and biomedical literature) can be leveraged to accelerate disease diagnosis. In this study, we aimed to leverage information contained in heterogeneous datasets to assist rare disease diagnosis. METHODS In a previous study, we proposed utilizing a collaborative filtering recommendation system enriched with natural language processing and semantic techniques to assist rare disease diagnosis based on phenotypic characterizations derived solely from EMR data. In this study, in order to further investigate the performance of collaborative filtering on heterogeneous datasets, we studied EMR data generated at Mayo Clinic as well as published article abstracts retrieved from the Semantic MEDLINE Database. Specifically, in this study, we applied Tanimoto coefficient similarity, overlap coefficient similarity, Fager & McGowan coefficient similarity, and log likelihood ratio similarity with K nearest neighbor and threshold based patient neighbor algorithms on various combinations of datasets. RESULTS We evaluated different approaches to this problem using characterizations derived from various combinations of EMR data and literature, as well as with solely EMR data. We extracted 12.8 million EMRs from the Mayo Clinic unstructured patient cohort generated between 2010 through 2015 and retrieved all article abstracts from the semi-structured Semantic MEDLINE Database that were published through the end of 2016. We applied a collaborative filtering model and compared the performance generated by different metrics. Log likelihood ratio similarity combined with K nearest neighbor on heterogeneous datasets showed the optimal performance in patient recommendation with PRAUC 0.475 (string match), 0.511 (SNOMED match), and 0.752 (GARD match). Log likelihood ratio similarity also performed the best with mean average precision 0.465 (string match), 0.5 (SNOMED match), and 0.749 (GARD match). Performance of rare disease prediction was also demonstrated by using the optimal algorithm. Macro-average F-measure for string, SNOMED-CT, and GARD match were 0.32, 0.42, and 0.63, respectively. CONCLUSIONS This study demonstrated potential utilization of heterogeneous datasets in a collaborative filtering model to support rare disease diagnosis. In addition to phenotypic-based analysis, in the future, we plan to resolve the heterogeneity issue and reduce miscommunication between EMR and literature by mining genotypic information to establish a comprehensive disease-phenotype-gene network for rare disease diagnosis.

Ontology-driven and weakly supervised rare disease identification from clinical notes

Rare Disease Identification from Clinical Notes with Ontologies and Weak Supervision

A Robust Phenotype-Driven Likelihood Ratio Analysis Approach Assisting Interpretable Clinical Diagnosis of Rare Diseases.

A hybrid framework with large language models for rare disease phenotyping

Automatic Classification and Visualization of Text Data on Rare Diseases

A Visual Phenotype-Based Differential Diagnosis Process for Rare Diseases.

Exploring deep learning methods for recognizing rare diseases and their clinical manifestations from texts

Identifying and Extracting Rare Diseases and Their Phenotypes with Large Language Models

Automated annotation of disease subtypes

Novel phenotype–disease matching tool for rare genetic diseases

Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Case

Machine learning in rare disease

Few shot learning for phenotype-driven diagnosis of patients with rare genetic diseases

Weakly Semi-supervised phenotyping using Electronic Health records

Unsupervised Extraction of Phenotypes from Cancer Clinical Notes for Association Studies

Large Language Models with Retrieval-Augmented Generation for Zero-Shot Disease Phenotyping

Rare disease knowledge enrichment through a data-driven approach

Utilization of Electronic Medical Records and Biomedical Literature to Support Rare Disease Diagnosis (Preprint)

Ontology-driven weak supervision for clinical entity classification in electronic health records

Identifying and Extracting Rare Disease Phenotypes with Large Language Models