Abstract:Background: The severity of Alzheimer disease and related dementias (ADRD) is rarely documented in structured data fields in electronic health records (EHRs). Although this information is important for clinical monitoring and decision-making, it is often undocumented or "hidden" in unstructured text fields and not readily available for clinicians to act upon. Objective: We aimed to assess the feasibility and potential bias in using keywords and rule-based matching for obtaining information about the severity of ADRD from EHR data. Methods: We used EHR data from a large academic health care system that included patients with a primary discharge diagnosis of ADRD based on ICD-9 (International Classification of Diseases, Ninth Revision) and ICD-10 (International Statistical Classification of Diseases, Tenth Revision) codes between 2014 and 2019. We first assessed the presence of ADRD severity information and then the severity of ADRD in the EHR. Clinicians' notes were used to determine the severity of ADRD based on two criteria: (1) scores from the Mini Mental State Examination and Montreal Cognitive Assessment and (2) explicit terms for ADRD severity (eg, "mild dementia" and "advanced Alzheimer disease"). We compiled a list of common ADRD symptoms, cognitive test names, and disease severity terms, refining it iteratively based on previous literature and clinical expertise. Subsequently, we used rule-based matching in Python using standard open-source data analysis libraries to identify the context in which specific words or phrases were mentioned. We estimated the prevalence of documented ADRD severity and assessed the performance of our rule-based algorithm. Results: We included 9115 eligible patients with over 65,000 notes from the providers. Overall, 22.93% (2090/9115) of patients were documented with mild ADRD, 20.87% (1902/9115) were documented with moderate or severe ADRD, and 56.20% (5123/9115) did not have any documentation of the severity of their ADRD. For the task of determining the presence of any ADRD severity information, our algorithm achieved an accuracy of >95%, specificity of >95%, sensitivity of >90%, and an F1-score of >83%. For the specific task of identifying the actual severity of ADRD, the algorithm performed well with an accuracy of >91%, specificity of >80%, sensitivity of >88%, and F1-score of >92%. Comparing patients with mild ADRD to those with more advanced ADRD, the latter group tended to contain older, more likely female, and Black patients, and having received their diagnoses in primary care or in-hospital settings. Relative to patients with undocumented ADRD severity, those with documented ADRD severity had a similar distribution in terms of sex, race, and rural or urban residence. Conclusions: Our study demonstrates the feasibility of using a rule-based matching algorithm to identify ADRD severity from unstructured EHR report data. However, it is essential to acknowledge potential biases arising from differences in documentation practices across various health care systems.

Rule-Based Identification of Individuals with Mild Cognitive Impairment or Alzheimer’s Disease Using Clinical Notes from the United States Veterans Affairs Healthcare System

Prevalence of Mild Cognitive Impairment and Alzheimer's Disease Identified in Veterans in the United States

Automated Medical Records Review for Mild Cognitive Impairment and Dementia

Extracting Critical Information from Unstructured Clinicians' Notes Data to Identify Dementia Severity Using a Rule-Based Approach: Feasibility Study

Identification of Outcome-Oriented Progression Subtypes from Mild Cognitive Impairment to Alzheimer’s Disease Using Electronic Health Records

Early Prediction of Alzheimers Disease Leveraging Symptom Occurrences from Longitudinal Electronic Health Records of US Military Veterans

Development and Validation of a Deep Learning Model for Earlier Detection of Cognitive Decline From Clinical Notes in Electronic Health Records

Develop and validate a computable phenotype for the identification of Alzheimer's disease patients using electronic health record data

The Role of Mental Health Conditions in Early Detection and Treatment of Veterans With Alzheimer’s Dementia

Identifying Dementia Severity Among People Living With Dementia Using Administrative Claims Data

Develop and Validate a Computable Phenotype for the Identification of Alzheimer’s Disease Patients Using Electronic Health Record Data

A comparison of dementia diagnoses and cognitive function measures in Medicare claims and the Minimum Data Set

Enhancing early detection of cognitive decline in the elderly: a comparative study utilizing large language models in clinical notes

Real-world diagnostic, referral, and treatment patterns in early Alzheimer's disease among community-based practices in the United States

AD-BERT: Using pre-trained language model to predict the progression from mild cognitive impairment to Alzheimer's disease

Comparing neuropsychological, typical, and ADNI criteria for the diagnosis of mild cognitive impairment in Vietnam-era veterans

Predicting 5-year dementia conversion in veterans with mild cognitive impairment

Identifying Psychosis Episodes in Psychiatric Admission Notes via Rule-based Methods, Machine Learning, and Pre-Trained Language Models

Rural-Urban mild cognitive impairment comparison in West Michigan through EHR

Assess the Documentation of Cognitive Tests and Biomarkers in Electronic Health Records Via Natural Language Processing for Alzheimer’s Disease and Related Dementias