Abstract:Background: The severity of Alzheimer disease and related dementias (ADRD) is rarely documented in structured data fields in electronic health records (EHRs). Although this information is important for clinical monitoring and decision-making, it is often undocumented or "hidden" in unstructured text fields and not readily available for clinicians to act upon. Objective: We aimed to assess the feasibility and potential bias in using keywords and rule-based matching for obtaining information about the severity of ADRD from EHR data. Methods: We used EHR data from a large academic health care system that included patients with a primary discharge diagnosis of ADRD based on ICD-9 (International Classification of Diseases, Ninth Revision) and ICD-10 (International Statistical Classification of Diseases, Tenth Revision) codes between 2014 and 2019. We first assessed the presence of ADRD severity information and then the severity of ADRD in the EHR. Clinicians' notes were used to determine the severity of ADRD based on two criteria: (1) scores from the Mini Mental State Examination and Montreal Cognitive Assessment and (2) explicit terms for ADRD severity (eg, "mild dementia" and "advanced Alzheimer disease"). We compiled a list of common ADRD symptoms, cognitive test names, and disease severity terms, refining it iteratively based on previous literature and clinical expertise. Subsequently, we used rule-based matching in Python using standard open-source data analysis libraries to identify the context in which specific words or phrases were mentioned. We estimated the prevalence of documented ADRD severity and assessed the performance of our rule-based algorithm. Results: We included 9115 eligible patients with over 65,000 notes from the providers. Overall, 22.93% (2090/9115) of patients were documented with mild ADRD, 20.87% (1902/9115) were documented with moderate or severe ADRD, and 56.20% (5123/9115) did not have any documentation of the severity of their ADRD. For the task of determining the presence of any ADRD severity information, our algorithm achieved an accuracy of >95%, specificity of >95%, sensitivity of >90%, and an F1-score of >83%. For the specific task of identifying the actual severity of ADRD, the algorithm performed well with an accuracy of >91%, specificity of >80%, sensitivity of >88%, and F1-score of >92%. Comparing patients with mild ADRD to those with more advanced ADRD, the latter group tended to contain older, more likely female, and Black patients, and having received their diagnoses in primary care or in-hospital settings. Relative to patients with undocumented ADRD severity, those with documented ADRD severity had a similar distribution in terms of sex, race, and rural or urban residence. Conclusions: Our study demonstrates the feasibility of using a rule-based matching algorithm to identify ADRD severity from unstructured EHR report data. However, it is essential to acknowledge potential biases arising from differences in documentation practices across various health care systems.

Prevalence of Mild Cognitive Impairment and Alzheimer's Disease Identified in Veterans in the United States

Rule-Based Identification of Individuals with Mild Cognitive Impairment or Alzheimer’s Disease Using Clinical Notes from the United States Veterans Affairs Healthcare System

The epidemiology of mild cognitive impairment, Alzheimer's disease and related dementia in U.S. veterans

Prevalence of Alzheimer’s disease (AD) dementia and mild cognitive impairment (MCI) in the United States Medicare population

Prevalence and Severity Distribution of Alzheimer’s Disease in the United States from the Health and Retirement Study

The Prevalence Of Mild Cognitive Impairment In China: A Systematic Review

Prevalence Estimation of Dementia/Alzheimer's Disease Using Health and Retirement Study Database in the United States

The Role of Mental Health Conditions in Early Detection and Treatment of Veterans With Alzheimer’s Dementia

Automated Medical Records Review for Mild Cognitive Impairment and Dementia

Real-world diagnostic, referral, and treatment patterns in early Alzheimer's disease among community-based practices in the United States

Early Prediction of Alzheimers Disease Leveraging Symptom Occurrences from Longitudinal Electronic Health Records of US Military Veterans

Identification of Outcome-Oriented Progression Subtypes from Mild Cognitive Impairment to Alzheimer’s Disease Using Electronic Health Records

Predicting 5-year dementia conversion in veterans with mild cognitive impairment

Prevalence of Neuropsychiatric Symptoms Across the Declining Memory Continuum: an Observational Study in a Memory Clinic Setting

A comparison of dementia diagnoses and cognitive function measures in Medicare claims and the Minimum Data Set

Case Definition for Diagnosed Alzheimer Disease and Related Dementias in Medicare

Comparing neuropsychological, typical, and ADNI criteria for the diagnosis of mild cognitive impairment in Vietnam-era veterans

Economic Impact of Progression from Mild Cognitive Impairment to Alzheimer Disease in the United States

Using a newly validated algorithm to estimate prevalence and incidence of Alzheimer’s Disease and related dementias in Medicare claims

Identifying Dementia Severity Among People Living With Dementia Using Administrative Claims Data

Extracting Critical Information from Unstructured Clinicians' Notes Data to Identify Dementia Severity Using a Rule-Based Approach: Feasibility Study