Abstract:Background: The severity of Alzheimer disease and related dementias (ADRD) is rarely documented in structured data fields in electronic health records (EHRs). Although this information is important for clinical monitoring and decision-making, it is often undocumented or "hidden" in unstructured text fields and not readily available for clinicians to act upon. Objective: We aimed to assess the feasibility and potential bias in using keywords and rule-based matching for obtaining information about the severity of ADRD from EHR data. Methods: We used EHR data from a large academic health care system that included patients with a primary discharge diagnosis of ADRD based on ICD-9 (International Classification of Diseases, Ninth Revision) and ICD-10 (International Statistical Classification of Diseases, Tenth Revision) codes between 2014 and 2019. We first assessed the presence of ADRD severity information and then the severity of ADRD in the EHR. Clinicians' notes were used to determine the severity of ADRD based on two criteria: (1) scores from the Mini Mental State Examination and Montreal Cognitive Assessment and (2) explicit terms for ADRD severity (eg, "mild dementia" and "advanced Alzheimer disease"). We compiled a list of common ADRD symptoms, cognitive test names, and disease severity terms, refining it iteratively based on previous literature and clinical expertise. Subsequently, we used rule-based matching in Python using standard open-source data analysis libraries to identify the context in which specific words or phrases were mentioned. We estimated the prevalence of documented ADRD severity and assessed the performance of our rule-based algorithm. Results: We included 9115 eligible patients with over 65,000 notes from the providers. Overall, 22.93% (2090/9115) of patients were documented with mild ADRD, 20.87% (1902/9115) were documented with moderate or severe ADRD, and 56.20% (5123/9115) did not have any documentation of the severity of their ADRD. For the task of determining the presence of any ADRD severity information, our algorithm achieved an accuracy of >95%, specificity of >95%, sensitivity of >90%, and an F1-score of >83%. For the specific task of identifying the actual severity of ADRD, the algorithm performed well with an accuracy of >91%, specificity of >80%, sensitivity of >88%, and F1-score of >92%. Comparing patients with mild ADRD to those with more advanced ADRD, the latter group tended to contain older, more likely female, and Black patients, and having received their diagnoses in primary care or in-hospital settings. Relative to patients with undocumented ADRD severity, those with documented ADRD severity had a similar distribution in terms of sex, race, and rural or urban residence. Conclusions: Our study demonstrates the feasibility of using a rule-based matching algorithm to identify ADRD severity from unstructured EHR report data. However, it is essential to acknowledge potential biases arising from differences in documentation practices across various health care systems.

Validation of Different Dementia Code-Based Definitions in a Population-Based Study of Rheumatoid Arthritis

Validation of claims‐based diagnoses for rheumatoid arthritis in Japan: Results from the VALIDATE‐J study

A systematic review of validated methods for identifying patients with rheumatoid arthritis using administrative or claims data

Validation of the rheumatoid arthritis diagnosis in the Swedish National patient register: a cohort study from Stockholm County

The accuracy of administrative health data for identifying patients with rheumatoid arthritis: a retrospective validation study using medical records in Western Australia

Association of Autoimmune Disorders and Disease-modifying Antirheumatic Drugs: (DMARDs) with the Risk of Alzheimer's and/or Dementia: A Population Study Using Medicare Beneficiary Data

Validation of New Classification Criteria of Rheumatoid Arthritis in an International Multicentre Study.

Impact Of Icd10 And Secular Changes On Electronic Medical Record Rheumatoid Arthritis Algorithms

Electronic medical records for discovery research in rheumatoid arthritis

Predicting risk for radiographic damage in rheumatoid arthritis: comparative analysis of the multi-biomarker disease activity score and conventional measures of disease activity in multiple studies

Extracting Critical Information from Unstructured Clinicians' Notes Data to Identify Dementia Severity Using a Rule-Based Approach: Feasibility Study

Reduced cognitive ability in people with rheumatoid arthritis compared with age-matched healthy controls

Development and validation of a rheumatoid arthritis case definition: a machine learning approach using data from primary care electronic medical records

From patient care to research: a validation study examining the factors contributing to data quality in a primary care electronic medical record database

The Impact of Cardiovascular and Cerebrovascular Disease on the Risk of Dementia in Rheumatoid Arthritis: A Mediation Analysis

Disease-Modifying Antirheumatic Drugs and Dementia Prevention: A Systematic Review of Observational Evidence in Rheumatoid Arthritis

Prodromal symptoms of rheumatoid arthritis in a primary care database: variation by ethnicity and socioeconomic status

Comprehensive assessment of multimorbidity burden in a population-based cohort of patients with rheumatoid arthritis

Handwork vs machine: a comparison of rheumatoid arthritis patient populations as identified from EHR free-text by diagnosis extraction through machine-learning or traditional criteria-based chart review

Causal relationships between rheumatoid arthritis and neurodegenerative diseases: a two-sample univariable and multivariable Mendelian randomization study

Derivation and internal validation of a multi-biomarker-based cardiovascular disease risk prediction score for rheumatoid arthritis patients