Abstract:Background: With the rapid aging of the global population, the prevalence of mild cognitive impairment (MCI) and dementia is anticipated to surge worldwide. MCI serves as an intermediary stage between normal aging and dementia, necessitating more sensitive and effective screening tools for early identification and intervention. The BrainFx SCREEN is a novel digital tool designed to assess cognitive impairment. This study evaluated its efficacy as a screening tool for MCI in primary care settings, particularly in the context of an aging population and the growing integration of digital health solutions. Objective: The primary objective was to assess the validity, reliability, and applicability of the BrainFx SCREEN (hereafter, the SCREEN) for MCI screening in a primary care context. We conducted an exploratory study comparing the SCREEN with an established screening tool, the Quick Mild Cognitive Impairment (Qmci) screen. Methods: A concurrent mixed methods, prospective study using a quasi-experimental design was conducted with 147 participants from 5 primary care Family Health Teams (FHTs; characterized by multidisciplinary practice and capitated funding) across southwestern Ontario, Canada. Participants included health care practitioners, patients, and FHT administrative executives. Individuals aged ≥55 years with no history of MCI or diagnosis of dementia rostered in a participating FHT were eligible to participate. Participants were screened using both the SCREEN and Qmci. The study also incorporated the Geriatric Anxiety Scale–10 to assess general anxiety levels at each cognitive screening. The SCREEN's scoring was compared against that of the Qmci and the clinical judgment of health care professionals. Statistical analyses included sensitivity, specificity, internal consistency, and test-retest reliability assessments. Results: The study found that the SCREEN's longer administration time and complex scoring algorithm, which is proprietary and unavailable for independent analysis, presented challenges. Its internal consistency, indicated by a Cronbach α of 0.63, was below the acceptable threshold. The test-retest reliability also showed limitations, with moderate intraclass correlation coefficient (0.54) and inadequate κ (0.15) values. Sensitivity and specificity were consistent (63.25% and 74.07%, respectively) between cross-tabulation and discrepant analysis. In addition, the study faced limitations due to its demographic skew (96/147, 65.3% female, well-educated participants), the absence of a comprehensive gold standard for MCI diagnosis, and financial constraints limiting the inclusion of confirmatory neuropsychological testing. Conclusions: The SCREEN, in its current form, does not meet the necessary criteria for an optimal MCI screening tool in primary care settings, primarily due to its longer administration time and lower reliability. As the number of digital health technologies increases and evolves, further testing and refinement of tools such as the SCREEN are essential to ensure their efficacy and reliability in real-world clinical settings. This study advocates for continued research in this rapidly advancing field to better serve the aging population. Trial Registration:

Investigating the relevance of the advanced activities of daily living tool for the screening and diagnosis of mild cognitive impairment and dementia to the Sub-Saharan African migrant population in Belgium: A qualitative focus group study

Early diagnosis of mild cognitive impairment and mild dementia through basic and instrumental activities of daily living: Development of a new evaluation tool

Discriminant Validity and Time‐effectiveness of A Stepwise Dementia Case‐finding Approach in an Asian Elderly Community

Use of the Dementia Assessment Sheet for Community‐based Integrated Care System 21 Items among Chinese Community‐dwelling Older Adults

The Discriminant Validity of Single-Question Assessments of Subjective Cognitive Complaints in an Asian Older Adult Population.

Facilitating clinical use of the Amsterdam Instrumental Activities of Daily Living Questionnaire: Normative data and a diagnostic cutoff value

Not daily, sometimes not ever - mixed methods exploration of the contemporary relevance of tasks contained in extended activities of daily living scales

Assessing cognitive function in longitudinal studies of ageing worldwide: some practical considerations

1972 A scoping review of remotely delivered cognitive assessment tools that could be used in comprehensive geriatric assessment

Validation of a brief screener for broad-spectrum mental and substance-use disorders in South Africa

The Association of Alzheimer's Disease-Related Blood-Based Biomarkers with Cognitive Screening Test Performance in the Congolese Population in Kinshasa

Validation study of "Santé-Cerveau", a digital tool for early cognitive changes identification

Dementia in South Africa: A Situational Analysis

Psychometric Evaluation of a Tablet-Based Tool to Detect Mild Cognitive Impairment in Older Adults: Mixed Methods Study

Multicenter Validation of the English Version of the Dépistage Cognitif de Québec: a Cognitive Screening Tool for Atypical Dementias

A Systematic Review of Neuropsychological Tests for the Assessment of Dementia in Non-Western, Low-Educated or Illiterate Populations

Attitudes and Preferences Towards Screening for Dementia with a Focus on Ethnic Minority and Low Socio-Economic Groups: A Systematic Review of Research Studies Written in the English Language

The influence of diversity on the measurement of functional impairment: An international validation of the Amsterdam IADL Questionnaire in 8 countries

Feasibility and Determinants of Performance for a Tablet-Based Cognitive Assessment Tool in Rural and Urban Southeast Nigeria

Validation of the "Perceptions Regarding pRE-Symptomatic Alzheimer's Disease Screening" (PRE-ADS) Questionnaire in the German Population: Attitudes, Motivations, and Barriers to Pre-Symptomatic Dementia Screening

Cognitive and Functional Decline in a Psychogeriatric Population: A Comparative Longitudinal Analysis of MMSE, MoCA, ADL, and IADL