Abstract:Background: Computer-aided detection, used in the screening and diagnosing of cognitive impairment, provides an objective, valid, and convenient assessment. Particularly, digital sensor technology is a promising detection method. Objective: This study aimed to develop and validate a novel Trail Making Test (TMT) using a combination of paper and electronic devices. Methods: This study included community-dwelling older adult individuals (n=297), who were classified into (1) cognitively healthy controls (HC; n=100 participants), (2) participants diagnosed with mild cognitive impairment (MCI; n=98 participants), and (3) participants with Alzheimer disease (AD; n=99 participants). An electromagnetic tablet was used to record each participant's hand-drawn stroke. A sheet of A4 paper was placed on top of the tablet to maintain the traditional interaction style for participants who were not familiar or comfortable with electronic devices (such as touchscreens). In this way, all participants were instructed to perform the TMT-square and circle. Furthermore, we developed an efficient and interpretable cognitive impairment–screening model to automatically analyze cognitive impairment levels that were dependent on demographic characteristics and time-, pressure-, jerk-, and template-related features. Among these features, novel template-based features were based on a vector quantization algorithm. First, the model identified a candidate trajectory as the standard answer (template) from the HC group. The distance between the recorded trajectories and reference was computed as an important evaluation index. To verify the effectiveness of our method, we compared the performance of a well-trained machine learning model using the extracted evaluation index with conventional demographic characteristics and time-related features. The well-trained model was validated using follow-up data (HC group: n=38; MCI group: n=32; and AD group: n=22). Results: We compared 5 candidate machine learning methods and selected random forest as the ideal model with the best performance (accuracy: 0.726 for HC vs MCI, 0.929 for HC vs AD, and 0.815 for AD vs MCI). Meanwhile, the well-trained classifier achieved better performance than the conventional assessment method, with high stability and accuracy of the follow-up data. Conclusions: The study demonstrated that a model combining both paper and electronic TMTs increases the accuracy of evaluating participants' cognitive impairment compared to conventional paper-based feature assessment.

Study on stability of Stroop color word test and trail making test in normal elder people：A 2-year follow-up

Memory Tests Predict the Change of Hippocampus Topography in Mild Cognitive Impairment Patients

Diagnostic Accuracy of the Chinese Version of the Trail‐Making Test for Screening Cognitive Impairment

Trail Making Test Used by Chinese Elderly Patients with Mild Cognitive Impairment and Mild Alzheimer' Dementia

Application of Stroop color-word test on Chinese elderly patients with mild cognitive impairment and mild Alzheimer's dementia

The Shape Trail Test: Application of a New Variant of the Trail Making Test

P1‐222: Auditory Verbal Learning Test is Superior to Rey‐osterrieth Complex Figure Memory for Predicting Progression from Mild Cognitive Impairment to Alzheimer's Disease

Longitudinal Changes In Clock Drawing Test (Cdt) Performance Before And After Cognitive Decline

Shanghai Community Brain Health Initiative Pilot Study: Neuropsychological Results

Comparative Study of Discerning Efficacy of Shortened Neuropsychological Tests on Mild Cognitive Impairment

The 4 year follow-up investigation of cognitive function in patients after acute stroke

The Effects of Normal Aging, Subjective Cognitive Decline, Mild Cognitive Impairment, or Alzheimer’s Disease on Visual Search

Short-term Delayed Recall of Auditory Verbal Learning Test Provides Equivalent Value to Long-Term Delayed Recall in Predicting MCI Clinical Outcomes: A Longitudinal Follow-Up Study

Differential Cognitive Deterioration in Dementia: A Two Year Longitudinal Study

Progression from Subjective Cognitive Decline to Mild Cognitive Impairment or Dementia: The Role of Baseline Cognitive Performance

3-Year test-retest reliability in Parkinson's disease and healthy older adults: The Parkinson's progression markers initiative study

Combination of Paper and Electronic Trail Making Tests for Automatic Analysis of Cognitive Impairment: Development and Validation Study

Research for Difference Between Neurodegenerative and Vascular Mild Cognitive Impairment with Neuropsychological Assessment

Neuropsychological Examination in Patients with Mild Cognitive Impairment

Validation of Chinese Version of SKT (Syndrom Kurztest): A Short Cognitive Performance Test for the Assessment of Memory and Attention

Neuropsychological Correlates of Clinical Progression in Subjective Cognitive Decline