Abstract:Neuroimaging has achieved considerable success in elucidating the neurophysiological underpinnings of various brain functions. Tools such as standardized cognitive tests and symptom inventories have played a crucial role in informing neuroimaging studies, helping to uncover the underlying brain systems associated with these measures. Substantial strides have been taken in developing models, such as connectome-based predictive modeling (CPM), that establish connections between external measures and the human connectome, offering insights into how the functional organization of the brain varies in relation to scores on external measures. Here, we depart from the conventional feed-forward approach and introduce a feed-back approach that allows testing of the tests. Since the inception of cognitive psychology over 60 years ago, cognitive tests have been meticulously developed to measure specific components of cognition. These tests, which have undergone extensive validation and have been standardized and administered to millions, operate on explicit assumptions about the cognitive components they assess. Rather than using external tests to identify the circuits supporting test scores, we a priori define networks of interest and quantify the extent to which these circuits support the test measure. To demonstrate this, we define functional connectivity networks for six cognitive constructs and quantify their contribution to performance across a spectrum of standardized cognitive tests and clinical measures. Employing robust machine learning in a predictive modeling framework, we show how this approach can be used to select tests according to the networks they rely upon. This establishes a biologically grounded metric for test comparison. This approach also yields a brain-driven process for forming composite tests by selecting test combinations that depend on the same proportional brain systems, or for a single network of interest, combining tests with the highest predictive power for that network. This brain-driven approach results in more robust behavioral assessments and enhanced predictive power for the network of interest. We illustrate how this methodology can be applied to evaluate the inclusion of specific sub-tests within a composite score, revealing instances where composite scores are reinforced or weakened by subtest inclusion in terms of the specificity of the brain network they interrogate. The brain-test score modeling approach presented here provides a biologically driven approach to the selection of external cognitive and symptom measures directed at specific brain systems. It opens new avenues of research by providing a framework for the development of new tests and measures guided by quantitative brain metrics.

Process scores on measures of learning and memory: Issue 1

Process scores on measures of learning and memory: issue 2

Differential Neural Correlates Underlie Judgment of Learning and Subsequent Memory Performance

Modern Scores for Traditional Tests - Review of the Diagnostic Potential of Scores Derived from Word List Learning Tests in Mild Cognitive Impairment and Early Alzheimer's Disease

Process models of verbal memory in cancer survivors: Bayesian process modeling approach to variation in test scores

Methods for assessment of rey auditory verbal learning test performance in memory clinic patients and healthy adults - at the cross-roads of learning theory and clinical utility

Scoring story recall for individual differences research: Central details, peripheral details, and automated scoring

The processing of verbal memories after traumatic brain injury

Process and Product in Computer-Based Assessments

The relationship between processing speed and verbal and non-verbal new learning and memory in progressive multiple sclerosis

The Common Time Course of Memory Processes Revealed

Learning-performance distinction and memory processes for motor skills: a focused review and perspective

Detection of Rater Errors on Cognitive Instruments in a Clinical Trial Setting

Optimizing Cognitive Assessment Outcome Measures for Alzheimer's Disease by Matching Wordlist Memory Test Features to Scoring Methodology

The Effect of Learning in a Virtual Environment on Explicit and Implicit Memory by Applying a Process Dissociation Procedure

Testing the Tests: Using Connectome-Based Predictive Models to Reveal the Systems Standardized Tests and Clinical Symptoms Are Reflecting

Neurocognitive Deficits and Functional Outcome in Schizophrenia: Are We Measuring the "Right Stuff"?

Challenges and advanced concepts for the assessment of learning and memory function in mice

Digital assessment of cognition in neurodegenerative disease: a data driven approach leveraging artificial intelligence

Memory and automatic processing of valuable information in younger and older adults

Effect of processing speed and memory performance on classification accuracy of the dot counting test in a mixed neuropsychiatric sample