Abstract:The present study investigated the test–retest reliability of the attention network test from the perspective of intrinsic network organization using a sample of Parkinson's patients and healthy old adults. The overlap of the contrast map at the group level between sessions and between participant groups was unsatisfactory. The reliability of alerting, orienting and executive was worse than estimates of specific conditions. Attention‐related intrinsic networks showed acceptable reliability for the congruent and incongruent contrasts. The attention network test (ANT), developed based on the triple‐network taxonomy by Posner and colleagues, has been widely used to examine the efficacy of alerting, orienting and executive control in clinical and developmental neuroscience studies. Recent research suggests the imperfect reliability of the behavioural ANT and its variants. However, the classical ANT fMRI task's test–retest reliability has received little attention. Moreover, it remains ambiguous whether the attention‐related intrinsic network components, especially the dorsal attention, ventral attention and frontoparietal network, manifest acceptable reliability. The present study approaches these issues by utilizing an openly available ANT fMRI dataset for participants with Parkinson's disease and healthy elderly. The reproducibility of group‐level activations across sessions and participant groups and the test–retest reliability at the individual level were examined at the voxel, region and network levels. The intrinsic network was defined using the Yeo‐Schaefer atlas. Our results reveal three critical facets: (1) the overlapping of the group‐level contrast map between sessions and between participant groups was unsatisfactory; (2) the reliability of alerting, orienting and executive, defined as a contrast between conditions, was worse than estimates of specific conditions. (3) Dorsal attention, ventral attention, visual and somatomotor networks showed acceptable reliability for the congruent and incongruent conditions. Our results suggest that specific condition estimates might be used instead of the contrast map for individual or group‐difference studies.

Test-retest reliability for common tasks in vision science

Reliably Measuring Learning-Dependent Distractor Suppression with Eye Tracking

The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences

Reliability and Validity of Useful Field of View Test Scores as Administered by Personal Computer

A measure of reliability convergence to select and optimize cognitive tasks for individual differences research

On the reliability of behavioral measures of cognitive control: retest reliability of task-inhibition effect, task-preparation effect, Stroop-like interference, and conflict adaptation effect

Individual differences in visual attention: A short, reliable, open-source, and multilingual test of multiple object tracking in PsychoPy

Test–retest reliability of the attention network test from the perspective of intrinsic network organization

The complexity of measuring reliability in learning tasks: An illustration using the Alternating Serial Reaction Time Task

Correlated individual differences suggest a common mechanism underlying metacognition in visual perception and visual short-term memory

Test–retest reliability of reinforcement learning parameters

Measuring individual differences in statistical learning: Current pitfalls and possible solutions

The Reliability of the Senaptec Sensory Station for the Comprehensive Assessment of Sensorimotor Skills in College-Aged Individuals

Visual tests, touch responses: Computer-based neuropsychological tools

Consistency of spatial ability performance in children, adolescents, and young adults

Test-Retest Reliability of Component Process Variables Within the Hopkins Verbal Learning Test-Revised

Consistency within change: Evaluating the psychometric properties of a widely used predictive-inference task

Individual differences in perceptual abilities in medical imaging: the Vanderbilt Chest Radiograph Test

Individual differences in visual search: A systematic review of the link between visual search performance and traits or abilities

Cognitive Predictors of Vigilance

Test-retest reliability of the simon task: a short version proposal