Abstract:Objective: Attention concerns, particularly difficulties with focusing and regulating attention, are reported in diverse clinical contexts. The Ruff 2&7 Selective Attention Test (Ruff 2&7; Ruff & Allen, 1996) is a measure of sustained and selective attention that assesses automatic detection and effortful processing. The goal of this study was to create an internal consistency metric within this test and to determine cognitive predictors by evaluating associations with executive control of attention and other cognitive skills. It was hypothesized that those who are more consistent across Ruff 2&7 performance would have more robust executive functioning skills, particularly those related to regulating and directing attention and the planning and utilization of cognitive resources. Participants and Methods: The current study examined a clinical sample of 98 United States veterans with a history of mild traumatic brain injury. After excluding invalid cases (n=24), the final sample consisted of 74 veterans (Age=38.5 (8.9) years old; 13.9 (2.2) years of education; 78% male; 82% white, 7% Black, 8% Hispanic, 2% Asian). A consistency score was defined as the absolute value of the intertrial change in target hits plus errors across each pair of trials of the same stimulus type (Automatic Detection, AD, and Controlled Search, CS). Hierarchical linear regression modeling was used to evaluate the relative contributions of memory and executive functions (Rey Auditory Verbal Learning Test, Delis-Kaplan Executive Function System Tower Test, phonemic fluency, Trail Making Test B) and subjective symptom report (PTSD Checklist for DSM-5, Barkley Adult ADHD Rating Scale for DSM-IV). Results: The mean deviation scores for the two trial types were similar (AD mean=13.6, SD=5.9; CS mean=13.6, SD=5.3). In predicting consistency across AD trials, delayed recall contributed 11% unique variance (p=.013), while no other block was statistically significant. For CS trials, self-reported PTSD and inattention symptoms contributed a combined 20% of unique variance to the model (p=.007), while there were no statistically significant cognitive predictors in this model. Conclusions: Contrary to expectation, executive function measures did not explain statistically significant variance in performance across either trial type. Less consistent performance on AD trials was associated with weaker verbal memory. Less consistent performance on CS trials, which theoretically require greater executive control, was not associated with any cognitive scores, but was associated with more severe self-reported psychological and inattention symptoms. These findings buttress the conceptual distinction between AD and CS trial types, and they point to both cognitive and non-cognitive underpinnings of performance consistency.

Attention! Do We Really Need Attention Checks?

Nature and measurement of attention control.

Investigating Respondent Attention to Experimental Text Lengths

The Hidden Cost of Using Amazon Mechanical Turk for Research

Measuring attention and vigilance in the laboratory vs. online: The split-half reliability of the ANTI-Vea

Individual differences in inattentional blindness

The Attentional Blink Between Two Color Processing Tasks

Advancing the understanding of individual differences in attentional control: Theoretical, methodological, and analytical considerations

Psychometric curves reveal changes in bias, lapse rate, and guess rate in an online vigilance task

Testing the validity of the attention control video: An eye-tracking approach of the ego depletion effect

The Relevance of Attention Control, Not Working Memory, in Human Factors

85 Performance Consistency on a Measure of Sustained and Selective Attention

Comparing attentional disengagement between Prolific and MTurk samples

“Rarely safe to assume”: Evaluating the use and interpretation of manipulation checks in experimental social psychology

In Response to Warnings: Exploring Individual Differences in Sustained Attention Performance

On the reliability of value-modulated attentional capture: An online replication and multiverse analysis

Investigating the mechanisms by which selective attention affects subsequent preferences and choice

Attention Control: A Cornerstone of Higher-Order Cognition

The Temporal Dynamics of Attention: Thinking about Oneself Comes at a Cost in Sub-Clinical Depression but Not in Healthy Participants

The Power of Attention: Using Eye Gaze to Predict Other-Regarding and Moral Choices

Online Independent Versus Laboratory-Based Stop-Signal Task Performance: A Within-Subjects Counterbalanced Comparison Study (Preprint)