Abstract:Objective: To date the vast majority of research in the visual neurosciences have been forced to adopt a highly constrained perspective of the vision system in which stimuli are processed in an open-loop reactive fashion (i.e., abrupt stimulus presentation followed by an evoked neural response). While such constraints enable high construct validity for neuroscientific investigation, the primary outcomes have been a reductionistic approach to isolate the component processes of visual perception. In electrophysiology, of the many neural processes studied under this rubric, the most well-known is, arguably, the P300 evoked response. There is, however, relatively little known about the real-world corollary of this component in free-viewing paradigms where visual stimuli are connected to neural function in a closed-loop. While growing evidence suggests that neural activity analogous to the P300 does occur in such paradigms, it is an open question when this response occurs and what behavioral or environmental factors could be used to isolate this component. Approach: The current work uses convolutional networks to decode neural signals during a free-viewing visual search task in a closed-loop paradigm within an open-world virtual environment. From the decoded activity we construct fixation-locked response profiles that enable estimations of the variable latency of any P300 analogue around the moment of fixation. We then use these estimates to investigate which factors best reduce variable latency and, thus, predict the onset time of the response. We consider measurable, search-related factors encompassing top-down (i.e., goal driven) and bottom-up (i.e., stimulus driven) processes, such as fixation duration and salience. We also consider saccade size as an intermediate factor reflecting the integration of these two systems. Main results: The results show that of these factors only saccade size reliably determines the onset time of P300 analogous activity for this task. Specifically, we find that for large saccades the variability in response onset is small enough to enable analysis using traditional ensemble averaging methods. Significance: The results show that P300 analogous activity does occur during closed-loop, free-viewing visual search while highlighting distinct differences between the open-loop version of this response and its real-world analogue. The results also further establish saccades, and saccade size, as a key factor in real-world visual processing.

Compression of time in double-step saccades

Attention Does Not Play a Role in Chronostasis Effect

Time Compression Induced by Voluntary-Action and Its Underlying Mechanism: the Role of Eye Movement in Intentional Binding (IB)

Effects of post-saccadic oscillations on visual processing times

The effects of post‐saccadic oscillations on visual processing time

Situational Context is Important: Perceptual Grouping Modulates Temporal Perception

Sound reduces saccadic chronostasis illusion

Planning of saccadic eye movements in an evaluation task

Eccentricity-Dependent Saccadic Reaction Time: The Roles of Foveal Magnification and Attentional Orienting

Early visual modulation and selection predict saccadic timing during visual search: An ERP study

Saccade size predicts onset time of object processing during visual search of an open world virtual environment

Effects of cerebellar disease on sequences of rapid eye movements

Physiological correlates of a simple saccadic-decision task to extended objects in superior colliculus

Modulations of Temporal Perception by Consciously and Unconsciously Perceived Stimuli

Working memory capacity for continuous events: The root of temporal compression in episodic memory?

Common structure of saccades and microsaccades in visual perception.

Naïve theories of causal force and compression of elapsed time judgments.

Evidence for five types of fixation during a random saccade eye tracking task and changes in fixation duration as a function of time-on-task

Same principle, but different computations in representing time and space

A comparison of the temporal and spatial properties of trans-saccadic perceptual recalibration and saccadic adaptation

Gaze-Triggered Communicative Intention Compresses Perceived Temporal Duration