Visual encoding and fixation target selection in free viewing: presaccadic brain potentials

Andrey R. Nikolaev,Peter Jurica,Chie Nakatani,Gijs Plomp,Cees van Leeuwen

DOI: https://doi.org/10.3389/fnsys.2013.00026

2013-01-01

Frontiers in Systems Neuroscience

Abstract:In scrutinizing a scene, the eyes alternate between fixations and saccades. During a fixation, two component processes can be distinguished: visual encoding and selection of the next fixation target. We aimed to distinguish the neural correlates of these processes in the electrical brain activity prior to a saccade onset. Participants viewed color photographs of natural scenes, in preparation for a change detection task. Then, for each participant and each scene we computed an image heat map, with temperature representing the duration and density of fixations. The temperature difference between the start and end points of saccades was taken as a measure of the expected task-relevance of the information concentrated in specific regions of a scene. Visual encoding was evaluated according to whether subsequent change was correctly detected. Saccades with larger temperature difference were more likely to be followed by correct detection than ones with smaller temperature differences. The amplitude of presaccadic activity over anterior brain areas was larger for correct detection than for detection failure. This difference was observed for short "scrutinizing" but not for long "explorative" saccades, suggesting that presaccadic activity reflects top-down saccade guidance. Thus, successful encoding requires local scanning of scene regions which are expected to be task-relevant. Next, we evaluated fixation target selection. Saccades "moving up" in temperature were preceded by presaccadic activity of higher amplitude than those "moving down". This finding suggests that presaccadic activity reflects attention deployed to the following fixation location. Our findings illustrate how presaccadic activity can elucidate concurrent brain processes related to the immediate goal of planning the next saccade and the larger-scale goal of constructing a robust representation of the visual scene.

neurosciences

What problem does this paper attempt to address?

This paper attempts to address the question of how neural correlates of visual encoding and the selection of the next fixation point are reflected in EEG activity during free-viewing scenes. Specifically, the researchers aim to distinguish these two processes by analyzing brain electrical activity before saccades and to explore how these processes relate to task-relevant information extraction and attention allocation.

### Main Issues:
1. **Visual Encoding**: The researchers aim to understand how the brain encodes visual information during fixation, particularly whether brain electrical activity before saccades can predict subsequent performance in visual change detection tasks.
2. **Selection of the Next Fixation Point**: The researchers aim to understand how the brain selects the next fixation point, particularly whether brain electrical activity before saccades reflects attention allocation to the next fixation point.

### Research Methods:
- **Experimental Design**: Participants viewed photographs of natural scenes and reported changes in a subsequent visual change detection task.
- **Data Collection**: Eye movement data were recorded using an eye tracker, and brain electrical activity was recorded using EEG.
- **Data Analysis**: By calculating fixation heatmaps for each scene, the temperature differences before and after saccades were analyzed, as well as the relationship between these differences and task performance.

### Key Findings:
- **Visual Encoding**: When the amplitude of brain electrical activity in the prefrontal region was higher before saccades, participants were more likely to correctly detect visual changes. This effect was more pronounced during short "careful observation" saccades and less so during long "exploratory" saccades.
- **Selection of the Next Fixation Point**: Saccades with temperature increases (i.e., saccades from low-temperature regions to high-temperature regions) had higher amplitudes of brain electrical activity before saccades, indicating that the brain had already allocated attention to the next fixation point before the saccade.

### Conclusion:
By analyzing brain electrical activity before saccades, this study reveals the neural mechanisms of visual encoding and the selection of the next fixation point. These findings contribute to understanding how the brain efficiently processes visual information and allocates attention during free-viewing scenes.