Abstract:Traditionally, vision has been seen to comprise low-level, mid-level, and high-level processes. To make computational tasks explicit and highlight the central role of visual attention, I propose to view vision as having the encoding, selection, and decoding stages. These three stages do not correspond to the low-level, mid-level, and high-level vision, although the encoding stage dominates in low-level vision. At encoding, representation of visual information is transformed for some purposes, e.g., photoreceptor signals are transformed to retinal ganglion responses, such that a maximum amount of input information is sent to the brain while limiting the cost on neural resources (e.g., information bandwidth at the optic nerve). At selection, a tiny fraction of visual information is admitted into the attentional bottleneck for detailed processing. For example, a spatial location is selected through a saccade towards it for scrutiny, while information at other locations are downplayed or deleted. Selection can be exogeneous when a saliency map created in the primary visual cortex (V1) guides selection by its monosynaptic projection to the superior colliculus (SC) which executes saccades. Selection can also be endogenous when, e.g., the knowledge about the location of our book guides our gaze, controlled largely by frontal and parietal brain areas which also project to SC. At decoding, properties of visual scenes, e.g., the identity and movement of an object, are inferred to become our perception and aid our movements, from a combination of the information admitted to the attentional bottleneck and internal knowledge or expectation of the visual environment. In the first approximation, encoding, selection, and decoding stages are assumed to occur consecutively along the visual pathway. Hence, exogeneous selection by V1 suggests decoding and endogenous selection by extrastriate cortices. However, feedback between stages, especially between selection and decoding, are expected to enable process iterations to improve vision. Meeting abstract presented at VSS 2014

Peripheral Vision is Mainly for Looking Rather Than Seeing.

Feedback from higher to lower visual areas for visual recognition may be weaker in the periphery: Glimpses from the perception of brief dichoptic stimuli.

A new framework for understanding vision from the perspective of the primary visual cortex

Peripheral vision contributes to implicit attentional learning: Findings from the "mouse-eye" paradigm

Peripheral and central sensation: multisensory orienting and recognition across species.

Peripheral vision in real-world tasks: A systematic review

Investigating Cultural Diversity for Extrafoveal Information Use in Visual Scenes.

Looking with or without seeing in an individual with age-related macular degeneration impairing central vision

Out of the corner of the driver's eye: Peripheral processing of hazards in static traffic scenes

The Flip Tilt Illusion: Visible in Peripheral Vision As Predicted by the Central-Peripheral Dichotomy

Central and peripheral vision for scene recognition: A neurocomputational modeling exploration

Spatial frequency processing in the central and peripheral visual field during scene viewing

Vision As a Three-Stage Process: Encoding, Selection, and Decoding

Interaction between central and peripheral vision: Influence of distance and spatial frequencies

Peripheral Vision Transformer

Modeling peripheral vision for moving target search and detection

Measurements and Clinical Applications of Peripheral Vision

Cortical Reorganization of Peripheral Vision Induced by Simulated Central Vision Loss

Identification of peripheral visual images in a laterally restricted gaze field

Distinct visual processing networks for foveal and peripheral visual fields

Seeing on the fly: Physiological and behavioral evidence show that space-to-space representation and processing enable fast and efficient performance by the visual system