Abstract:The human visual system has a hierarchical structure consisting of layers of processing, such as the retina, V1, V2, etc. Understanding the functional roles of these visual processing layers would help to integrate the psychophysiological and neurophysiological models into a consistent theory of human vision, and would also provide insights to computer vision research. One classical theory of the early visual pathway hypothesizes that it serves to capture the statistical structure of the visual inputs by efficiently coding the visual information in its outputs. Until recently, most computational models following this theory have focused upon explaining the receptive field properties of one or two visual layers. Recent work in deep networks has eliminated this concern, however, there is till the retinal layer to consider. Here we improve on a previously-described hierarchical model Recursive ICA (RICA) [1] which starts with PCA, followed by a layer of sparse coding or ICA, followed by a component-wise nonlinearity derived from considerations of the variable distributions expected by ICA. This process is then repeated. In this work, we improve on this model by using a new version of sparse PCA (sPCA), which results in biologically-plausible receptive fields for both the sPCA and ICA/sparse coding. When applied to natural image patches, our model learns visual features exhibiting the receptive field properties of retinal ganglion cells/lateral geniculate nucleus (LGN) cells, V1 simple cells, V1 complex cells, and V2 cells. Our work provides predictions for experimental neuroscience studies. For example, our result suggests that a previous neurophysiological study improperly discarded some of their recorded neurons; we predict that their discarded neurons capture the shape contour of objects.

Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding

Perceptual Integration Rapidly Activates Dorsal Visual Pathway to Guide Local Processing in Early Visual Areas

Integration of eye-centered and landmark-centered codes in frontal eye field gaze responses

Self-Calibrating Active Binocular Vision via Active Efficient Coding with Deep Autoencoders

Near-optimal combination of disparity across a log-polar scaled visual field

Vector disparity sensor with vergence control for active vision systems

Efficient Visual Coding: From Retina To V2

Fast feature- and category-related parafoveal previewing support natural visual exploration

Active Visual Computing Model Based on Data- and Knowledge-Driven Selective Attention Mechanism.

Distinct visual processing networks for foveal and peripheral visual fields

Neural circuits for binocular vision: Ocular dominance, interocular matching, and disparity selectivity

Processing Real-World Imagery with FACADE-based Approaches

Vergence Eye Movement with Prediction and Learning Based on Dual Visual-Local Feedback

A Perceptual Model for Eccentricity-dependent Spatio-temporal Flicker Fusion and its Applications to Foveated Graphics

A comparative study of stereo, vergence, and focus as depth cues for active vision

Active Vision in Binocular Depth Estimation: A Top-Down Perspective

Design and Simulation of a Hierarchical Parallel Distributed Processing Model for Orientation Selection Based on Primary Visual Cortex

A Spatial Temporal Integration Model of Primary Visual Cortex Concerning Directional Selectivity

Learning to segment self-generated from externally caused optic flow through sensorimotor mismatch circuits

Sub-cone visual resolution by active, adaptive sampling in the human foveola

Active Gaze Control for Foveal Scene Exploration