Abstract:First, neurophysiological evidence for the learning of invariant representations in the inferior temporal visual cortex is described. This includes object and face representations with invariance for position, size, lighting, view and morphological transforms in the temporal lobe visual cortex; global object motion in the cortex in the superior temporal sulcus; and spatial view representations in the hippocampus that are invariant with respect to eye position, head direction, and place. Second, computational mechanisms that enable the brain to learn these invariant representations are proposed. For the ventral visual system, one key adaptation is the use of information available in the statistics of the environment in slow unsupervised learning to learn transform-invariant representations of objects. This contrasts with deep supervised learning in artificial neural networks, which uses training with thousands of exemplars forced into different categories by neuronal teachers. Similar slow learning principles apply to the learning of global object motion in the dorsal visual system leading to the cortex in the superior temporal sulcus. The learning rule that has been explored in VisNet is an associative rule with a short-term memory trace. The feed-forward architecture has four stages, with convergence from stage to stage. This type of slow learning is implemented in the brain in hierarchically organized competitive neuronal networks with convergence from stage to stage, with only 4-5 stages in the hierarchy. Slow learning is also shown to help the learning of coordinate transforms using gain modulation in the dorsal visual system extending into the parietal cortex and retrosplenial cortex. Representations are learned that are in allocentric spatial view coordinates of locations in the world and that are independent of eye position, head direction, and the place where the individual is located. This enables hippocampal spatial view cells to use idiothetic, self-motion, signals for navigation when the view details are obscured for short periods.

Unsupervised learning on spontaneous retinal activity leads to efficient neural representation geometry

Pre-training artificial neural networks with spontaneous retinal activity improves motion prediction in natural scenes

ReWaRD: Retinal Waves for Pre-Training Artificial Neural Networks Mimicking Real Prenatal Development

A Unified Theory of Early Visual Representations from Retina to Cortex through Anatomically Constrained Deep CNNs

Distinct streams for supervised and unsupervised learning in the visual cortex

Learning Invariant Object and Spatial View Representations in the Brain Using Slow Unsupervised Learning

Unraveling Neural Coding of Dynamic Natural Visual Scenes Via Convolutional Recurrent Neural Networks.

Retinal waves prime visual motion detection by simulating future optic flow

Human Eyes Inspired Recurrent Neural Networks are More Robust Against Adversarial Noises

Learning Spatial Common Sense with Geometry-Aware Recurrent Networks

Human Eyes-Inspired Recurrent Neural Networks Are More Robust Against Adversarial Noises

Spatio-Temporal Adaptation in the Unsupervised Development of Networked Visual Neurons

Revealing structure components of the retina by deep learning networks

Revealing Fine Structures of the Retinal Receptive Field by Deep-Learning Networks

Adaptation of retinal discriminability to natural scenes

Efficient Visual Coding: From Retina To V2

Saliency Suppressed, Semantics Surfaced: Visual Transformations in Neural Networks and the Brain

EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbones.

3D View Prediction Models of the Dorsal Visual Stream

A Visually Inspired Computational Model for Recognition of Optic Flow

Self-Supervised Learning from Unlabeled Fundus Photographs Improves Segmentation of the Retina