Abstract:First, neurophysiological evidence for the learning of invariant representations in the inferior temporal visual cortex is described. This includes object and face representations with invariance for position, size, lighting, view and morphological transforms in the temporal lobe visual cortex; global object motion in the cortex in the superior temporal sulcus; and spatial view representations in the hippocampus that are invariant with respect to eye position, head direction, and place. Second, computational mechanisms that enable the brain to learn these invariant representations are proposed. For the ventral visual system, one key adaptation is the use of information available in the statistics of the environment in slow unsupervised learning to learn transform-invariant representations of objects. This contrasts with deep supervised learning in artificial neural networks, which uses training with thousands of exemplars forced into different categories by neuronal teachers. Similar slow learning principles apply to the learning of global object motion in the dorsal visual system leading to the cortex in the superior temporal sulcus. The learning rule that has been explored in VisNet is an associative rule with a short-term memory trace. The feed-forward architecture has four stages, with convergence from stage to stage. This type of slow learning is implemented in the brain in hierarchically organized competitive neuronal networks with convergence from stage to stage, with only 4-5 stages in the hierarchy. Slow learning is also shown to help the learning of coordinate transforms using gain modulation in the dorsal visual system extending into the parietal cortex and retrosplenial cortex. Representations are learned that are in allocentric spatial view coordinates of locations in the world and that are independent of eye position, head direction, and the place where the individual is located. This enables hippocampal spatial view cells to use idiothetic, self-motion, signals for navigation when the view details are obscured for short periods.

Continuous Transformation Learning of Translation Invariant Representations

Learning Invariant Object Recognition in the Visual System with Continuous Transformations

Spatial vs temporal continuity in view invariant visual object recognition learning.

Learning Transform Invariant Object Recognition in the Visual System with Multiple Stimuli Present During Training.

Learning Invariant Responses to the Natural Transformations of Objects

Invariant Object Recognition with Trace Learning and Multiple Stimuli Present During Training

Learning Invariant Object and Spatial View Representations in the Brain Using Slow Unsupervised Learning

Spatial Scene Representations Formed by Self‐organizing Learning in a Hippocampal Extension of the Ventral Visual System

Invariant Object Recognition in the Visual System with Novel Views of 3D Objects

Invariant visual object recognition: A model, with lighting invariance

Continuous image anomaly detection based on contrastive lifelong learning

Look-Ahead Selective Plasticity for Continual Learning of Visual Tasks

The human visual system and CNNs can both support robust online translation tolerance following extreme displacements

Transform-Invariant Recognition by Association in a Recurrent Network

Learning Spatially Structured Image Transformations Using Planar Neural Networks

Exemplar-free Continual Learning of Vision Transformers via Gated Class-Attention and Cascaded Feature Drift Compensation

Continually Learn to Map Visual Concepts to Large Language Models in Resource-constrained Environments

Invariant recognition of feature combinations in the visual system

Continual Neural Mapping: Learning an Implicit Scene Representation from Sequential Observations

Continuous Spatiotemporal Transformers

Learning mechanisms in the temporal lobe visual cortex