Abstract:When we see a human sitting down, standing up, or walking, we can recognize one of these poses independently of the individual, or we can recognize the individual person, independently of the pose. The same issues arise for deforming objects. For example, if we see a flag deformed by the wind, either blowing out or hanging languidly, we can usually recognize the flag, independently of its deformation; or we can recognize the deformation independently of the identity of the flag. We hypothesize that these types of recognition can be implemented by the primate visual system using temporo-spatial continuity as objects transform as a learning principle. In particular, we hypothesize that pose or deformation can be learned under conditions in which large numbers of different people are successively seen in the same pose, or objects in the same deformation. We also hypothesize that person-specific representations that are independent of pose, and object-specific representations that are independent of deformation and view, could be built, when individual people or objects are observed successively transforming from one pose or deformation and view to another. These hypotheses were tested in a simulation of the ventral visual system, VisNet, that uses temporal continuity, implemented in a synaptic learning rule with a short-term memory trace of previous neuronal activity, to learn invariant representations. It was found that depending on the statistics of the visual input, either pose-specific or deformation-specific representations could be built that were invariant with respect to individual and view; or that identity-specific representations could be built that were invariant with respect to pose or deformation and view. We propose that this is how pose-specific and pose-invariant, and deformation-specific and deformation-invariant, perceptual representations are built in the brain.

Visualizing and Understanding Vision System

Rethinking Visual Reconstruction: Experience-Based Content Completion Guided by Visual Cues

Invariant Visual Object and Face Recognition: Neural and Computational Bases, and a Model, VisNet

Seeing eye-to-eye? A comparison of object recognition performance in humans and deep convolutional neural networks under image manipulation

Towards Human-Leveled Vision Systems

A Model of Invariant Object Recognition in the Visual System: Learning Rules, Activation Functions, Lateral Inhibition, and Information-Based Performance Measures

Invariant Object Recognition in the Visual System with Novel Views of 3D Objects

Invariant Visual Object Recognition: Biologically Plausible Approaches

Object recognition by artificial cortical maps

Invariant face and object recognition in the visual system.

Image Feature Extraction and Object Recognition Based on Vision Neural Mechanism

Transform-Invariant Recognition by Association in a Recurrent Network

Vision at A Glance: Interplay between Fine and Coarse Information Processing Pathways

Recurrent issues with deep neural networks of visual recognition

Learning Transform Invariant Object Recognition in the Visual System with Multiple Stimuli Present During Training.

VBNet: A Visually-Aware Biomimetic Network for Simulating the Human Eye's Visual System

Unraveling Neural Coding of Dynamic Natural Visual Scenes Via Convolutional Recurrent Neural Networks.

A Model of Invariant Object Recognition in the Visual System

Deformation-specific and Deformation-Invariant Visual Object Recognition: Pose Vs. Identity Recognition of People and Deforming Objects.

Brain-inspired Models for Visual Object Recognition: an Overview

RNCIR: Retinal Neuron Coding-Based Image Recognition