Abstract:Recently, many biologically inspired visual computational models have been proposed. The design of these models follows the related biological mechanisms and structures, and these models provide new solutions for visual recognition tasks. In this paper, based on the recent biological evidence, we propose a framework to mimic the active and dynamic learning and recognition process of the primate visual cortex. From principle point of view, the main contributions are that the framework can achieve unsupervised learning of episodic features (including key components and their spatial relations) and semantic features (semantic descriptions of the key components), which support higher level cognition of an object. From performance point of view, the advantages of the framework are as follows: 1) learning episodic features without supervision-for a class of objects without a prior knowledge, the key components, their spatial relations and cover regions can be learned automatically through a deep neural network (DNN); 2) learning semantic features based on episodic features-within the cover regions of the key components, the semantic geometrical values of these components can be computed based on contour detection; 3) forming the general knowledge of a class of objects-the general knowledge of a class of objects can be formed, mainly including the key components, their spatial relations and average semantic values, which is a concise description of the class; and 4) achieving higher level cognition and dynamic updating-for a test image, the model can achieve classification and subclass semantic descriptions. And the test samples with high confidence are selected to dynamically update the whole model. Experiments are conducted on face images, and a good performance is achieved in each layer of the DNN and the semantic description learning process. Furthermore, the model can be generalized to recognition tasks of other objects with learning ability.

Learning V1 Simple Cells with Vector Representation of Local Content and Matrix Representation of Local Motion

Learning vector representation of local content and matrix representation of local motion, with implications for V1

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Motion Feature Extraction of Random-Dot Video Sequences with the Visual Cortex Mechanism

Adaptive V1-MT Model for Motion Perception

Learning Grid Cells as Vector Representation of Self-Position Coupled with Matrix Representation of Self-Motion

Optical Flow Calculating Method Based on Multi-scale V1-MT Feedforward Model

Development of Invariant Feature Maps Via a Computational Model of Simple and Complex Cells.

Grid Cell Modeling with Mapping Representation of Self-Motion for Path Integration

Human Action Recognition by Imitating the Simple Cells of Visual Cortex

Learning Spatially Variant Linear Representation Models for Joint Filtering

A Computational Model of Early Vision Based on Synchronized Response and Inner Product Operation.

Hebbian-based Mean Shift for Learning the Diverse Shapes of V1 Simple Cell Receptive Fields

Learning intermediate-level representations of form and motion from natural movies

Emergence of Complex-Like Cells in a Temporal Product Network with Local Receptive Fields

Computational Model of Primary Visual Cortex Combining Visual Attention for Action Recognition

Learning Topographic Representations of Nature Images with Pairwise Cumulant.

Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis

Biologically Inspired Model for Visual Cognition Achieving Unsupervised Episodic and Semantic Feature Learning.

A Computational Model That Realizes a Sparse Representation of the Primary Visual Cortex V1

Modelling Human Visual Motion Processing with Trainable Motion Energy Sensing and a Self-attention Network