Abstract:Recently, many biologically inspired visual computational models have been proposed. The design of these models follows the related biological mechanisms and structures, and these models provide new solutions for visual recognition tasks. In this paper, based on the recent biological evidence, we propose a framework to mimic the active and dynamic learning and recognition process of the primate visual cortex. From principle point of view, the main contributions are that the framework can achieve unsupervised learning of episodic features (including key components and their spatial relations) and semantic features (semantic descriptions of the key components), which support higher level cognition of an object. From performance point of view, the advantages of the framework are as follows: 1) learning episodic features without supervision-for a class of objects without a prior knowledge, the key components, their spatial relations and cover regions can be learned automatically through a deep neural network (DNN); 2) learning semantic features based on episodic features-within the cover regions of the key components, the semantic geometrical values of these components can be computed based on contour detection; 3) forming the general knowledge of a class of objects-the general knowledge of a class of objects can be formed, mainly including the key components, their spatial relations and average semantic values, which is a concise description of the class; and 4) achieving higher level cognition and dynamic updating-for a test image, the model can achieve classification and subclass semantic descriptions. And the test samples with high confidence are selected to dynamically update the whole model. Experiments are conducted on face images, and a good performance is achieved in each layer of the DNN and the semantic description learning process. Furthermore, the model can be generalized to recognition tasks of other objects with learning ability.

Complex Sequential Understanding Through the Awareness of Spatial and Temporal Concepts

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

A Spiking Neural Network System for Robust Sequence Recognition

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Sequential Segment Networks for Action Recognition

A Sequential Neural Encoder with Latent Structured Description for Modeling Sentences.

Capturing the Spatio-Temporal Continuity for Video Semantic Segmentation.

Spatial-Temporal Multi-Cue Network for Continuous Sign Language Recognition

Continual Neural Mapping: Learning an Implicit Scene Representation from Sequential Observations

A Spatial–Channel–Temporal-Fused Attention for Spiking Neural Networks

Towards Neuro-Symbolic Video Understanding

Dual temporal memory network with high-order spatio-temporal graph learning for video object segmentation

Continuous Online Sequence Learning with an Unsupervised Neural Network Model

SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models

Biologically Inspired Model for Visual Cognition Achieving Unsupervised Episodic and Semantic Feature Learning.

Sequential Video VLAD: Training the Aggregation Locally and Temporally

Deep RNN Framework for Visual Sequential Applications

Learning Spatial and Temporal Information with Complex-Valued Operation for High-Performance of Spiking Neural Networks