Abstract:It is known that humans and animals can learn and utilize category information quickly and efficiently to adapt to changing environments, and several brain areas are involved in learning and encoding category information. However, it is unclear that how the brain system learns and forms categorical representations from the view of neural circuits. In order to investigate this issue from the network level, we combine a recurrent neural network with reinforcement learning to construct a deep reinforcement learning model to demonstrate how the category is learned and represented in the network. The model consists of a policy network and a value network. The policy network is responsible for updating the policy to choose actions, while the value network is responsible for evaluating the action to predict rewards. The agent learns dynamically through the information interaction between the policy network and the value network. This model was trained to learn six stimulus-stimulus associative chains in a sequential paired-association task that was learned by the monkey. The simulated results demonstrated that our model was able to learn the stimulus-stimulus associative chains, and successfully reproduced the similar behavior of the monkey performing the same task. Two types of neurons were found in this model: one type primarily encoded identity information about individual stimuli; the other type mainly encoded category information of associated stimuli in one chain. The two types of activity-patterns were also observed in the primate prefrontal cortex after the monkey learned the same task. Furthermore, the ability of these two types of neurons to encode stimulus or category information was enhanced during this model was learning the task. Our results suggest that the neurons in the recurrent neural network have the ability to form categorical representations through deep reinforcement learning during learning stimulus-stimulus associations. It might provide a new approach for understanding neuronal mechanisms underlying how the prefrontal cortex learns and encodes category information.

Modeling Neural Representation of Social Recognition Information with Recurrent Neural Networks

Recurrent neural networks as neuro-computational models of human speech recognition

A prefrontal-thalamic circuit encodes social information for social recognition

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

An Explainable and Generalizable Recurrent Neural Network Approach for Differentiating Human Brain States on EEG Dataset

Characterising representation dynamics in recurrent neural networks for object recognition

Character Recognition from Trajectory by Recurrent Spiking Neural Networks

Spiking Neural Networks Based Cortex Like Mechanism: A Case Study for Facial Expression Recognition

A Spiking Neural Network System for Robust Sequence Recognition

From Regional to Global Brain: A Novel Hierarchical Spatial-Temporal Neural Network Model for EEG Emotion Recognition

A Spiking Neural Network Based Cortex-Like Mechanism and Application to Facial Expression Recognition

Brain-inspired Computational Modeling of Action Recognition with Recurrent Spiking Neural Networks Equipped with Reinforcement Delay Learning

Multi-Net Fusion: Exploring a Brain-Inspired Neural Network Model for Facial Expression Recognition

An Ensemble Unsupervised Spiking Neural Network for Objective Recognition

Category Learning in a Recurrent Neural Network with Reinforcement Learning.

Spatiotemporal Information Processing with a Reservoir Decision-making Network

On the modeling of neural cognition for social network applications

Identifying Brain Networks at Multiple Time Scales via Deep Recurrent Neural Network

Spatial-Temporal Recurrent Neural Network for Emotion Recognition

Dynamic Spatiotemporal Pattern Recognition with Recurrent Spiking Neural Network

Application of Convolutional Recurrent Neural Network for Individual Recognition Based on Resting State Fmri Data.