Abstract:Experimental evidence indicates that neurophysiological responses to well-known meaningful sensory items and symbols (such as familiar objects, faces, or words) differ from those to matched but novel and senseless materials (unknown objects, scrambled faces, and pseudowords). Spectral responses in the high beta- and gamma-band have been observed to be generally stronger to familiar stimuli than to unfamiliar ones. These differences have been hypothesized to be caused by the activation of distributed neuronal circuits or cell assemblies, which act as long-term memory traces for learned familiar items only. Here, we simulated word learning using a biologically constrained neurocomputational model of the left-hemispheric cortical areas known to be relevant for language and conceptual processing. The 12-area spiking neural-network architecture implemented replicates physiological and connectivity features of primary, secondary, and higher-association cortices in the frontal, temporal, and occipital lobes of the human brain. We simulated elementary aspects of word learning in it, focussing specifically on semantic grounding in action and perception. As a result of spike-driven Hebbian synaptic plasticity mechanisms, distributed, stimulus-specific cell-assembly (CA) circuits spontaneously emerged in the network. After training, presentation of one of the learned "word" forms to the model correlate of primary auditory cortex induced periodic bursts of activity within the corresponding CA, leading to oscillatory phenomena in the entire network and spontaneous across-area neural synchronization. Crucially, Morlet wavelet analysis of the network's responses recorded during presentation of learned meaningful "word" and novel, senseless "pseudoword" patterns revealed stronger induced spectral power in the gamma-band for the former than the latter, closely mirroring differences found in neurophysiological data. Furthermore, coherence analysis of the simulated responses uncovered dissociated category specific patterns of synchronous oscillations in distant cortical areas, including indirectly connected primary sensorimotor areas. Bridging the gap between cellular-level mechanisms, neuronal-population behavior, and cognitive function, the present model constitutes the first spiking, neurobiologically, and anatomically realistic model able to explain high-frequency oscillatory phenomena indexing language processing on the basis of dynamics and competitive interactions of distributed cell-assembly circuits which emerge in the brain as a result of Hebbian learning and sensorimotor experience.

Word Learning by a Extended BAM Network

Neural Substrate Underlying the Learning of a Passage with Unfamiliar Vocabulary and Syntax.

Optimal learning algorithm in bidirectional associative memories

Designing Bidirectional Associative Memories with Optimal Stability

Weighted Learning of Bidirectional Associative Memories by Global Minimization

A Novel BN Learning Algorithm Based on Block Learning Strategy

Bidirectional Associative Memory Utilizing Maximum Likelihood

A Neural Network Architecture for Learning Word-Referent Associations in Multiple Contexts

An Adaptive Wordpiece Language Model For Learning Chinese Word Embeddings

A robust learning algorithm for the extended AM neural network

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

Bi-directional Reasoning Based on BAM Neural Networks

KNET: A General Framework for Learning Word Embedding using Morphological Knowledge

Word Alignment Modeling with Context Dependent Deep Neural Network.

A Spiking Neurocomputational Model of High-Frequency Oscillatory Brain Responses to Words and Pseudowords

Optimum associative neural network utilizing maximum likelihood

Learning Effective Word Embedding Using Morphological Word Similarity

A New Method Of Learning Bayesian Networks Structures From Incomplete Data

BAM: Bottleneck Attention Module

Asymmetric Bidirectional Associative Memories.

Learning Word Representation Considering Proximity and Ambiguity