Abstract:In this research, temporal processing in brain neural circuitries is addressed by a dynamic model of synaptic connections in which the synapse model accounts for both pre- and post-synaptic processes determining its temporal dynamics and strength. Neurons, which are excited by the post-synaptic potentials of hundred of the synapses, build the computational engine capable of processing dynamic neural stimuli. Temporal dynamics in neural models with dynamic synapses will be analyzed, and learning algorithms for synaptic adaptation of neural networks with hundreds of synaptic connections are proposed. The paper starts by introducing a linear approximate model for the temporal dynamics of synaptic transmission. The proposed linear model substantially simplifies the analysis and training of spiking neural networks. Furthermore, it is capable of replicating the synaptic response of the non-linear facilitation-depression model with an accuracy better than 92.5%. In the second part of the paper, a supervised spike-in-spike-out learning rule for synaptic adaptation in dynamic synapse neural networks (DSNN) is proposed. The proposed learning rule is a biologically plausible process, and it is capable of simultaneously adjusting both pre- and post-synaptic components of individual synapses. The last section of the paper starts with presenting the rigorous analysis of the learning algorithm in a system identification task with hundreds of synaptic connections which confirms the learning algorithm's accuracy, repeatability and scalability. The DSNN is utilized to predict the spiking activity of cortical neurons and pattern recognition tasks. The DSNN model is demonstrated to be a generative model capable of producing different cortical neuron spiking patterns and CA1 Pyramidal neurons recordings. A single-layer DSNN classifier on a benchmark pattern recognition task outperforms a 2-Layer Neural Network and GMM classifiers while having fewer numbers of free parameters and decides with a shorter observation of data. DSNN performance in the benchmark pattern recognition problem shows 96.7% accuracy in classifying three classes of spiking activity.

Diluted neural networks with adapting and correlated synapses

An evaluation of the dynamics of diluted neural network

An Evaluation of the Dynamics of Diluted Neural Network.

Effect of dilution in asymmetric recurrent neural networks

Cortical attractor network dynamics with diluted connectivity.

Neural networks with transient state dynamics

Synaptic dynamics: linear model and adaptation algorithm

Adaptation controls synchrony and cluster states of coupled threshold-model neurons

Feed-forward chains of recurrent attractor neural networks with finite dilution near saturation

Sparsely Connected Associative Memory with Adaptive Topology Through Annealed Dilution

Attractor Metadynamics in Adapting Neural Networks

Mean-field approximation for networks with synchrony-driven adaptive coupling

Adaptive nodes enrich nonlinear cooperative learning beyond traditional adaptation by links

Statistical Neurodynamics for Sequence Processing Neural Networks with Finite Dilution

Hybrid Adaptive Synchronization Strategy for Linearly Coupled Reaction–diffusion Neural Networks with Time-Varying Coupling Strength

Modeling and Contractivity of Neural-Synaptic Networks with Hebbian Learning

Synaptic dependence of dynamic regimes when coupling neural populations

Learning may need only a few bits of synaptic precision

Mean-Field Limit of a Stochastic Particle System Smoothly Interacting Through Threshold Hitting-Times and Applications to Neural Networks with Dendritic Component

Adaptive Antisynchronization of Multilayer Reaction–Diffusion Neural Networks

Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics