Abstract:In this research, temporal processing in brain neural circuitries is addressed by a dynamic model of synaptic connections in which the synapse model accounts for both pre- and post-synaptic processes determining its temporal dynamics and strength. Neurons, which are excited by the post-synaptic potentials of hundred of the synapses, build the computational engine capable of processing dynamic neural stimuli. Temporal dynamics in neural models with dynamic synapses will be analyzed, and learning algorithms for synaptic adaptation of neural networks with hundreds of synaptic connections are proposed. The paper starts by introducing a linear approximate model for the temporal dynamics of synaptic transmission. The proposed linear model substantially simplifies the analysis and training of spiking neural networks. Furthermore, it is capable of replicating the synaptic response of the non-linear facilitation-depression model with an accuracy better than 92.5%. In the second part of the paper, a supervised spike-in-spike-out learning rule for synaptic adaptation in dynamic synapse neural networks (DSNN) is proposed. The proposed learning rule is a biologically plausible process, and it is capable of simultaneously adjusting both pre- and post-synaptic components of individual synapses. The last section of the paper starts with presenting the rigorous analysis of the learning algorithm in a system identification task with hundreds of synaptic connections which confirms the learning algorithm's accuracy, repeatability and scalability. The DSNN is utilized to predict the spiking activity of cortical neurons and pattern recognition tasks. The DSNN model is demonstrated to be a generative model capable of producing different cortical neuron spiking patterns and CA1 Pyramidal neurons recordings. A single-layer DSNN classifier on a benchmark pattern recognition task outperforms a 2-Layer Neural Network and GMM classifiers while having fewer numbers of free parameters and decides with a shorter observation of data. DSNN performance in the benchmark pattern recognition problem shows 96.7% accuracy in classifying three classes of spiking activity.

Statistical learning algorithms for dendritic neuron model artificial neural network based on sine cosine algorithm

Winsorized dendritic neuron model artificial neural network and a robust training algorithm with Tukey’s biweight loss function based on particle swarm optimization

A seasonal-trend decomposition-based dendritic neuron model for financial time series prediction

A new deep neural network for forecasting: Deep dendritic artificial neural network

Artificial immune system training algorithm for a dendritic neuron model

Event-driven Spiking Neural Networks with Spike-Based Learning

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Data

A new hybrid recurrent artificial neural network for time series forecasting

Financial Data Modeling using a Hybrid Bayesian Network Structured Learning Algorithm

Optical characterization of chevron texture formation in nematic electroconvection

Heuristic computing with active set method for the nonlinear Rabinovich-Fabrikant model

Synaptic dynamics: linear model and adaptation algorithm

A Novel Sine Cosine Optimization with Stacked Long Short-term Memory-enabled Stock Price Prediction

Multiresolution dendritic cell algorithm for network anomaly detection

Deep learning algorithm for data-driven simulation of noisy dynamical system

Data Simulations Using Cosine and Sigmoid Higher Order Neural Networks

A Dendritic Neuron Model Optimized by Meta-Heuristics with a Power-Law-Distributed Population Interaction Network for Financial Time-Series Forecasting

Neural network stochastic differential equation models with applications to financial data forecasting

Learning maximum entropy models from finite-size data sets: A fast data-driven algorithm allows sampling from the posterior distribution

Financial Data Prediction by Artificial Sine and Cosine Trigonometric Higher Order Neural Networks