Abstract:An ongoing challenge in neural information processing is the following question: how do neurons adjust their connectivity to improve network-level task performance over time (i.e., actualize learning)? It is widely believed that there is a consistent, synaptic-level learning mechanism in specific brain regions, such as the basal ganglia, that actualizes learning. However, the exact nature of this mechanism remains unclear. Here, we investigate the use of universal synaptic-level algorithms in training connectionist models. Specifically, we propose an algorithm based on reinforcement learning (RL) to generate and apply a simple biologically-inspired synaptic-level learning policy for neural networks. In this algorithm, the action space for each synapse in the network consists of a small increase, decrease, or null action on the connection strength. To test our algorithm, we applied it to a multilayer perceptron (MLP) neural network model. This algorithm yields a static synaptic learning policy that enables the simultaneous training of over 20,000 parameters (i.e., synapses) and consistent learning convergence when applied to simulated decision boundary matching and optical character recognition tasks. The trained networks yield character-recognition performance comparable to identically shaped networks trained with gradient descent. The approach has two significant advantages in comparison to traditional gradient-descent-based optimization methods. First, the robustness of our novel method and its lack of reliance on gradient computations opens the door to new techniques for training difficult-to-differentiate artificial neural networks, such as spiking neural networks (SNNs) and recurrent neural networks (RNNs). Second, the method’s simplicity provides a unique opportunity for further development of local information-driven multiagent connectionist models for machine intelligence analogous to cellular automata.

Training dynamically balanced excitatory-inhibitory networks

Biologically-Informed Excitatory and Inhibitory Balance for Robust Spiking Neural Network Training

Approximating Nonlinear Functions With Latent Boundaries in Low-Rank Excitatory-Inhibitory Spiking Networks

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Modeling and Contractivity of Neural-Synaptic Networks with Hebbian Learning

Balanced Networks of Spiking Neurons with Spatially Dependent Recurrent Connections

A robust balancing mechanism for spiking neural networks

Excitation-Inhibition Balanced Spiking Neural Networks for Fast Information Processing

A biophysical model of dynamic balancing of excitation and inhibition in fast oscillatory large-scale networks

Balanced Excitation and Inhibition are Required for High-Capacity, Noise-Robust Neuronal Selectivity

The brain as an efficient and robust adaptive learner

Synaptic Plasticity in Correlated Balanced Networks

A Theory of Synaptic Neural Balance: From Local to Global Order

Gradient-Free Neural Network Training via Synaptic-Level Reinforcement Learning

Emergence of a Balanced Core through Dynamical Competition in Heterogeneous Neuronal Networks

Transient amplification in balanced neural networks

Emergence of Irregular Activity in Networks of Strongly Coupled Conductance-Based Neurons

Memory Storage and Retrieval in Sparsely Connected Balanced Networks

Learning recurrent dynamics in spiking networks

A probabilistic model for learning in cortical microcircuit motifs with data-based divisive inhibition