Abstract:Synaptic plasticity dynamically shapes the connectivity of neural systems and is key to learning processes in the brain. To what extent the mechanisms of plasticity can be exploited to drive a neural network and make it perform some kind of computational task remains unclear. This question, relevant in a bioengineering context, can be formulated as a control problem on a high-dimensional system with strongly constrained and non-linear dynamics. We present a self-contained procedure which, through appropriate spatio-temporal stimulations of the neurons, is able to drive rate-based neural networks with arbitrary initial connectivity towards a desired functional state. We illustrate our approach on two different computational tasks: a non-linear association between multiple input stimulations and activity patterns (representing digit images), and the construction of a continuous attractor encoding a collective variable in a neural population. Our work thus provides a proof of principle for emerging paradigms of in vitro computation based on real neurons.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the ability to complete specific computational tasks through stimulation - induced plasticity in neural networks. Specifically, the author explores how to utilize the plasticity mechanisms of biological neuron circuits, through appropriate spatio - temporal stimulation, to enable these circuits to perform predetermined computational tasks. This problem is particularly important in the context of bioengineering, as it involves how to design and control neural networks to achieve advanced computational functions. ### Main problems 1. **How to train biological neuron circuits to perform specific computational tasks?** - The paper proposes a method to drive rate - based neural networks through appropriate spatio - temporal stimulation, making them transform from an arbitrary initial connection state to a desired functional state. 2. **How to overcome the learning limitations in biological neural networks?** - The learning dynamics of biological neural networks are severely restricted. Unlike artificial neural networks, the learning dynamics cannot be arbitrarily selected. The paper proposes an optimization method to gradually adjust network connections by controlling stimulation, thereby achieving the required tasks. ### Specific tasks 1. **Non - linear association task**: - Task definition: Input neurons are stimulated in different ways, and each input stimulus should cause a specific activity pattern of output neurons. These patterns are represented as digital images. - Challenge: The task is non - linear and cannot be achieved by a simple linear network. In addition, there is no direct connection between input and output neurons, and information must be transmitted through an intermediate processing area. 2. **Continuous attractor dynamics**: - Task definition: Reshape network connections to make them support a ring - shaped attractor that can encode continuously changing angles. - Challenge: Precise control of network connections is required to form a specific ring - shaped structure that can maintain the "bump" position of activity under the guidance of external input. ### Method overview 1. **Network connection estimation**: - Estimate the current network connection state \( J_k \) by quickly probing the network's response to random stimuli. 2. **Optimal control calculation**: - Calculate the optimal control stimulus \( f^*_k \) to move the network connection state in the target direction. This step is achieved by solving an optimization problem: \[ f^*_k=\arg\min_f U(J_k + \Delta J(f, \Delta t, J_k)) \] where \( U \) is a loss function, and \( \Delta J(f, \Delta t, J_k) \) is the connection change after applying the stimulus \( f \). 3. **Control - stimulus application**: - Apply the optimal control stimulus \( f^*_k \) for a period of time \( \Delta t \), causing the network to reorganize connections through its inherent plasticity mechanisms. ### Results - **Non - linear association task**: The network has successfully learned to map different input patterns to specific output patterns, exhibiting complex non - linear behavior. - **Continuous attractor dynamics**: The network has successfully formed a ring - shaped attractor and can maintain the "bump" position of activity under the guidance of external input. ### Discussion - **Generality**: This method can be applied to different tasks and plasticity rules (such as Hebbian and anti - Hebbian). - **Computational challenges**: The learning dynamics of biological neural networks are severely restricted, and it is difficult to use an adaptive learning rate. Nevertheless, by increasing the size of the processing area, it is easier to achieve functional goals. In conclusion, this paper provides a proof - of - concept, demonstrating how to train biological neural networks through appropriate control stimuli to enable them to perform complex computational tasks. This research provides an important theoretical and technical foundation for the future development of bio - computing.

Task learning through stimulation-induced plasticity in neural networks

Beyond spiking networks: The computational advantages of dendritic amplification and input segregation

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

The brain as an efficient and robust adaptive learner

Evolving interpretable plasticity for spiking networks

Time-Integrated Spike-Timing-Dependent-Plasticity

Memristive neural network for on-line learning and tracking with brain-inspired spike timing dependent plasticity

Neural Co-Processors for Restoring Brain Function: Results from a Cortical Model of Grasping

Neural connectivity inference with spike-timing dependent plasticity network

Simulation, visualization and analysis tools for pattern recognition assessment with spiking neuronal networks

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Contributions of cortical neuron firing patterns, synaptic connectivity, and plasticity to task performance

Learning by Stimulation Avoidance: A Principle to Control Spiking Neural Networks Dynamics

Cooperation of Spike Timing-Dependent and Heterosynaptic Plasticities in Neural Networks: A Fokker-Planck Approach

Oscillation-Driven Spike-Timing Dependent Plasticity Allows Multiple Overlapping Pattern Recognition in Inhibitory Interneuron Networks

A history of spike-timing-dependent plasticity

Control of synaptic plasticity in neural networks

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

Stimulation-based control of dynamic brain networks

Incorporating structural plasticity into self-organization recurrent networks for sequence learning