Abstract:Recent developments in artificial neural networks and their learning algorithms have enabled new research directions in computer vision, language modeling, and neuroscience. Among various neural network algorithms, spiking neural networks (SNNs) are well-suited for understanding the behavior of biological neural circuits. In this work, we propose to guide the training of a sparse SNN in order to replace a sub-region of a cultured hippocampal network with limited hardware resources. To verify our approach with a realistic experimental setup, we record spikes of cultured hippocampal neurons with a microelectrode array (in vitro). The main focus of this work is to dynamically cut unimportant synapses during SNN training on the fly so that the model can be realized on resource-constrained hardware, e.g., implantable devices. To do so, we adopt a simple STDP learning rule to easily select important synapses that impact the quality of spike timing learning. By combining the STDP rule with online supervised learning, we can precisely predict the spike pattern of the cultured network in real-time. The reduction in the model complexity, i.e., the reduced number of connections, significantly reduces the required hardware resources, which is crucial in developing an implantable chip for the treatment of neurological disorders. In addition to the new learning algorithm, we prototype a sparse SNN hardware on a small FPGA with pipelined execution and parallel computing to verify the possibility of real-time replacement. As a result, we can replace a sub-region of the biological neural circuit within 22 μs using 2.5 × fewer hardware resources, i.e., by allowing 80% sparsity in the SNN model, compared to the fully-connected SNN model. With energy-efficient algorithms and hardware, this work presents an essential step toward real-time neuroprosthetic computation.

A Fully Digital Implementation of A Reward-Modulated STDP Synapse

A Stochastic Approach to STDP

A Reconfigurable Two-WSe2 -Transistor Synaptic Cell for Reinforcement Learning.

A Reconfigurable Two‐WSe 2 ‐Transistor Synaptic Cell for Reinforcement Learning

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

SC-PLR: an Approximate Spiking Neural Network Accelerator with On-Chip Predictive Learning Rule

A Reconfigurable Mixed Signal CMOS Design for Multiple STDP Learning Rules

Reconfigurable Neural Synaptic Plasticity-Based Stochastic Deep Neural Network Computing

A Low-Cost FPGA Implementation of Spiking Extreme Learning Machine with On-Chip Reward-Modulated STDP Learning

Dendritic-Inspired Processing Enables Bio-Plausible STDP in Compound Binary Synapses

A Spike-Event-Based Neuromorphic Processor with Enhanced On-Chip STDP Learning in 28nm CMOS

An Energy Efficient STDP-Based SNN Architecture With On-Chip Learning

Analog Neurons with Dopamine-Modulated STDP

An Area- and Energy-Efficient Spiking Neural Network with Spike-Time-Dependent Plasticity Realized with SRAM Processing-in-Memory Macro and On-Chip Unsupervised Learning.

High-speed, low-power, and configurable on-chip training acceleration platform for spiking neural networks

An Efficient Neuromorphic Implementation of Temporal Coding-Based On-Chip STDP Learning

Circuit Implementation of Spike Time Dependent Plasticity (stdp) for Artificial Synapse

A Neuromorphic VLSI Design for Spike Timing and Rate Based Synaptic Plasticity

A Compact Online-Learning Spiking Neuromorphic Biosignal Processor

Efficient Design of Spiking Neural Network With STDP Learning Based on Fast CORDIC

ReplaceNet: real-time replacement of a biological neural circuit with a hardware-assisted spiking neural network