Abstract:In this work, we propose time-integrated spike-timing-dependent plasticity (TI-STDP), a mathematical model of synaptic plasticity that allows spiking neural networks to continuously adapt to sensory input streams in an unsupervised fashion. Notably, we theoretically establish and formally prove key properties related to the synaptic adjustment mechanics that underwrite TI-STDP. Empirically, we demonstrate the efficacy of TI-STDP in simulations of jointly learning deeper spiking neural networks that process input digit pixel patterns, at both full image and patch-levels, comparing to two powerful historical instantations of STDP; trace-based STDP (TR-STDP) and event-based post-synaptic STDP (EV-STDP). Usefully, we demonstrate that not only are all forms of STDP capable of meaningfully adapting the synaptic efficacies of a multi-layer biophysical architecture, but that TI-STDP is notably able to do so without requiring the tracking of a large window of pre- and post-synaptic spike timings, the maintenance of additional parameterized traces, or the restriction of synaptic plasticity changes to occur within very narrow windows of time. This means that our findings show that TI-STDP can efficiently embody the benefits of models such as canonical STDP, TR-STDP, and EV-STDP without their costs or drawbacks. Usefully, our results further demonstrate the promise of using a spike-correlation scheme such as TI-STDP in conducting credit assignment in discrete pulse-based neuromorphic models, particularly those than acquire a lower-level distributed representation jointly with an upper-level, more abstract representation that self-organizes to cluster based on inherent cross-pattern similarities. We further demonstrate TI-STDP's effectiveness in adapting a simple neuronal circuit that learns a simple bi-level, part-whole hierarchy from sensory input patterns.

Implementation Of Optical Multiplicative Spike-Timing-Dependent Plasticity With Adaptive Current Feedback Of Semiconductor Optical Amplifiers

Optical Spike-Timing-dependent Plasticity with Weight-Dependent Learning Window and Reward Modulation.

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

Pulsed Laser Deposition of a Ga2O3 Thin Film for an Optoelectronic Synaptic Device.

Artificial Neuron Based on Nonlinear Polarization Rotation in a Semiconductor Optical Amplifier

Tailoring Neuroplasticity in Flexible Perovskite QDs-based Optoelectronic Synaptic Transistors by Dual Modes Modulation

Time-Integrated Spike-Timing-Dependent-Plasticity

Simulating the Spiking Response of VCSEL-based Optical Spiking Neuron

Circuit Implementation of Spike Time Dependent Plasticity (stdp) for Artificial Synapse

Optically Stimulated Synaptic Devices Based on the Hybrid Structure of Silicon Nanomembrane and Perovskite.

Photonic implementation of the synaptic depression functions based on a vertical-cavity semiconductor optical amplifier

Temporal Modulation of Spike-Timing-Dependent Plasticity

Optogenetics‐Inspired Neuromorphic Optoelectronic Synaptic Transistors with Optically Modulated Plasticity

Multiple-Step Quantized Triplet STDP Implemented with Memristive Synapse

A Stochastic Approach to STDP

High Visible-Light-Stimulated Plasticity in Optoelectronic Synaptic Transistors for Irradiation History-Dependent Learning

A Neuromorphic VLSI Design for Spike Timing and Rate Based Synaptic Plasticity

Optically Stimulated Synaptic Transistor Based on MoS2/quantum Dots Mixed-Dimensional Heterostructure with Gate-Tunable Plasticity

Realization of Diverse Spike-timing-dependent Plasticity with Nanosecond Timescale Based on Metal Oxide Resistive Switching Memory

Memory-Efficient Synaptic Connectivity for Spike-Timing- Dependent Plasticity

Forward Table-Based Presynaptic Event-Triggered Spike-Timing-Dependent Plasticity