Abstract:In this work, we propose time-integrated spike-timing-dependent plasticity (TI-STDP), a mathematical model of synaptic plasticity that allows spiking neural networks to continuously adapt to sensory input streams in an unsupervised fashion. Notably, we theoretically establish and formally prove key properties related to the synaptic adjustment mechanics that underwrite TI-STDP. Empirically, we demonstrate the efficacy of TI-STDP in simulations of jointly learning deeper spiking neural networks that process input digit pixel patterns, at both full image and patch-levels, comparing to two powerful historical instantations of STDP; trace-based STDP (TR-STDP) and event-based post-synaptic STDP (EV-STDP). Usefully, we demonstrate that not only are all forms of STDP capable of meaningfully adapting the synaptic efficacies of a multi-layer biophysical architecture, but that TI-STDP is notably able to do so without requiring the tracking of a large window of pre- and post-synaptic spike timings, the maintenance of additional parameterized traces, or the restriction of synaptic plasticity changes to occur within very narrow windows of time. This means that our findings show that TI-STDP can efficiently embody the benefits of models such as canonical STDP, TR-STDP, and EV-STDP without their costs or drawbacks. Usefully, our results further demonstrate the promise of using a spike-correlation scheme such as TI-STDP in conducting credit assignment in discrete pulse-based neuromorphic models, particularly those than acquire a lower-level distributed representation jointly with an upper-level, more abstract representation that self-organizes to cluster based on inherent cross-pattern similarities. We further demonstrate TI-STDP's effectiveness in adapting a simple neuronal circuit that learns a simple bi-level, part-whole hierarchy from sensory input patterns.

Scale-invariant temporal history (SITH): optimal slicing of the past in an uncertain world

Deep reinforcement learning with time-scale invariant memory

Episodic Memory for Learning Subjective-Timescale Models

Optimizing Agent Behavior over Long Time Scales by Transporting Value

Estimating scale-invariant future in continuous time

Stable Hadamard Memory: Revitalizing Memory-Augmented Agents for Reinforcement Learning

Schematic Memory Persistence and Transience for Efficient and Robust Continual Learning

Neural mechanism to simulate a scale-invariant future timeline

Sparse Graphical Memory for Robust Planning

Long horizon episodic decision making for cognitively inspired robots

Generic construction of scale-invariantly coarse grained memory

Learning Successor Features with Distributed Hebbian Temporal Memory

Learning a World Model With Multitimescale Memory Augmentation

Active Dendrites Enable Efficient Continual Learning in Time-To-First-Spike Neural Networks

Time-Integrated Spike-Timing-Dependent-Plasticity

Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework

Incremental Self-Organization of Spatio-Temporal Spike Pattern Detection

SR-CIS: Self-Reflective Incremental System with Decoupled Memory and Reasoning

Temporal Knowledge Sharing enable Spiking Neural Network Learning from Past and Future

Beyond spiking networks: The computational advantages of dendritic amplification and input segregation

Combining long and short spatiotemporal reasoning for deep reinforcement learning