Self-backpropagation of synaptic modifications elevates the efficiency of spiking and artificial neural networks

Tielin Zhang,Xiang Cheng,Shuncheng Jia,Mu-ming Poo,Yi Zeng,Bo Xu

DOI: https://doi.org/10.1126/sciadv.abh0146

IF: 13.6

2021-10-22

Science Advances

Abstract:A mesoscale plasticity rule improves AI learning.

multidisciplinary sciences

What problem does this paper attempt to address?

Synergies Between Intrinsic and Synaptic Plasticity Based on Information Theoretic Learning

Yuke Li,Chunguang Li

DOI: https://doi.org/10.1371/journal.pone.0062894

IF: 3.7

2013-01-01

PLoS ONE

Abstract:In experimental and theoretical neuroscience, synaptic plasticity has dominated the area of neural plasticity for a very long time. Recently, neuronal intrinsic plasticity (IP) has become a hot topic in this area. IP is sometimes thought to be an information-maximization mechanism. However, it is still unclear how IP affects the performance of artificial neural networks in supervised learning applications. From an information-theoretical perspective, the error-entropy minimization (MEE) algorithm has newly been proposed as an efficient training method. In this study, we propose a synergistic learning algorithm combining the MEE algorithm as the synaptic plasticity rule and an information-maximization algorithm as the intrinsic plasticity rule. We consider both feedforward and recurrent neural networks and study the interactions between intrinsic and synaptic plasticity. Simulations indicate that the intrinsic plasticity rule can improve the performance of artificial neural networks trained by the MEE algorithm.
Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Qiang Yu,Shenglan Li,Huajin Tang,Longbiao Wang,Jianwu Dang,Kay Chen Tan

DOI: https://doi.org/10.1109/tcyb.2020.2984888

IF: 11.8

2022-01-01

IEEE Transactions on Cybernetics

Abstract:Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.
Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Basile Confavreux,Everton J. Agnes,Friedemann Zenke,Henning Sprekeler,Tim P Vogels

DOI: https://doi.org/10.1101/2024.06.17.599260

2024-06-17

Abstract:Synaptic plasticity is a key player in the brain′s life-long learning abilities. However, due to experimental limitations, the mechanistic link between synaptic plasticity rules and the network-level computations they enable remain opaque. Here we use evolutionary strategies (ES) to meta-learn local co-active plasticity rules in large recurrent spiking networks, using parameterizations of increasing complexity. We discover rules that robustly stabilize network dynamics for all four synapse types acting in isolation (E-to-E, E-to-I, I-to-E and I-to-I). More complex functions such as familiarity detection can also be included in the search constraints. However, our meta-learning strategy begins to fail for co-active rules of increasing complexity, as it is challenging to devise loss functions that effectively constrain network dynamics to plausible solutions a priori. Moreover, in line with previous work, we can find multiple degenerate solutions with identical network behaviour. As a local optimization strategy, ES provides one solution at a time and makes exploration of this degeneracy cumbersome. Regardless, we can glean the interdependecies of various plasticity parameters by considering the covariance matrix learned alongside the optimal rule with ES. Our work provides a proof of principle for the success of machine-learning-guided discovery of plasticity rules in large spiking networks, and points at the necessity of more elaborate search strategies going forward.

Neuroscience
Meta-learning biologically plausible plasticity rules with random feedback pathways

Navid Shervani-Tabar,Robert Rosenbaum

DOI: https://doi.org/10.1038/s41467-023-37562-1

IF: 16.6

2023-04-01

Nature Communications

Abstract:Backpropagation is widely used to train artificial neural networks, but its relationship to synaptic plasticity in the brain is unknown. Some biological models of backpropagation rely on feedback projections that are symmetric with feedforward connections, but experiments do not corroborate the existence of such symmetric backward connectivity. Random feedback alignment offers an alternative model in which errors are propagated backward through fixed, random backward connections. This approach successfully trains shallow models, but learns slowly and does not perform well with deeper models or online learning. In this study, we develop a meta-learning approach to discover interpretable, biologically plausible plasticity rules that improve online learning performance with fixed random feedback connections. The resulting plasticity rules show improved online training of deep models in the low data regime. Our results highlight the potential of meta-learning to discover effective, interpretable learning rules satisfying biological constraints.

multidisciplinary sciences
Optimality of short-term synaptic plasticity in modelling certain dynamic environments

Timoleon Moraitis,Abu Sebastian,Evangelos Eleftheriou

DOI: https://doi.org/10.48550/arXiv.2009.06808

2020-09-15

Neural and Evolutionary Computing

Abstract:Biological neurons and their in-silico emulations for neuromorphic artificial intelligence (AI) use extraordinarily energy-efficient mechanisms, such as spike-based communication and local synaptic plasticity. It remains unclear whether these neuronal mechanisms only offer efficiency or also underlie the superiority of biological intelligence. Here, we prove rigorously that, indeed, the Bayes-optimal prediction and inference of randomly but continuously transforming environments, a common natural setting, relies on short-term spike-timing-dependent plasticity, a hallmark of biological synapses. Further, this dynamic Bayesian inference through plasticity enables circuits of the cerebral cortex in simulations to recognize previously unseen, highly distorted dynamic stimuli. Strikingly, this also introduces a biologically-modelled AI, the first to overcome multiple limitations of deep learning and outperform artificial neural networks in a visual task. The cortical-like network is spiking and event-based, trained only with unsupervised and local plasticity, on a small, narrow, and static training dataset, but achieves recognition of unseen, transformed, and dynamic data better than deep neural networks with continuous activations, trained with supervised backpropagation on the transforming data. These results link short-term plasticity to high-level cortical function, suggest optimality of natural intelligence for natural environments, and repurpose neuromorphic AI from mere efficiency to computational supremacy altogether.
A Spike-Based Model of Neuronal Intrinsic Plasticity.

Chunguang Li,Yuke Li

DOI: https://doi.org/10.1109/tamd.2012.2211101

2013-01-01

IEEE Transactions on Autonomous Mental Development

Abstract:The discovery of neuronal intrinsic plasticity (IP) processes which persistently modify a neuron's excitability necessitates a new concept of the neuronal plasticity mechanism and may profoundly influence our ideas on learning and memory. In this paper, we propose a spike-based IP model/adaptation rule for an integrate-and-fire (IF) neuron to model this biological phenomenon. By utilizing spikes denoted by Dirac delta functions rather than computing instantaneous firing rates for the time-dependent stimulus, this simple adaptation rule adjusts two parameters of an individual IF neuron to modify its excitability. As a result, this adaptation rule helps an IF neuron to keep its firing activity in a relatively “low but not too low” level and makes the spike-count distributions computed with adjusted window sizes similar to the experimental results.
Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

Mingkun Xu,Faqiang Liu,Yifan Hu,Hongyi Li,Yuanyuan Wei,Shuai Zhong,Jing Pei,Lei Deng

DOI: https://doi.org/10.1109/TNNLS.2024.3373599

2024-03-27

Abstract:Synaptic plasticity plays a critical role in the expression power of brain neural networks. Among diverse plasticity rules, synaptic scaling presents indispensable effects on homeostasis maintenance and synaptic strength regulation. In the current modeling of brain-inspired spiking neural networks (SNN), backpropagation through time is widely adopted because it can achieve high performance using a small number of time steps. Nevertheless, the synaptic scaling mechanism has not yet been well touched. In this work, we propose an experience-dependent adaptive synaptic scaling mechanism (AS-SNN) for spiking neural networks. The learning process has two stages: First, in the forward path, adaptive short-term potentiation or depression is triggered for each synapse according to afferent stimuli intensity accumulated by presynaptic historical neural activities. Second, in the backward path, long-term consolidation is executed through gradient signals regulated by the corresponding scaling factor. This mechanism shapes the pattern selectivity of synapses and the information transfer they mediate. We theoretically prove that the proposed adaptive synaptic scaling function follows a contraction map and finally converges to an expected fixed point, in accordance with state-of-the-art results in three tasks on perturbation resistance, continual learning, and graph learning. Specifically, for the perturbation resistance and continual learning tasks, our approach improves the accuracy on the N-MNIST benchmark over the baseline by 44% and 25%, respectively. An expected firing rate callback and sparse coding can be observed in graph learning. Extensive experiments on ablation study and cost evaluation evidence the effectiveness and efficiency of our nonparametric adaptive scaling method, which demonstrates the great potential of SNN in continual learning and robust learning.
Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns

Qiang Yu,Huajin Tang,Kay Chen Tan,Haizhou Li

DOI: https://doi.org/10.1371/journal.pone.0078318

IF: 3.7

2013-01-01

PLoS ONE

Abstract:A new learning rule (Precise-Spike-Driven (PSD) Synaptic Plasticity) is proposed for processing and memorizing spatiotemporal patterns. PSD is a supervised learning rule that is analytically derived from the traditional Widrow-Hoff rule and can be used to train neurons to associate an input spatiotemporal spike pattern with a desired spike train. Synaptic adaptation is driven by the error between the desired and the actual output spikes, with positive errors causing long-term potentiation and negative errors causing long-term depression. The amount of modification is proportional to an eligibility trace that is triggered by afferent spikes. The PSD rule is both computationally efficient and biologically plausible. The properties of this learning rule are investigated extensively through experimental simulations, including its learning performance, its generality to different neuron models, its robustness against noisy conditions, its memory capacity, and the effects of its learning parameters. Experimental results show that the PSD rule is capable of spatiotemporal pattern classification, and can even outperform a well studied benchmark algorithm with the proposed relative confidence criterion. The PSD rule is further validated on a practical example of an optical character recognition problem. The results again show that it can achieve a good recognition performance with a proper encoding. Finally, a detailed discussion is provided about the PSD rule and several related algorithms including tempotron, SPAN, Chronotron and ReSuMe.
EchoSpike Predictive Plasticity: An Online Local Learning Rule for Spiking Neural Networks

Lars Graf,Zhe Su,Giacomo Indiveri

2024-05-23

Abstract:The drive to develop artificial neural networks that efficiently utilize resources has generated significant interest in bio-inspired Spiking Neural Networks (SNNs). These networks are particularly attractive due to their potential in applications requiring low power and memory. This potential is further enhanced by the ability to perform online local learning, enabling them to adapt to dynamic environments. This requires the model to be adaptive in a self-supervised manner. While self-supervised learning has seen great success in many deep learning domains, its application for online local learning in multi-layer SNNs remains underexplored. In this paper, we introduce the "EchoSpike Predictive Plasticity" (ESPP) learning rule, a pioneering online local learning rule designed to leverage hierarchical temporal dynamics in SNNs through predictive and contrastive coding. We validate the effectiveness of this approach using benchmark datasets, demonstrating that it performs on par with current state-of-the-art supervised learning rules. The temporal and spatial locality of ESPP makes it particularly well-suited for low-cost neuromorphic processors, representing a significant advancement in developing biologically plausible self-supervised learning models for neuromorphic computing at the edge.

Neural and Evolutionary Computing,Machine Learning
Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Haosong Qi,Shuang Lian,Xu Li,Huajin Tang

DOI: https://doi.org/10.1109/ijcnn60899.2024.10650059

2024-01-01

Abstract:Spiking neural networks (SNNs) with bio-inspired spatio-temporal dynamics, have increasingly manifested their superiority in energy efficiency. However, the non-differential spiking activity hinders the implementation of the efficient error backpropagation in training SNNs. The existing solution circumvents this problem by a relaxation on the gradient calculation using a continuous function, which is referred to as surrogate gradient learning. Nevertheless, such a solution leads to a prominent gradient mismatch problem due to the low precision of spikes, which limits the performance of directly trained SNNs on deeper architectures. To tackle this issue, we propose the adaptive multilevel firing (AMLF) method incorporating the spiking dormant-suppressed residual network (spiking DS-ResNet) to get well-behaved SNNs. The AMLF method can not only adaptively implement incremental expression ability of spiking neurons to alleviate gradient mismatch issue, but also enable more efficient gradient propagation during training by enlarging the gradient-available area. We conduct a series of experiments on static image datasets and neuromorphic datasets. Results show that the proposed AMLF method can help SNNs achieve competitive performance in terms of both latency and accuracy.
Reinforcement Learning in Spiking Neural Networks with Stochastic and Deterministic Synapses

Mengwen Yuan,Xi Wu,Rui Yan,Huajin Tang

DOI: https://doi.org/10.1162/neco_a_01238

IF: 3.278

2019-01-01

Neural Computation

Abstract:Though succeeding in solving various learning tasks, most existing reinforcement learning (RL) models have failed to take into account the complexity of synaptic plasticity in the neural system. Models implementing reinforcement learning with spiking neurons involve only a single plasticity mechanism. Here, we propose a neural realistic reinforcement learning model that coordinates the plasticities of two types of synapses: stochastic and deterministic. The plasticity of the stochastic synapse is achieved by the hedonistic rule through modulating the release probability of synaptic neurotransmitter, while the plasticity of the deterministic synapse is achieved by a variant of a reward-modulated spike-timing-dependent plasticity rule through modulating the synaptic strengths. We evaluate the proposed learning model on two benchmark tasks: learning a logic gate function and the 19-state random walk problem. Experimental results show that the coordination of diverse synaptic plasticities can make the RL model learn in a rapid and stable form.
Improving Multispike Learning with Plastic Synaptic Delays

Qiang Yu,Jialu Gao,Jianguo Wei,Jing Li,Kay Chen Tan,Tiejun Huang

DOI: https://doi.org/10.1109/tnnls.2022.3165527

IF: 14.255

2023-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Emulating the spike-based processing in the brain, spiking neural networks (SNNs) are developed and act as a promising candidate for the new generation of artificial neural networks that aim to produce efficient cognitions as the brain. Due to the complex dynamics and nonlinearity of SNNs, designing efficient learning algorithms has remained a major difficulty, which attracts great research attention. Most existing ones focus on the adjustment of synaptic weights. However, other components, such as synaptic delays, are found to be adaptive and important in modulating neural behavior. How could plasticity on different components cooperate to improve the learning of SNNs remains as an interesting question. Advancing our previous multispike learning, we propose a new joint weight-delay plasticity rule, named TDP-DL, in this article. Plastic delays are integrated into the learning framework, and as a result, the performance of multispike learning is significantly improved. Simulation results highlight the effectiveness and efficiency of our TDP-DL rule compared to baseline ones. Moreover, we reveal the underlying principle of how synaptic weights and delays cooperate with each other through a synthetic task of interval selectivity and show that plastic delays can enhance the selectivity and flexibility of neurons by shifting information across time. Due to this capability, useful information distributed away in the time domain can be effectively integrated for a better accuracy performance, as highlighted in our generalization tasks of the image, speech, and event-based object recognitions. Our work is thus valuable and significant to improve the performance of spike-based neuromorphic computing.
Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks

Guobin Shen,Dongcheng Zhao,Yiting Dong,Yang Li,Feifei Zhao,Yi Zeng

2024-02-01

Abstract:The evolution of the human brain has led to the development of complex synaptic plasticity, enabling dynamic adaptation to a constantly evolving world. This progress inspires our exploration into a new paradigm for Spiking Neural Networks (SNNs): a Plasticity-Driven Learning Framework (PDLF). This paradigm diverges from traditional neural network models that primarily focus on direct training of synaptic weights, leading to static connections that limit adaptability in dynamic environments. Instead, our approach delves into the heart of synaptic behavior, prioritizing the learning of plasticity rules themselves. This shift in focus from weight adjustment to mastering the intricacies of synaptic change offers a more flexible and dynamic pathway for neural networks to evolve and adapt. Our PDLF does not merely adapt existing concepts of functional and Presynaptic-Dependent Plasticity but redefines them, aligning closely with the dynamic and adaptive nature of biological learning. This reorientation enhances key cognitive abilities in artificial intelligence systems, such as working memory and multitasking capabilities, and demonstrates superior adaptability in complex, real-world scenarios. Moreover, our framework sheds light on the intricate relationships between various forms of plasticity and cognitive functions, thereby contributing to a deeper understanding of the brain's learning mechanisms. Integrating this groundbreaking plasticity-centric approach in SNNs marks a significant advancement in the fusion of neuroscience and artificial intelligence. It paves the way for developing AI systems that not only learn but also adapt in an ever-changing world, much like the human brain.

Neural and Evolutionary Computing
Towards deep learning with spiking neurons in energy based models with contrastive Hebbian plasticity

Thomas Mesnard,Wulfram Gerstner,Johanni Brea

DOI: https://doi.org/10.48550/arXiv.1612.03214

IF: 5.414

2016-12-09

Machine Learning

Abstract:In machine learning, error back-propagation in multi-layer neural networks (deep learning) has been impressively successful in supervised and reinforcement learning tasks. As a model for learning in the brain, however, deep learning has long been regarded as implausible, since it relies in its basic form on a non-local plasticity rule. To overcome this problem, energy-based models with local contrastive Hebbian learning were proposed and tested on a classification task with networks of rate neurons. We extended this work by implementing and testing such a model with networks of leaky integrate-and-fire neurons. Preliminary results indicate that it is possible to learn a non-linear regression task with hidden layers, spiking neurons and a local synaptic plasticity rule.
Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Alireza Alemi,Christian Machens,Sophie Denève,Jean-Jacques Slotine

DOI: https://doi.org/10.48550/arXiv.1705.08026

2017-08-05

Abstract:Understanding how recurrent neural circuits can learn to implement dynamical systems is a fundamental challenge in neuroscience. The credit assignment problem, i.e. determining the local contribution of each synapse to the network's global output error, is a major obstacle in deriving biologically plausible local learning rules. Moreover, spiking recurrent networks implementing such tasks should not be hugely costly in terms of number of neurons and spikes, as they often are when adapted from rate models. Finally, these networks should be robust to noise and neural deaths in order to sustain these representations in the face of such naturally occurring perturbation. We approach this problem by fusing the theory of efficient, balanced spiking networks (EBN) with nonlinear adaptive control theory. Local learning rules are ensured by feeding back into the network its own error, resulting in a synaptic plasticity rule depending solely on presynaptic inputs and post-synaptic feedback. The spiking efficiency and robustness of the network are guaranteed by maintaining a tight excitatory/inhibitory balance, ensuring that each spike represents a local projection of the global output error and minimizes a loss function. The resulting networks can learn to implement complex dynamics with very small numbers of neurons and spikes, exhibit the same spike train variability as observed experimentally, and are extremely robust to noise and neuronal loss.

Neurons and Cognition
Learning to learn with backpropagation of Hebbian plasticity

Thomas Miconi

DOI: https://doi.org/10.48550/arXiv.1609.02228

2016-10-20

Abstract:Hebbian plasticity is a powerful principle that allows biological brains to learn from their lifetime experience. By contrast, artificial neural networks trained with backpropagation generally have fixed connection weights that do not change once training is complete. While recent methods can endow neural networks with long-term memories, Hebbian plasticity is currently not amenable to gradient descent. Here we derive analytical expressions for activity gradients in neural networks with Hebbian plastic connections. Using these expressions, we can use backpropagation to train not just the baseline weights of the connections, but also their plasticity. As a result, the networks "learn how to learn" in order to solve the problem at hand: the trained networks automatically perform fast learning of unpredictable environmental features during their lifetime, expanding the range of solvable problems. We test the algorithm on various on-line learning tasks, including pattern completion, one-shot learning, and reversal learning. The algorithm successfully learns how to learn the relevant associations from one-shot instruction, and fine-tunes the temporal dynamics of plasticity to allow for continual learning in response to changing environmental parameters. We conclude that backpropagation of Hebbian plasticity offers a powerful model for lifelong learning.

Neural and Evolutionary Computing,Artificial Intelligence,Machine Learning,Neurons and Cognition
Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits

Alexander Ororbia

DOI: https://doi.org/10.1126/sciadv.adn6076

2024-10-25

Abstract:Brain-inspired machine intelligence research seeks to develop computational models that emulate the information processing and adaptability that distinguishes biological systems of neurons. This has led to the development of spiking neural networks, a class of models that promisingly addresses the biological implausibility and {the lack of energy efficiency} inherent to modern-day deep neural networks. In this work, we address the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks and propose contrastive-signal-dependent plasticity, a process which generalizes ideas behind self-supervised learning to facilitate local adaptation in architectures of event-based neuronal layers that operate in parallel. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks, crucially side-stepping the need for extra structure such as feedback synapses.

Neural and Evolutionary Computing,Machine Learning
Memory-efficient neurons and synapses for spike-timing-dependent-plasticity in large-scale spiking networks

Pablo Urbizagastegui,André van Schaik,Runchun Wang

DOI: https://doi.org/10.3389/fnins.2024.1450640

2024-09-06

Abstract:This paper addresses the challenges posed by frequent memory access during simulations of large-scale spiking neural networks involving synaptic plasticity. We focus on the memory accesses performed during a common synaptic plasticity rule since this can be a significant factor limiting the efficiency of the simulations. We propose neuron models that are represented by only three state variables, which are engineered to enforce the appropriate neuronal dynamics. Additionally, memory retrieval is executed solely by fetching postsynaptic variables, promoting a contiguous memory storage and leveraging the capabilities of burst mode operations to reduce the overhead associated with each access. Different plasticity rules could be implemented despite the adopted simplifications, each leading to a distinct synaptic weight distribution (i.e., unimodal and bimodal). Moreover, our method requires fewer average memory accesses compared to a naive approach. We argue that the strategy described can speed up memory transactions and reduce latencies while maintaining a small memory footprint.
Hebbian and Gradient-based Plasticity Enables Robust Memory and Rapid Learning in RNNs

Yu Duan,Zhongfan Jia,Qian Li,Yi Zhong,Kaisheng Ma

DOI: https://doi.org/10.48550/arXiv.2302.03235

2023-02-07

Abstract:Rapidly learning from ongoing experiences and remembering past events with a flexible memory system are two core capacities of biological intelligence. While the underlying neural mechanisms are not fully understood, various evidence supports that synaptic plasticity plays a critical role in memory formation and fast learning. Inspired by these results, we equip Recurrent Neural Networks (RNNs) with plasticity rules to enable them to adapt their parameters according to ongoing experiences. In addition to the traditional local Hebbian plasticity, we propose a global, gradient-based plasticity rule, which allows the model to evolve towards its self-determined target. Our models show promising results on sequential and associative memory tasks, illustrating their ability to robustly form and retain memories. In the meantime, these models can cope with many challenging few-shot learning problems. Comparing different plasticity rules under the same framework shows that Hebbian plasticity is well-suited for several memory and associative learning tasks; however, it is outperformed by gradient-based plasticity on few-shot regression tasks which require the model to infer the underlying mapping. Code is available at <a class="link-external link-https" href="https://github.com/yuvenduan/PlasticRNNs" rel="external noopener nofollow">this https URL</a>.

Neural and Evolutionary Computing,Artificial Intelligence
A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost

Tielin Zhang,Xiang Cheng,Shuncheng Jia,Chengyu T Li,Mu-Ming Poo,Bo Xu,Mu-ming Poo

DOI: https://doi.org/10.1126/sciadv.adi2947

IF: 13.6

2023-08-27

Science Advances

Abstract:Neuromodulators in the brain act globally at many forms of synaptic plasticity, represented as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking artificial neural networks (ANNs). Here, we report an efficient brain-inspired computing algorithm for SNNs and ANNs, referred to here as neuromodulation-assisted credit assignment (NACA), which uses expectation signals to induce defined levels of neuromodulators to selective synapses, whereby the long-term synaptic potentiation and depression are modified in a nonlinear manner depending on the neuromodulator level. The NACA algorithm achieved high recognition accuracy with substantially reduced computational cost in learning spatial and temporal classification tasks. Notably, NACA was also verified as efficient for learning five different class continuous learning tasks with varying degrees of complexity, exhibiting a markedly mitigated catastrophic forgetting at low computational cost. Mapping synaptic weight changes showed that these benefits could be explained by the sparse and targeted synaptic modifications attributed to expectation-based global neuromodulation.

multidisciplinary sciences

Self-backpropagation of synaptic modifications elevates the efficiency of spiking and artificial neural networks

Synergies Between Intrinsic and Synaptic Plasticity Based on Information Theoretic Learning

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Balancing complexity, performance and plausibility to meta learn plasticity rules in recurrent spiking networks.

Meta-learning biologically plausible plasticity rules with random feedback pathways

Optimality of short-term synaptic plasticity in modelling certain dynamic environments

A Spike-Based Model of Neuronal Intrinsic Plasticity.

Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns

EchoSpike Predictive Plasticity: An Online Local Learning Rule for Spiking Neural Networks

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Reinforcement Learning in Spiking Neural Networks with Stochastic and Deterministic Synapses

Improving Multispike Learning with Plastic Synaptic Delays

Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks

Towards deep learning with spiking neurons in energy based models with contrastive Hebbian plasticity

Learning arbitrary dynamics in efficient, balanced spiking networks using local plasticity rules

Learning to learn with backpropagation of Hebbian plasticity

Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits

Memory-efficient neurons and synapses for spike-timing-dependent-plasticity in large-scale spiking networks

Hebbian and Gradient-based Plasticity Enables Robust Memory and Rapid Learning in RNNs

A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost