Effects of Domain Knowledge on User Performance and Perception in a Knowledge Domain Visualization System

Xiaojun Yuan,Chaomei Chen,Xiangmin Zhang,J. M. Avery,Tao Xu

DOI: https://doi.org/10.1007/978-3-642-39253-5_67

2013-07-21

Interacción

Abstract:

What problem does this paper attempt to address?

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Qiang Yu,Shenglan Li,Huajin Tang,Longbiao Wang,Jianwu Dang,Kay Chen Tan

DOI: https://doi.org/10.1109/tcyb.2020.2984888

IF: 11.8

2022-01-01

IEEE Transactions on Cybernetics

Abstract:Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.
Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Qiang Yu,K. C. Tan,Huajin Tang

DOI: https://doi.org/10.1109/ijcnn.2012.6252427

2012-01-01

Abstract:Many conventional methods have been widely studied to solve the pattern recognition task, but most of them lack the biological plausibility. This paper presents a spiking neural network of integrate-and-fire neurons to perform pattern recognition. A biologically plausible supervised synaptic learning rule is used so that neurons can efficiently make a decision. The whole system contains encoding, learning and readout. It can classify complex patterns of activities stored in a vector, as well as the real-world stimuli. We test the performance of the network with digital images from the MNIST and images of alphabetic letters. It turns out to be able to classify these patterns correctly. In addition, the synaptic dynamics is shown to be compatible with many experimental observations on induction of long-term modifications, like spike-timing-dependent plasticity (STDP).
Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

Yi Zhong,Zilin Wang,Xiaoxin Cui,Jian Cao,Yuan Wang

DOI: https://doi.org/10.1109/AICAS57966.2023.10168578

2023-01-01

Abstract:Spiking neural network is a promising endeavor to fulfill brain-like intelligence on the chip. Its learning rule, i.e., spike-timing-dependent plasticity (STDP), derived from neurobiology, is perceived as a powerful candidate to facilitate low-cost and high-performance unsupervised training. In this paper, we present a temporal coding based STDP learning method (TC-STDP) to verify the counter and look-up table based circuit design on a neuromorphic prototype chip. In order to perform on-chip STDP learning in an unsupervised manner, this paper concentrates more on detailing the experimental procedures and practical evaluations, where we introduce the matching score as a quantitative index to carry out label assignment and accuracy confirmation. Evaluation experiments demonstrate that the unsupervised STDP learning achieves best on-chip recognition accuracies of 93.51%, 80.33% on MNIST and EMNIST datasets, respectively. Moreover, experiments conducted on ModelNet40 3D dataset also validate the effectiveness of unsupervised STDP rule to perform possible incremental learning.
An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Xiaolei Zhu,Baixin Zhao,De Ma,Huajin Tang

DOI: https://doi.org/10.1109/tcds.2021.3073846

IF: 4.546

2021-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:It is challenging to train deep spiking neural networks (SNNs) directly due to the difficulties associated with the nondifferentiable neuron model. In this work, an end-to-end learning algorithm based on discrete current-based leaky integrate-and-fire (C-LIF) neuron model and surrogate gradient is proposed to leverage the encoder–decoder network architecture to train deep SNNs directly. The proposed algorithm is capable of learning deep spatiotemporal features relying on current time step only, and several acceleration techniques including backward phase skipping and layerwise FreezeOut are proposed to accelerate the training. Experimental results show that the proposed learning algorithm achieved the classification accuracies of 98.40% and 95.83% on the dynamic neuromorphic data sets MNIST-DVS and DVS-Gestures, respectively, and of 99.58% and 95.97% on static vision data sets MNIST and SVHN, respectively, which are comparable to the existing state-of-the-art results. The training speed was accelerated by up to 49.5% on MNIST and 36.6% on DVS-Gestures with the proposed acceleration techniques while maintaining the same level of accuracy.
Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Qi Xu,Yaxin Li,Jiangrong Shen,Pingping Zhang,Jian K. Liu,Huajin Tang,Gang Pan

DOI: https://doi.org/10.1109/tnnls.2022.3232106

IF: 14.255

2024-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Thanks to their event-driven nature, spiking neural networks (SNNs) are surmised to be great computation-efficient models. The spiking neurons encode beneficial temporal facts and possess excessive anti-noise properties. However, the high-quality encoding of spatio-temporal complexity and also its training optimization of SNNs are restricted by means of the contemporary problem, this article proposes a novel hierarchical event-driven visual device to explore how information transmits and signifies in the retina the usage of biologically manageable mechanisms. This cognitive model is an augmented spiking-based framework consisting of the function learning capacity of convolutional neural networks (CNNs) with the cognition capability of SNNs. Furthermore, this visual device is modeled in a biological realism way with unsupervised learning rules and advanced spike firing rate encoding methods. We train and test them on some image datasets (Modified National Institute of Standards and Technology (MNIST), Canadian Institute for Advanced Research (CIFAR)10, and its noisy versions) to show that our mannequin can process greater vital data than present cognitive models. This article also proposes a novel quantization approach to make the proposed spiking-based model more efficient for neuromorphic hardware implementation. The outcomes show this joint CNN-SNN model can reap excessive focus accuracy and get more effective generalization ability.
Unsupervised Spiking Neural Network with Dynamic Learning of Inhibitory Neurons

Geunbo Yang,Wongyu Lee,Youjung Seo,Choongseop Lee,Woojoon Seok,Jongkil Park,Donggyu Sim,Cheolsoo Park

DOI: https://doi.org/10.3390/s23167232

IF: 3.9

2023-08-18

Sensors

Abstract:A spiking neural network (SNN) is a type of artificial neural network that operates based on discrete spikes to process timing information, similar to the manner in which the human brain processes real-world problems. In this paper, we propose a new spiking neural network (SNN) based on conventional, biologically plausible paradigms, such as the leaky integrate-and-fire model, spike timing-dependent plasticity, and the adaptive spiking threshold, by suggesting new biological models; that is, dynamic inhibition weight change, a synaptic wiring method, and Bayesian inference. The proposed network is designed for image recognition tasks, which are frequently used to evaluate the performance of conventional deep neural networks. To manifest the bio-realistic neural architecture, the learning is unsupervised, and the inhibition weight is dynamically changed; this, in turn, affects the synaptic wiring method based on Hebbian learning and the neuronal population. In the inference phase, Bayesian inference successfully classifies the input digits by counting the spikes from the responding neurons. The experimental results demonstrate that the proposed biological model ensures a performance improvement compared with other biologically plausible SNN models.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
A frugal Spiking Neural Network for unsupervised classification of continuous multivariate temporal data

Sai Deepesh Pokala,Marie Bernert,Takuya Nanami,Takashi Kohno,Timothée Lévi,Blaise Yvert

2024-08-08

Abstract:As neural interfaces become more advanced, there has been an increase in the volume and complexity of neural data recordings. These interfaces capture rich information about neural dynamics that call for efficient, real-time processing algorithms to spontaneously extract and interpret patterns of neural dynamics. Moreover, being able to do so in a fully unsupervised manner is critical as patterns in vast streams of neural data might not be easily identifiable by the human eye. Formal Deep Neural Networks (DNNs) have come a long way in performing pattern recognition tasks for various static and sequential pattern recognition applications. However, these networks usually require large labeled datasets for training and have high power consumption preventing their future embedding in active brain implants. An alternative aimed at addressing these issues are Spiking Neural Networks (SNNs) which are neuromorphic and use more biologically plausible neurons with evolving membrane potentials. In this context, we introduce here a frugal single-layer SNN designed for fully unsupervised identification and classification of multivariate temporal patterns in continuous data with a sequential approach. We show that, with only a handful number of neurons, this strategy is efficient to recognize highly overlapping multivariate temporal patterns, first on simulated data, and then on Mel Cepstral representations of speech sounds and finally on multichannel neural data. This approach relies on several biologically inspired plasticity rules, including Spike-timing-dependent plasticity (STDP), Short-term plasticity (STP) and intrinsic plasticity (IP). These results pave the way towards highly frugal SNNs for fully unsupervised and online-compatible learning of complex multivariate temporal patterns for future embedding in dedicated very-low power hardware.

Neural and Evolutionary Computing,Artificial Intelligence,Machine Learning
Supervised Learning with First-to-Spike Decoding in Multilayer Spiking Neural Networks

Brian Gardner,André Grüning

DOI: https://doi.org/10.48550/arXiv.2008.06937

2020-08-16

Abstract:Experimental studies support the notion of spike-based neuronal information processing in the brain, with neural circuits exhibiting a wide range of temporally-based coding strategies to rapidly and efficiently represent sensory stimuli. Accordingly, it would be desirable to apply spike-based computation to tackling real-world challenges, and in particular transferring such theory to neuromorphic systems for low-power embedded applications. Motivated by this, we propose a new supervised learning method that can train multilayer spiking neural networks to solve classification problems based on a rapid, first-to-spike decoding strategy. The proposed learning rule supports multiple spikes fired by stochastic hidden neurons, and yet is stable by relying on first-spike responses generated by a deterministic output layer. In addition to this, we also explore several distinct, spike-based encoding strategies in order to form compact representations of presented input data. We demonstrate the classification performance of the learning rule as applied to several benchmark datasets, including MNIST. The learning rule is capable of generalising from the data, and is successful even when used with constrained network architectures containing few input and hidden layer neurons. Furthermore, we highlight a novel encoding strategy, termed `scanline encoding', that can transform image data into compact spatiotemporal patterns for subsequent network processing. Designing constrained, but optimised, network structures and performing input dimensionality reduction has strong implications for neuromorphic applications.

Neural and Evolutionary Computing,Machine Learning,Neurons and Cognition
An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections

Yiting Dong,Dongcheng Zhao,Yang Li,Yi Zeng

DOI: https://doi.org/10.1016/j.neunet.2023.06.019

IF: 7.8

2023-07-07

Neural Networks

Abstract:The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual knowledge in a self-organized and unsupervised manner, accomplished through coordinating various learning rules and structures in the human brain. Spike-timing-dependent plasticity (STDP) is a general learning rule in the brain, but spiking neural networks (SNNs) trained with STDP alone is inefficient and perform poorly. In this paper, taking inspiration from short-term synaptic plasticity, we design an adaptive synaptic filter and introduce the adaptive spiking threshold as the neuron plasticity to enrich the representation ability of SNNs. We also introduce an adaptive lateral inhibitory connection to adjust the spikes balance dynamically to help the network learn richer features. To speed up and stabilize the training of unsupervised spiking neural networks, we design a samples temporal batch STDP (STB-STDP), which updates weights based on multiple samples and moments. By integrating the above three adaptive mechanisms and STB-STDP, our model greatly accelerates the training of unsupervised spiking neural networks and improves the performance of unsupervised SNNs on complex tasks. Our model achieves the current state-of-the-art performance of unsupervised STDP-based SNNs in the MNIST and FashionMNIST datasets. Further, we tested on the more complex CIFAR10 dataset, and the results fully illustrate the superiority of our algorithm. Our model is also the first work to apply unsupervised STDP-based SNNs to CIFAR10. At the same time, in the small-sample learning scenario, it will far exceed the supervised ANN using the same structure.

computer science, artificial intelligence,neurosciences
Spiking-timing based pattern recognition with real-world visual stimuli

Jun Hu,Huajin Tang,K. C. Tan

DOI: https://doi.org/10.1109/CCMB.2013.6609161

2013-01-01

Abstract:Pattern recognition has been widely studied in the field of computational intelligence. However, primates outperform existing algorithms in cognitive tasks without any difficulty and most of current methods lack enough biological plausibility. Inspired by recent biological findings, a spike-timing based computational model is described, in which information is represented by temporal codes with explicit firing times rather than firing rates of neurons. Visual stimulation is converted into precisely timed spikes by a retina-like model. Encoded spatiotemporal patterns are learned by a temporal learning algorithm based on spiking-timing-dependent plasticity (STDP). The computational model integrates encoding and learning with a unified neural representation closing the gap between them. We show that our integrated model is capable of recognizing real world stimuli such as images successfully with fast and efficient neural computation.
Digit Recognition using Multimodal Spiking Neural Networks

William Bjorndahl,Jack Easton,Austin Modoff,Eric C. Larson,Joseph Camp,Prasanna Rangarajan

2024-09-01

Abstract:Spiking neural networks (SNNs) are the third generation of neural networks that are biologically inspired to process data in a fashion that emulates the exchange of signals in the brain. Within the Computer Vision community SNNs have garnered significant attention due in large part to the availability of event-based sensors that produce a spatially resolved spike train in response to changes in scene radiance. SNNs are used to process event-based data due to their neuromorphic nature. The proposed work examines the neuromorphic advantage of fusing multiple sensory inputs in classification tasks. Specifically we study the performance of a SNN in digit classification by passing in a visual modality branch (Neuromorphic-MNIST [N-MNIST]) and an auditory modality branch (Spiking Heidelberg Digits [SHD]) from datasets that were created using event-based sensors to generate a series of time-dependent events. It is observed that multi-modal SNNs outperform unimodal visual and unimodal auditory SNNs. Furthermore, it is observed that the process of sensory fusion is insensitive to the depth at which the visual and auditory branches are combined. This work achieves a 98.43% accuracy on the combined N-MNIST and SHD dataset using a multimodal SNN that concatenates the visual and auditory branches at a late depth.

Audio and Speech Processing,Sound
A Spike-Timing Based Integrated Model for Pattern Recognition

Qiang Yu,Huajin Tang,Jun Hu,Kay Chen Tan

DOI: https://doi.org/10.1162/neco_a_00395

IF: 3.278

2012-01-01

Neural Computation

Abstract:During the past few decades, remarkable progress has been made in solving pattern recognition problems using networks of spiking neurons. However, the issue of pattern recognition involving computational process from sensory encoding to synaptic learning remains underexplored, as most existing models or algorithms target only part of the computational process. Furthermore, many learning algorithms proposed in the literature neglect or pay little attention to sensory information encoding, which makes them incompatible with neural-realistic sensory signals encoded from real-world stimuli. By treating sensory coding and learning as a systematic process, we attempt to build an integrated model based on spiking neural networks (SNNs), which performs sensory neural encoding and supervised learning with precisely timed sequences of spikes. With emerging evidence of precise spike-timing neural activities, the view that information is represented by explicit firing times of action potentials rather than mean firing rates has been receiving increasing attention. The external sensory stimulation is first converted into spatiotemporal patterns using a latency-phase encoding method and subsequently transmitted to the consecutive network for learning. Spiking neurons are trained to reproduce target signals encoded with precisely timed spikes. We show that when a supervised spike-timing-based learning is used, different spatiotemporal patterns are recognized by different spike patterns with a high time precision in milliseconds.
Paired Competing Neurons Improving STDP Supervised Local Learning In Spiking Neural Networks

Gaspard Goupy,Pierre Tirilly,Ioan Marius Bilasco

2024-04-27

Abstract:Direct training of Spiking Neural Networks (SNNs) on neuromorphic hardware has the potential to significantly reduce the energy consumption of artificial neural network training. SNNs trained with Spike Timing-Dependent Plasticity (STDP) benefit from gradient-free and unsupervised local learning, which can be easily implemented on ultra-low-power neuromorphic hardware. However, classification tasks cannot be performed solely with unsupervised STDP. In this paper, we propose Stabilized Supervised STDP (S2-STDP), a supervised STDP learning rule to train the classification layer of an SNN equipped with unsupervised STDP for feature extraction. S2-STDP integrates error-modulated weight updates that align neuron spikes with desired timestamps derived from the average firing time within the layer. Then, we introduce a training architecture called Paired Competing Neurons (PCN) to further enhance the learning capabilities of our classification layer trained with S2-STDP. PCN associates each class with paired neurons and encourages neuron specialization toward target or non-target samples through intra-class competition. We evaluate our methods on image recognition datasets, including MNIST, Fashion-MNIST, and CIFAR-10. Results show that our methods outperform state-of-the-art supervised STDP learning rules, for comparable architectures and numbers of neurons. Further analysis demonstrates that the use of PCN enhances the performance of S2-STDP, regardless of the hyperparameter set and without introducing any additional hyperparameters.

Computer Vision and Pattern Recognition
A Spiking Neuron Synaptic Plasticity Model Optimized for Unsupervised Learning

Mikhail Kiselev

DOI: https://doi.org/10.48550/arXiv.2111.06768

2021-11-12

Neural and Evolutionary Computing

Abstract:Spiking neural networks (SNN) are considered as a perspective basis for performing all kinds of learning tasks - unsupervised, supervised and reinforcement learning. Learning in SNN is implemented through synaptic plasticity - the rules which determine dynamics of synaptic weights depending usually on activity of the pre- and post-synaptic neurons. Diversity of various learning regimes assumes that different forms of synaptic plasticity may be most efficient for, for example, unsupervised and supervised learning, as it is observed in living neurons demonstrating many kinds of deviations from the basic spike timing dependent plasticity (STDP) model. In the present paper, we formulate specific requirements to plasticity rules imposed by unsupervised learning problems and construct a novel plasticity model generalizing STDP and satisfying these requirements. This plasticity model serves as main logical component of the novel supervised learning algorithm called SCoBUL (Spike Correlation Based Unsupervised Learning) proposed in this work. We also present the results of computer simulation experiments confirming efficiency of these synaptic plasticity rules and the algorithm SCoBUL.
Deep Unsupervised Learning Using Spike-Timing-Dependent Plasticity

Sen Lu,Abhronil Sengupta

2024-03-16

Abstract:Spike-Timing-Dependent Plasticity (STDP) is an unsupervised learning mechanism for Spiking Neural Networks (SNNs) that has received significant attention from the neuromorphic hardware community. However, scaling such local learning techniques to deeper networks and large-scale tasks has remained elusive. In this work, we investigate a Deep-STDP framework where a rate-based convolutional network, that can be deployed in a neuromorphic setting, is trained in tandem with pseudo-labels generated by the STDP clustering process on the network outputs. We achieve $24.56\%$ higher accuracy and $3.5\times$ faster convergence speed at iso-accuracy on a 10-class subset of the Tiny ImageNet dataset in contrast to a $k$-means clustering approach.

Computer Vision and Pattern Recognition
High-parallelism Inception-like Spiking Neural Networks for Unsupervised Feature Learning

Mingyuan Meng,Xingyu Yang,Lei Bi,Jinman Kim,Shanlin Xiao,Zhiyi Yu

DOI: https://doi.org/10.1016/j.neucom.2021.02.027

IF: 6

2021-01-01

Neurocomputing

Abstract:Spiking Neural Networks (SNNs) are brain-inspired, event-driven machine learning algorithms that have been widely recognized in producing ultra-high-energy-efficient hardware. Among existing SNNs, unsupervised SNNs based on synaptic plasticity, especially Spike-Timing-Dependent Plasticity (STDP), are considered to have great potential in imitating the learning process of the biological brain. Nevertheless, the existing STDP-based SNNs have limitations in constrained learning capability and/or slow learning speed. Most STDP-based SNNs adopted a slow-learning Fully-Connected (FC) architectures and used a sub-optimal vote-based scheme for spike decoding. In this paper, we overcome these limitations with: 1) a design of high-parallelism network architecture, inspired by the Inception module in Artificial Neural Networks (ANNs); 2) use of a Vote-for-All (VFA) decoding layer as a replacement to the standard vote-based spike decoding scheme, to reduce the information loss in spike decoding and, 3) a proposed adaptive repolarization (resetting) mechanism that accelerates SNNs' learning by enhancing spiking activities. Our experimental results on two established benchmark datasets (MNIST/EMNIST) show that our network architecture resulted in superior performance compared to the widely used FC architecture and a more advanced Locally-Connected (LC) architecture, and that our SNN achieved competitive results with state-of-the-art unsupervised SNNs (95.64%/80.11% accuracy on the MNIST/EMNISE dataset) while having superior learning efficiency and robustness against hardware damage. Our SNN achieved great classification accuracy with only hundreds of training iterations, and random destruction of large numbers of synapses or neurons only led to negligible performance degradation. (c) 2021 Elsevier B.V. All rights reserved.
STDP-based Unsupervised Feature Learning using Convolution-over-time in Spiking Neural Networks for Energy-Efficient Neuromorphic Computing

Gopalakrishnan Srinivasan,Priyadarshini Panda,Kaushik Roy

DOI: https://doi.org/10.1145/3266229

IF: 2.013

2018-10-31

ACM Journal on Emerging Technologies in Computing Systems

Abstract:Brain-inspired learning models attempt to mimic the computations performed in the neurons and synapses constituting the human brain to achieve its efficiency in cognitive tasks. In this work, we propose Spike Timing Dependent Plasticity-based unsupervised feature learning using convolution-over-time in Spiking Neural Network (SNN). We use shared weight kernels that are convolved with the input patterns over time to encode representative input features, thereby improving the sparsity as well as the robustness of the learning model. We show that the Convolutional SNN self-learns several visual categories for object recognition with limited number of training patterns while yielding comparable classification accuracy relative to the fully connected SNN. Further, we quantify the energy benefits of the Convolutional SNN over fully connected SNN on neuromorphic hardware implementation.

engineering, electrical & electronic,computer science, hardware & architecture,nanoscience & nanotechnology
Gliotoxin analogues as inhibitors of reverse transcriptase. 2. Resolution and X-ray crystal structure determination.

H. Ottenheijm,J. Herscheid,M. Tijhuis,R. Nivard,E. De Clercq,P. Prick

DOI: https://doi.org/10.1021/JM00206A016

IF: 8.039

1978-08-01

Journal of Medicinal Chemistry

Abstract:A novel, simple, and efficient method for the chemical resolution of epidithiodioxopiperazines is reported, which is based upon covalent formation of diastereomers. This method might be a general one for the resolution of chiral cyclic disulfides. Dithiol 5, prepared from 2 by reduction with NaBH4, was allowed to react with the disulfenyl chloride 8 to yield 9 and 10, which were separated by short-column chromatography on silica gel. From these, the optically pure enantiomers 11 and 12, respectively, were obtained by reduction with NaBH4, followed by reoxidation with I2-pyridine. In this way the precursor 7 of the resolving agent could also be recovered. The absolute configurations of 11 and 12 were derived from CD spectra. Kinetic asymmetric transformation of the gliotoxin analogue 2 with the diphosphine 6 gave a 19% enrichment in one enantiomer of the starting material. Surprisingly, both enantiomers were found to inhibit reverse transcriptase, the RNA-dependent DNA polymerase, to the same degree, indicating that there is no relation between this property of epidithiodioxopiperazines and their bridgehead configurations. From the X-ray crystal structure determination it can be seen that there is a considerable torsional and conformational strain in compound 2, which might enhance the ease of cleavage of the S-S bond. A possible relationship between this property and the biological activity of 2 is discussed.
SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training

Fangxin Liu,Wenbo Zhao,Yongbiao Chen,Zongwu Wang,Tao Yang,Li Jiang

DOI: https://doi.org/10.3389/fnins.2021.756876

IF: 4.3

2021-11-04

Frontiers in Neuroscience

Abstract:Spiking Neural Networks (SNNs) are a pathway that could potentially empower low-power event-driven neuromorphic hardware due to their spatio-temporal information processing capability and high biological plausibility. Although SNNs are currently more efficient than artificial neural networks (ANNs), they are not as accurate as ANNs. Error backpropagation is the most common method for directly training neural networks, promoting the prosperity of ANNs in various deep learning fields. However, since the signals transmitted in the SNN are non-differentiable discrete binary spike events, the activation function in the form of spikes presents difficulties for the gradient-based optimization algorithms to be directly applied in SNNs, leading to a performance gap (i.e., accuracy and latency) between SNNs and ANNs. This paper introduces a new learning algorithm, called SSTDP, which bridges the gap between backpropagation (BP)-based learning and spike-time-dependent plasticity (STDP)-based learning to train SNNs efficiently. The scheme incorporates the global optimization process from BP and the efficient weight update derived from STDP. It not only avoids the non-differentiable derivation in the BP process but also utilizes the local feature extraction property of STDP. Consequently, our method can lower the possibility of vanishing spikes in BP training and reduce the number of time steps to reduce network latency. In SSTDP, we employ temporal-based coding and use Integrate-and-Fire (IF) neuron as the neuron model to provide considerable computational benefits. Our experiments show the effectiveness of the proposed SSTDP learning algorithm on the SNN by achieving the best classification accuracy 99.3% on the Caltech 101 dataset, 98.1% on the MNIST dataset, and 91.3% on the CIFAR-10 dataset compared to other SNNs trained with other learning methods. It also surpasses the best inference accuracy of the directly trained SNN with 25~32× less inference latency. Moreover, we analyze event-based computations to demonstrate the efficacy of the SNN for inference operation in the spiking domain, and SSTDP methods can achieve 1.3~37.7× fewer addition operations per inference. The code is available at: https://github.com/MXHX7199/SNN-SSTDP .

neurosciences
Unsupervised Visual Feature Learning with Spike-timing-dependent Plasticity: How Far are we from Traditional Feature Learning Approaches?

Pierre Falez,Pierre Tirilly,Ioan Marius Bilasco,Philippe Devienne,Pierre Boulet

DOI: https://doi.org/10.1016/j.patcog.2019.04.016

2019-04-05

Abstract:Spiking neural networks (SNNs) equipped with latency coding and spike-timing dependent plasticity rules offer an alternative to solve the data and energy bottlenecks of standard computer vision approaches: they can learn visual features without supervision and can be implemented by ultra-low power hardware architectures. However, their performance in image classification has never been evaluated on recent image datasets. In this paper, we compare SNNs to auto-encoders on three visual recognition datasets, and extend the use of SNNs to color images. The analysis of the results helps us identify some bottlenecks of SNNs: the limits of on-center/off-center coding, especially for color images, and the ineffectiveness of current inhibition mechanisms. These issues should be addressed to build effective SNNs for image recognition.

Computer Vision and Pattern Recognition,Neural and Evolutionary Computing

Effects of Domain Knowledge on User Performance and Perception in a Knowledge Domain Visualization System

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Unsupervised Spiking Neural Network with Dynamic Learning of Inhibitory Neurons

A frugal Spiking Neural Network for unsupervised classification of continuous multivariate temporal data

Supervised Learning with First-to-Spike Decoding in Multilayer Spiking Neural Networks

An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections

Spiking-timing based pattern recognition with real-world visual stimuli

Digit Recognition using Multimodal Spiking Neural Networks

A Spike-Timing Based Integrated Model for Pattern Recognition

Paired Competing Neurons Improving STDP Supervised Local Learning In Spiking Neural Networks

A Spiking Neuron Synaptic Plasticity Model Optimized for Unsupervised Learning

Deep Unsupervised Learning Using Spike-Timing-Dependent Plasticity

High-parallelism Inception-like Spiking Neural Networks for Unsupervised Feature Learning

STDP-based Unsupervised Feature Learning using Convolution-over-time in Spiking Neural Networks for Energy-Efficient Neuromorphic Computing

Gliotoxin analogues as inhibitors of reverse transcriptase. 2. Resolution and X-ray crystal structure determination.

SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training

Unsupervised Visual Feature Learning with Spike-timing-dependent Plasticity: How Far are we from Traditional Feature Learning Approaches?