Intracellular regions of potassium channels: Kv2.1 and heag

D. Wray

DOI: https://doi.org/10.1007/s00249-008-0354-4

2009-03-01

European Biophysics Journal

Abstract:

What problem does this paper attempt to address?

Time series classification models based on nonlinear spiking neural P systems

Xin Xiong,Min Wu,Juan He,Hong Peng,Jun Wang,Xianzhong Long,Qian Yang

DOI: https://doi.org/10.1016/j.engappai.2023.107603

IF: 8

2024-03-01

Engineering Applications of Artificial Intelligence

Abstract:Reservoir computing (RC) is a novel class of recurrent neural networks (RNN) models. Nonlinear spiking neural P (NSNP) systems are neural-like computing models with nonlinear spiking mechanisms. By introducing NSNP systems as the reservoir, we propose a new RC model for time series classification task, termed TSC-NSNP model. However, due to the high-dimensional nature of the reservoir state space, the TSC-NSNP model, like existing RC models, will encounter some challenges. To address the challenges. we utilize the reservoir model space representation and dimensionality reduction method to propose two improved models, termed TSC-DR-NSNP model and TSC-RMS-NSNP model. The three RC models can be easily realized and learnt in the RC framework. The proposed three RC models are evaluated on 21 benchmark time series classification data sets, and are compared with 20 classification models. The comparisons demonstrate the effectiveness of the presented three RC models for time series classification tasks.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Qiang Yu,Shenglan Li,Huajin Tang,Longbiao Wang,Jianwu Dang,Kay Chen Tan

DOI: https://doi.org/10.1109/tcyb.2020.2984888

IF: 11.8

2022-01-01

IEEE Transactions on Cybernetics

Abstract:Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.
Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Qi Xu,Yaxin Li,Jiangrong Shen,Pingping Zhang,Jian K. Liu,Huajin Tang,Gang Pan

DOI: https://doi.org/10.1109/tnnls.2022.3232106

IF: 14.255

2024-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Thanks to their event-driven nature, spiking neural networks (SNNs) are surmised to be great computation-efficient models. The spiking neurons encode beneficial temporal facts and possess excessive anti-noise properties. However, the high-quality encoding of spatio-temporal complexity and also its training optimization of SNNs are restricted by means of the contemporary problem, this article proposes a novel hierarchical event-driven visual device to explore how information transmits and signifies in the retina the usage of biologically manageable mechanisms. This cognitive model is an augmented spiking-based framework consisting of the function learning capacity of convolutional neural networks (CNNs) with the cognition capability of SNNs. Furthermore, this visual device is modeled in a biological realism way with unsupervised learning rules and advanced spike firing rate encoding methods. We train and test them on some image datasets (Modified National Institute of Standards and Technology (MNIST), Canadian Institute for Advanced Research (CIFAR)10, and its noisy versions) to show that our mannequin can process greater vital data than present cognitive models. This article also proposes a novel quantization approach to make the proposed spiking-based model more efficient for neuromorphic hardware implementation. The outcomes show this joint CNN-SNN model can reap excessive focus accuracy and get more effective generalization ability.
Reservoir computing models based on spiking neural P systems for time series classification

Hong Peng,Xin Xiong,Min Wu,Jun Wang,Qian Yang,David Orellana-Martín,Mario J Pérez-Jiménez,Mario J. Pérez-Jiménez

DOI: https://doi.org/10.1016/j.neunet.2023.10.041

IF: 7.8

2023-10-29

Neural Networks

Abstract:Nonlinear spiking neural P (NSNP) systems are neural-like membrane computing models with nonlinear spiking mechanisms. Because of this nonlinear spiking mechanism, NSNP systems can show rich nonlinear dynamics. Reservoir computing (RC) is a novel recurrent neural network (RNN) and can overcome some shortcomings of traditional RNNs. Based on NSNP systems, we developed two RC variants for time series classification, RC-SNP and RC-RMS-SNP, which are without and integrated with reservoir model space (RMS), respectively. The two RC variants use NSNP systems as the reservoirs and can be easily implemented in the RC framework. The proposed two RC variants were evaluated on 17 benchmark time series classification datasets and compared with 16 state-of-the-art or baseline classification models. The comparison results demonstrate the effectiveness of the proposed two RC variants for time series classification tasks.

computer science, artificial intelligence,neurosciences
A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Qiang Yu,Huajin Tang,Kay Chen Tan,Haoyong Yu

DOI: https://doi.org/10.1016/j.neucom.2013.06.052

IF: 6

2014-01-01

Neurocomputing

Abstract:Neural coding and learning are important components in cognitive memory system, by processing the sensory inputs and distinguishing different patterns to allow for higher level brain functions such as memory storage and retrieval. Benefitting from biological relevance, this paper presents a spiking neural network of leaky integrate-and-fire (LIF) neurons for pattern recognition. A biologically plausible supervised synaptic learning rule is used so that neurons can efficiently make a decision. The whole system contains encoding, learning and readout. Utilizing the temporal coding and learning, networks of spiking neurons can effectively and efficiently perform various classification tasks. It can classify complex patterns of activities stored in a vector, as well as the real-world stimuli. Our approach is also benchmarked on the nonlinearly separable Iris dataset. The proposed approach achieves a good generalization, with a classification accuracy of 99.63% for training and 92.55% for testing. In addition, the trained networks demonstrate that the temporal coding is a viable means for fast neural information processing.
Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

Yajing Zheng,Shixin Li,Rui Yan,Huajin Tang,Kay Chen Tan

DOI: https://doi.org/10.1109/tnnls.2018.2812811

IF: 14.255

2018-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Robust object recognition in spiking neural systems remains a challenging in neuromorphic computing area as it needs to solve both the effective encoding of sensory information and also its integration with downstream learning neurons. We target this problem by developing a spiking neural system consisting of sparse temporal encoding and temporal classifier. We propose a sparse temporal encoding algorithm which exploits both spatial and temporal information derived from an spike-timing-dependent plasticity-based HMAX feature extraction process. The temporal feature representation, thus, becomes more appropriate to be integrated with a temporal classifier based on spiking neurons rather than with nontemporal classifier. The algorithm has been validated on two benchmark data sets and the results show the temporal feature encoding and learning-based method achieves high recognition accuracy. The proposed model provides an efficient approach to perform feature representation and recognition in a consistent temporal learning framework, which is easily adapted to neuromorphic implementations.
An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

Junwei Lu,Junfei Dong,Rui Yan,Huajin Tang

DOI: https://doi.org/10.1109/icaci49185.2020.9177628

2020-01-01

Abstract:This paper introduces an event-based categorization model to explore neuromorphic computing for object recognition. The proposed method makes full use of the precise timing information inherently present in the output of a bio-inspired vision sensor and utilizes event-driven processing to keep the form of address event representation (AER). In this model, a hierarchy of event-based time-surface is used to extract the spatio-temporal features of the AER data, and then these extracted features are classified by spiking neural network (SNN) with event-driven Tempotron rule. To demonstrate the effectiveness of the presented method, we conducted a series of experiments on some accessible AER datasets and compared our method to other developed event-based categorization models. Additional pooling operation in feature extraction can reduce the number of parameters and computing time. Experimental results show that our method has better classification performance and real-time computation. That is, the proposed model can extract useful features and consumes much less simulation time while still maintaining competitive accuracy.
Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Xianglan Wen,Pengjie Gu,Rui Yan,Huajin Tang

DOI: https://doi.org/10.1109/ijcnn48605.2020.9207236

2020-01-01

Abstract:In recent years, the learning of deep spiking neural networks(SNN) has attracted increasing researchers' interest, and has also made important progresses in theories and applications. It is desired to choose a neuron model with biological features and suitable for SNN training. Currently, Leaky Integrate-and-Fire(LIF) model is mainly used in deep SNN and some factors that can express the spatio-temporal information are ignored in the model. In this work, inspired by the Hodgkin-Huxley(H-H) model, we propose an improved LIF neuron model, which is an iterative current-based LIF model with voltage-based variable resistance. The improved neuron model is closer to the characteristics of the biological neuron model, which can make use of the spatio-temporal information. We further construct a new SNN learning algorithm that uses spatio-temporal back propagation by defining a loss function. We evaluated the proposed methods on single-label and multi-label data sets. The experimental results show that the variable resistance of the neuron model will affect the performance of the model. Choosing the appropriate relationship between the variable resistance and the membrane voltage can effectively improve the recognition accuracy.
You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy

Srivatsa P,Kyle Timothy Ng Chu,Burin Amornpaisannon,Yaswanth Tavva,Venkata Pavan Kumar Miriyala,Jibin Wu,Malu Zhang,Haizhou Li,Trevor E. Carlson

DOI: https://doi.org/10.48550/arXiv.2006.09982

2020-11-08

Abstract:In the past decade, advances in Artificial Neural Networks (ANNs) have allowed them to perform extremely well for a wide range of tasks. In fact, they have reached human parity when performing image recognition, for example. Unfortunately, the accuracy of these ANNs comes at the expense of a large number of cache and/or memory accesses and compute operations. Spiking Neural Networks (SNNs), a type of neuromorphic, or brain-inspired network, have recently gained significant interest as power-efficient alternatives to ANNs, because they are sparse, accessing very few weights, and typically only use addition operations instead of the more power-intensive multiply-and-accumulate (MAC) operations. The vast majority of neuromorphic hardware designs support rate-encoded SNNs, where the information is encoded in spike rates. Rate-encoded SNNs could be seen as inefficient as an encoding scheme because it involves the transmission of a large number of spikes. A more efficient encoding scheme, Time-To-First-Spike (TTFS) encoding, encodes information in the relative time of arrival of spikes. While TTFS-encoded SNNs are more efficient than rate-encoded SNNs, they have, up to now, performed poorly in terms of accuracy compared to previous methods. Hence, in this work, we aim to overcome the limitations of TTFS-encoded neuromorphic systems. To accomplish this, we propose: (1) a novel optimization algorithm for TTFS-encoded SNNs converted from ANNs and (2) a novel hardware accelerator for TTFS-encoded SNNs, with a scalable and low-power design. Overall, our work in TTFS encoding and training improves the accuracy of SNNs to achieve state-of-the-art results on MNIST MLPs, while reducing power consumption by 1.46$\times$ over the state-of-the-art neuromorphic hardware.

Neural and Evolutionary Computing,Artificial Intelligence,Hardware Architecture,Machine Learning
A TTFS-based energy and utilization efficient neuromorphic CNN accelerator

Miao Yu,Tingting Xiang,Srivatsa P,Kyle Timothy Ng Chu,Burin Amornpaisannon,Yaswanth Tavva,Venkata Pavan Kumar Miriyala,Trevor E Carlson

DOI: https://doi.org/10.3389/fnins.2023.1121592

2023-05-05

Abstract:Spiking neural networks (SNNs), which are a form of neuromorphic, brain-inspired AI, have the potential to be a power-efficient alternative to artificial neural networks (ANNs). Spikes that occur in SNN systems, also known as activations, tend to be extremely sparse, and low in number. This minimizes the number of data accesses typically needed for processing. In addition, SNN systems are typically designed to use addition operations which consume much less energy than the typical multiply and accumulate operations used in DNN systems. The vast majority of neuromorphic hardware designs support rate-based SNNs, where the information is encoded by spike rates. Generally, rate-based SNNs can be inefficient as a large number of spikes will be transmitted and processed during inference. One coding scheme that has the potential to improve efficiency is the time-to-first-spike (TTFS) coding, where the information isn't presented through the frequency of spikes, but instead through the relative spike arrival time. In TTFS-based SNNs, each neuron can only spike once during the entire inference process, and this results in high sparsity. The activation sparsity of TTFS-based SNNs is higher than rate-based SNNs, but TTFS-based SNNs have yet to achieve the same accuracy as rate-based SNNs. In this work, we propose two key improvements for TTFS-based SNN systems: (1) a novel optimization algorithm to improve the accuracy of TTFS-based SNNs and (2) a novel hardware accelerator for TTFS-based SNNs that uses a scalable and low-power design. Our work in TTFS coding and training improves the accuracy of TTFS-based SNNs to achieve state-of-the-art results on the MNIST and Fashion-MNIST datasets. Meanwhile, our work reduces the power consumption by at least 2.4×, 25.9×, and 38.4× over the state-of-the-art neuromorphic hardware on MNIST, Fashion-MNIST, and CIFAR10, respectively.
PT-Spike: A Precise-Time-Dependent Single Spike Neuromorphic Architecture with Efficient Supervised Learning

Tao Liu,Lei Jiang,Yier Jin,Gang Quan,Wujie Wen

DOI: https://doi.org/10.48550/arXiv.1803.05109

2018-03-14

Abstract:One of the most exciting advancements in AI over the last decade is the wide adoption of ANNs, such as DNN and CNN, in many real-world applications. However, the underlying massive amounts of computation and storage requirement greatly challenge their applicability in resource-limited platforms like the drone, mobile phone, and IoT devices etc. The third generation of neural network model--Spiking Neural Network (SNN), inspired by the working mechanism and efficiency of human brain, has emerged as a promising solution for achieving more impressive computing and power efficiency within light-weighted devices (e.g. single chip). However, the relevant research activities have been narrowly carried out on conventional rate-based spiking system designs for fulfilling the practical cognitive tasks, underestimating SNN's energy efficiency, throughput, and system flexibility. Although the time-based SNN can be more attractive conceptually, its potentials are not unleashed in realistic applications due to lack of efficient coding and practical learning schemes. In this work, a Precise-Time-Dependent Single Spike Neuromorphic Architecture, namely "PT-Spike", is developed to bridge this gap. Three constituent hardware-favorable techniques: precise single-spike temporal encoding, efficient supervised temporal learning, and fast asymmetric decoding are proposed accordingly to boost the energy efficiency and data processing capability of the time-based SNN at a more compact neural network model size when executing real cognitive tasks. Simulation results show that "PT-Spike" demonstrates significant improvements in network size, processing efficiency and power consumption with marginal classification accuracy degradation when compared with the rate-based SNN and ANN under the similar network configuration.

Neural and Evolutionary Computing,Neurons and Cognition
Recent Advances in Scalable Energy-Efficient and Trustworthy Spiking Neural networks: from Algorithms to Technology

Souvik Kundu,Rui-Jie Zhu,Akhilesh Jaiswal,Peter A. Beerel

2023-12-03

Abstract:Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from different sensory modalities, including audio and vision sensors. In this paper, we start with a description of recent advances in algorithmic and optimization innovations to efficiently train and scale low-latency, and energy-efficient spiking neural networks (SNNs) for complex machine learning applications. We then discuss the recent efforts in algorithm-architecture co-design that explores the inherent trade-offs between achieving high energy-efficiency and low latency while still providing high accuracy and trustworthiness. We then describe the underlying hardware that has been developed to leverage such algorithmic innovations in an efficient way. In particular, we describe a hybrid method to integrate significant portions of the model's computation within both memory components as well as the sensor itself. Finally, we discuss the potential path forward for research in building deployable SNN systems identifying key challenges in the algorithm-hardware-application co-design space with an emphasis on trustworthiness.

Hardware Architecture,Artificial Intelligence
MT-Spike: A Multilayer Time-based Spiking Neuromorphic Architecture with Temporal Error Backpropagation

Tao Liu,Zihao Liu,Fuhong Lin,Yier Jin,Gang Quan,Wujie Wen

DOI: https://doi.org/10.48550/arXiv.1803.05117

2018-03-14

Neural and Evolutionary Computing

Abstract:Modern deep learning enabled artificial neural networks, such as Deep Neural Network (DNN) and Convolutional Neural Network (CNN), have achieved a series of breaking records on a broad spectrum of recognition applications. However, the enormous computation and storage requirements associated with such deep and complex neural network models greatly challenge their implementations on resource-limited platforms. Time-based spiking neural network has recently emerged as a promising solution in Neuromorphic Computing System designs for achieving remarkable computing and power efficiency within a single chip. However, the relevant research activities have been narrowly concentrated on the biological plausibility and theoretical learning approaches, causing inefficient neural processing and impracticable multilayer extension thus significantly limitations on speed and accuracy when handling the realistic cognitive tasks. In this work, a practical multilayer time-based spiking neuromorphic architecture, namely "MT-Spike", is developed to fill this gap. With the proposed practical time-coding scheme, average delay response model, temporal error backpropagation algorithm, and heuristic loss function, "MT-Spike" achieves more efficient neural processing through flexible neural model size reduction while offering very competitive classification accuracy for realistic recognition tasks. Simulation results well validated that the algorithmic power of deep multi-layer learning can be seamlessly merged with the efficiency of time-based spiking neuromorphic architecture, demonstrating great potentials of "MT-Spike" in resource and power constrained embedded platforms.
Investigating Biologically Plausible Neural Networks for Reservoir Computing Solutions

Catherine Mia Schöfmann,Maria Fasli,Michael Taynnan Barros

DOI: https://doi.org/10.1109/access.2024.3385339

IF: 3.9

2024-04-16

IEEE Access

Abstract:While deep learning and backpropagation continue to dominate the field of machine learning in terms of benchmarks and versatility, recent neuroscientific advances shed light on more biologically plausible approaches. Spiking neural networks (SNNs), modelled after action potential dynamics, offer inherent time sensitivity and more efficiency in terms of performance to complexity. While investigating paradigms to support such alternatives, we attempt to answer whether reservoir computing can benefit from a spiking network based implementation with elements of biologically realistic models. This is done by varying both hyper-parameters and reservoir generation approaches and comparing implementations to spot potential improvements. We demonstrate how customized training of SNNs can result in competitive performance levels at lower operational complexity and be readily applied to other paradigms, such as the development of reservoir dynamics.

computer science, information systems,telecommunications,engineering, electrical & electronic
Effective and Efficient Computation with Multiple-timescale Spiking Recurrent Neural Networks

Bojian Yin,Federico Corradi,Sander M. Bohté

DOI: https://doi.org/10.1145/3407197.3407225

2020-07-27

Abstract:The emergence of brain-inspired neuromorphic computing as a paradigm for edge AI is motivating the search for high-performance and efficient spiking neural networks to run on this hardware. However, compared to classical neural networks in deep learning, current spiking neural networks lack competitive performance in compelling areas. Here, for sequential and streaming tasks, we demonstrate how a novel type of adaptive spiking recurrent neural network (SRNN) is able to achieve state-of-the-art performance compared to other spiking neural networks and almost reach or exceed the performance of classical recurrent neural networks (RNNs) while exhibiting sparse activity. From this, we calculate a > 100x energy improvement for our SRNNs over classical RNNs on the harder tasks. To achieve this, we model standard and adaptive multiple-timescale spiking neurons as self-recurrent neural units, and leverage surrogate gradients and auto-differentiation in the PyTorch Deep Learning framework to efficiently implement backpropagation-through-time, including learning of the important spiking neuron parameters to adapt our spiking neurons to the tasks.
S-TLLR: STDP-inspired Temporal Local Learning Rule for Spiking Neural Networks

Marco Paul E. Apolinario,Kaushik Roy

2024-10-30

Abstract:Spiking Neural Networks (SNNs) are biologically plausible models that have been identified as potentially apt for deploying energy-efficient intelligence at the edge, particularly for sequential learning tasks. However, training of SNNs poses significant challenges due to the necessity for precise temporal and spatial credit assignment. Back-propagation through time (BPTT) algorithm, whilst the most widely used method for addressing these issues, incurs high computational cost due to its temporal dependency. In this work, we propose S-TLLR, a novel three-factor temporal local learning rule inspired by the Spike-Timing Dependent Plasticity (STDP) mechanism, aimed at training deep SNNs on event-based learning tasks. Furthermore, S-TLLR is designed to have low memory and time complexities, which are independent of the number of time steps, rendering it suitable for online learning on low-power edge devices. To demonstrate the scalability of our proposed method, we have conducted extensive evaluations on event-based datasets spanning a wide range of applications, such as image and gesture recognition, audio classification, and optical flow estimation. In all the experiments, S-TLLR achieved high accuracy, comparable to BPTT, with a reduction in memory between $5-50\times$ and multiply-accumulate (MAC) operations between $1.3-6.6\times$.

Neural and Evolutionary Computing,Machine Learning
Efficient and Effective Time-Series Forecasting with Spiking Neural Networks

Changze Lv,Yansen Wang,Dongqi Han,Xiaoqing Zheng,Xuanjing Huang,Dongsheng Li

2024-05-30

Abstract:Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to difficulties in effective temporal alignment, complexities in encoding processes, and the absence of standardized guidelines for model selection. In this paper, we propose a framework for SNNs in time-series forecasting tasks, leveraging the efficiency of spiking neurons in processing temporal information. Through a series of experiments, we demonstrate that our proposed SNN-based approaches achieve comparable or superior results to traditional time-series forecasting methods on diverse benchmarks with much less energy consumption. Furthermore, we conduct detailed analysis experiments to assess the SNN's capacity to capture temporal dependencies within time-series data, offering valuable insights into its nuanced strengths and effectiveness in modeling the intricate dynamics of temporal data. Our study contributes to the expanding field of SNNs and offers a promising alternative for time-series forecasting tasks, presenting a pathway for the development of more biologically inspired and temporally aware forecasting models. Our code is available at <a class="link-external link-https" href="https://github.com/microsoft/SeqSNN" rel="external noopener nofollow">this https URL</a>.

Neural and Evolutionary Computing
Energy Efficient RRAM Spiking Neural Network for Real Time Classification

Yu Wang,Tianqi Tang,Lixue Xia,Boxun Li,Peng Gu,Huazhong Yang,Hai Li,Yuan Xie

DOI: https://doi.org/10.1145/2742060.2743756

2015-01-01

Abstract:Inspired by the human brain's function and efficiency, neuromorphic computing offers a promising solution for a wide set of tasks, ranging from brain machine interfaces to real-time classification. The spiking neural network (SNN), which encodes and processes information with bionic spikes, is an emerging neuromorphic model with great potential to drastically promote the performance and efficiency of computing systems. However, an energy efficient hardware implementation and the difficulty of training the model significantly limit the application of the spiking neural network. In this work, we address these issues by building an SNN-based energy efficient system for real time classification with metal-oxide resistive switching random-access memory (RRAM) devices. We implement different training algorithms of SNN, including Spiking Time Dependent Plasticity (STDP) and Neural Sampling method. Our RRAM SNN systems for these two training algorithms show good power efficiency and recognition performance on realtime classification tasks, such as the MNIST digit recognition. Finally, we propose a possible direction to further improve the classification accuracy by boosting multiple SNNs.
Ultra-low Latency Spiking Neural Networks with Spatio-Temporal Compression and Synaptic Convolutional Block

Changqing Xu,Yi Liu,Yintang Yang

DOI: https://doi.org/10.48550/arXiv.2203.10006

2022-03-18

Abstract:Spiking neural networks (SNNs), as one of the brain-inspired models, has spatio-temporal information processing capability, low power feature, and high biological plausibility. The effective spatio-temporal feature makes it suitable for event streams classification. However, neuromorphic datasets, such as N-MNIST, CIFAR10-DVS, DVS128-gesture, need to aggregate individual events into frames with a new higher temporal resolution for event stream classification, which causes high training and inference latency. In this work, we proposed a spatio-temporal compression method to aggregate individual events into a few time steps of synaptic current to reduce the training and inference latency. To keep the accuracy of SNNs under high compression ratios, we also proposed a synaptic convolutional block to balance the dramatic change between adjacent time steps. And multi-threshold Leaky Integrate-and-Fire (LIF) with learnable membrane time constant is introduced to increase its information processing capability. We evaluate the proposed method for event streams classification tasks on neuromorphic N-MNIST, CIFAR10-DVS, DVS128 gesture datasets. The experiment results show that our proposed method outperforms the state-of-the-art accuracy on nearly all datasets, using fewer time steps.

Neural and Evolutionary Computing,Computer Vision and Pattern Recognition,Machine Learning
Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms

Tehreem Syed,Vijay Kakani,Xuenan Cui,Hakil Kim

DOI: https://doi.org/10.3390/s21093240

2021-05-07

Abstract:In recent times, the usage of modern neuromorphic hardware for brain-inspired SNNs has grown exponentially. In the context of sparse input data, they are undertaking low power consumption for event-based neuromorphic hardware, specifically in the deeper layers. However, using deep ANNs for training spiking models is still considered as a tedious task. Until recently, various ANN to SNN conversion methods in the literature have been proposed to train deep SNN models. Nevertheless, these methods require hundreds to thousands of time-steps for training and still cannot attain good SNN performance. This work proposes a customized model (VGG, ResNet) architecture to train deep convolutional spiking neural networks. In this current study, the training is carried out using deep convolutional spiking neural networks with surrogate gradient descent backpropagation in a customized layer architecture similar to deep artificial neural networks. Moreover, this work also proposes fewer time-steps for training SNNs with surrogate gradient descent. During the training with surrogate gradient descent backpropagation, overfitting problems have been encountered. To overcome these problems, this work refines the SNN based dropout technique with surrogate gradient descent. The proposed customized SNN models achieve good classification results on both private and public datasets. In this work, several experiments have been carried out on an embedded platform (NVIDIA JETSON TX2 board), where the deployment of customized SNN models has been extensively conducted. Performance validations have been carried out in terms of processing time and inference accuracy between PC and embedded platforms, showing that the proposed customized models and training techniques are feasible for achieving a better performance on various datasets such as CIFAR-10, MNIST, SVHN, and private KITTI and Korean License plate dataset.

Intracellular regions of potassium channels: Kv2.1 and heag

Time series classification models based on nonlinear spiking neural P systems

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Reservoir computing models based on spiking neural P systems for time series classification

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy

A TTFS-based energy and utilization efficient neuromorphic CNN accelerator

PT-Spike: A Precise-Time-Dependent Single Spike Neuromorphic Architecture with Efficient Supervised Learning

Recent Advances in Scalable Energy-Efficient and Trustworthy Spiking Neural networks: from Algorithms to Technology

MT-Spike: A Multilayer Time-based Spiking Neuromorphic Architecture with Temporal Error Backpropagation

Investigating Biologically Plausible Neural Networks for Reservoir Computing Solutions

Effective and Efficient Computation with Multiple-timescale Spiking Recurrent Neural Networks

S-TLLR: STDP-inspired Temporal Local Learning Rule for Spiking Neural Networks

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks

Energy Efficient RRAM Spiking Neural Network for Real Time Classification

Ultra-low Latency Spiking Neural Networks with Spatio-Temporal Compression and Synaptic Convolutional Block

Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms