Do kainate-lesioned hippocampi become epileptogenic?

J. E. Franck,P. Schwartzkroin

DOI: https://doi.org/10.1016/0006-8993(85)90540-2

IF: 3.61

1985-03-11

Brain Research

Abstract:

What problem does this paper attempt to address?

TripleBrain: An Edge Neuromorphic Architecture for High-accuracy Single-layer Spiking Neural Network with On-chip Self-organizing and Reinforcement Learning

Haibing Wang,Zhen He,Jinsong Rao,Tengxiao Wang,Junxian He,Min Tian,Xichuan Zhou,Liyuan Liu,Nanjian Wu,Cong Shi

DOI: https://doi.org/10.1109/icta53157.2021.9661702

2021-11-24

Abstract:This paper proposes a scalable, high-performance and cost-effective digital neuromorphic hardware architecture for a single-layer SNN model, with fast and accurate on-chip learning capability. To obtain high recognition accuracies while reducing resource cost and processing latency, our neuromorphic architecture combines three brain-inspired factors: the SNN framework, the neuromorphic self-organizing map (SOM) learning (i.e., the unsupervised SOM-STDP learning rule), and the biological reinforcement learning (i.e., the reward-modulated STDP or R-STDP learning rule). Our hardware architecture mainly consists of a parallel and scalable 2D array of sub-network tiles, each computing 8×8 spiking neurons. On the hardware, a single-layer SNN is first trained by the SOM-STDP rule, and then fine-tuned by the R-STDP rule to improve the recognition accuracy. It realized a high performance of 448 frames/s during learning and 1818 fps during inference on the MNIST image dataset, at a 200 MHz clock frequency and 0.95 W power consumption. It attained high accuracies of 95.24% and 81.4% on the MNIST and ETH-80 datasets, respectively.
Brain-Inspired Hardware for Artificial Intelligence: Accelerated Learning in a Physical-Model Spiking Neural Network

Timo C. Wunderlich,Akos F. Kungl,Eric Müller,Johannes Schemmel,Mihai Petrovici

DOI: https://doi.org/10.1007/978-3-030-30487-4_10

2019-10-01

Abstract:Future developments in artificial intelligence will profit from the existence of novel, non-traditional substrates for brain-inspired computing. Neuromorphic computers aim to provide such a substrate that reproduces the brain's capabilities in terms of adaptive, low-power information processing. We present results from a prototype chip of the BrainScaleS-2 mixed-signal neuromorphic system that adopts a physical-model approach with a 1000-fold acceleration of spiking neural network dynamics relative to biological real time. Using the embedded plasticity processor, we both simulate the Pong arcade video game and implement a local plasticity rule that enables reinforcement learning, allowing the on-chip neural network to learn to play the game. The experiment demonstrates key aspects of the employed approach, such as accelerated and flexible learning, high energy efficiency and resilience to noise.

Neural and Evolutionary Computing,Artificial Intelligence,Emerging Technologies
An Efficient Neuromorphic Implementation of Temporal Coding-Based On-Chip STDP Learning

Yi Zhong,Zilin Wang,Xiaoxin Cui,Jian Cao,Yuan Wang

DOI: https://doi.org/10.1109/tcsii.2023.3282653

2023-01-01

IEEE Transactions on Circuits & Systems II Express Briefs

Abstract:Fulfilling brain intelligence on the chip has long been a fascinating and challenging endeavor. Numerous neuromorphic computing platforms based on spiking neural networks have simulated the architecture and information processing of the brain, providing new insights to realize artificial intelligence. However, the critical issue still remains how to effectively learn on site. In this brief, we present a neuromorphic processor aimed at performing instant on-chip learning for edge processing purposes. This design adopts a temporal coding based implementation of nearest-neighbor and additive spike-timing-dependent plasticity (STDP) learning method. A pair of spike tracing counters and a reconfigurable look-up table are deployed to perform the STDP weight updating. And a 16-core architecture is also leveraged to enhance learning parallelism and scalability. Integrating up to 2048 neurons and 2M 8-bit synapses, the processor achieves peak performance of 81.92GSOPS and 22.80GSOPS, with energy efficiency of 1.28pJ/SOP and 4.99pJ/SOP in the inference and learning phases, respectively. Validation experiments demonstrate that it achieves recognition accuracies of 93.54%, 59.46%, 72.67% and 79.77% for MNIST, Fashion-MNIST, EMNIST and Chinese-MNIST datasets by on-chip labeling methods, respectively.
A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Xiaoyue Ji,Zhekang Dong,Chun Sing Lai,Donglian Qi

DOI: https://doi.org/10.1109/mcom.001.21664

IF: 9.03

2022-01-01

IEEE Communications Magazine

Abstract:Brain-inspired approaches can efficiently analyze the activities of biological neural networks and solve computationally hard problems with energy efficiencies unattainable with von Neumann architectures, indicating a significant improvement in the understanding of neuronal communications and functionalities. Here, we present a brain-inspired multimodal signal processing system with organic memristor arrays that can potentially integrate the signal sensory, storage, and computation. To facilitate the multimodal signal processing system design, we used four components. First, we present a multimodal signal sensory module mainly responsible for multimodal (iconic, echoic, olfactory, muscular, and gustatory) signal collection, fusion, and storage. Second, a high-density cross-point memristive synapse array is constructed after fabrication of the albumin protein memristor to realize the dense connectivity between layers of computing, data storage, and communication. Third, considering the structure and function of the brain region, we demonstrate a general learning module for hierarchy learning, which can recognize and imagine multimodal information. Finally, the necessary peripheral circuit module (consisting of winnerless competition function circuit, analog-to-digital converter, digital-to-analog converter, pulse modulator, etc.) is designed. Notably, our system can capture massive amounts of data every second and perform in situ processing of multimodal signals. This study is expected to help achieve the deep integration of nano materials into neuromorphic computing systems and energy-efficient integrated circuits.
eBrainII: a 3 kW Realtime Custom 3D DRAM Integrated ASIC Implementation of a Biologically Plausible Model of a Human Scale Cortex

Dimitrios Stathis,Chirag Sudarshan,Yu Yang,Matthias Jung,Christian Weis,Ahmed Hemani,Anders Lansner,Norbert Wehn

DOI: https://doi.org/10.1007/s11265-020-01562-x

2020-07-07

Journal of Signal Processing Systems

Abstract:Abstract The Artificial Neural Networks (ANNs), like CNN/DNN and LSTM, are not biologically plausible. Despite their initial success, they cannot attain the cognitive capabilities enabled by the dynamic hierarchical associative memory systems of biological brains. The biologically plausible spiking brain models, e.g., cortex, basal ganglia, and amygdala, have a greater potential to achieve biological brain like cognitive capabilities. Bayesian Confidence Propagation Neural Network (BCPNN) is a biologically plausible spiking model of the cortex. A human-scale model of BCPNN in real-time requires 162 TFlop/s, 50 TBs of synaptic weight storage to be accessed with a bandwidth of 200 TBs. The spiking bandwidth is relatively modest at 250 GBs/s. A hand-optimized implementation of rodent scale BCPNN has been done on Tesla K80 GPUs require 3 kWs, we extrapolate from that a human scale network will require 3 MWs. These power numbers rule out such implementations for field deployment as cognition engines in embedded systems. The key innovation that this paper reports is that it is feasible and affordable to implement real-time BCPNN as a custom tiled application-specific integrated circuit (ASIC) in 28 nm technology with custom 3D DRAM - eBrainII - that consumes 3 kW for human scale and 12 watts for rodent scale. Such implementations eminently fulfill the demands for field deployment.
Emulating Brain-like Rapid Learning in Neuromorphic Edge Computing

Kenneth Stewart,Michael Neumeier,Sumit Bam Shrestha,Garrick Orchard,Emre Neftci

2024-08-28

Abstract:Achieving personalized intelligence at the edge with real-time learning capabilities holds enormous promise in enhancing our daily experiences and helping decision making, planning, and sensing. However, efficient and reliable edge learning remains difficult with current technology due to the lack of personalized data, insufficient hardware capabilities, and inherent challenges posed by online learning. Over time and across multiple developmental stages, the brain has evolved to efficiently incorporate new knowledge by gradually building on previous knowledge. In this work, we emulate the multiple stages of learning with digital neuromorphic technology that simulates the neural and synaptic processes of the brain using two stages of learning. First, a meta-training stage trains the hyperparameters of synaptic plasticity for one-shot learning using a differentiable simulation of the neuromorphic hardware. This meta-training process refines a hardware local three-factor synaptic plasticity rule and its associated hyperparameters to align with the trained task domain. In a subsequent deployment stage, these optimized hyperparameters enable fast, data-efficient, and accurate learning of new classes. We demonstrate our approach using event-driven vision sensor data and the Intel Loihi neuromorphic processor with its plasticity dynamics, achieving real-time one-shot learning of new classes that is vastly improved over transfer learning. Our methodology can be deployed with arbitrary plasticity models and can be applied to situations demanding quick learning and adaptation at the edge, such as navigating unfamiliar environments or learning unexpected categories of data through user engagement.

Neural and Evolutionary Computing,Artificial Intelligence
SC-PLR: an Approximate Spiking Neural Network Accelerator with On-Chip Predictive Learning Rule

Wei Liu,Shanlin Xiao,Yue Liu,Zhiyi Yu

DOI: https://doi.org/10.1109/tbcas.2024.3385235

2024-01-01

Abstract:The brain's ability to anticipate future events is crucial for intelligent behavior. However, when deploying the capability to edge devices, there are huge challenges in terms of resources and power consumption. The main obstacle is the state-of-the-art neuromorphic hardware with Spike Timing Dependent Plasticity (STDP) learning rule requires significant computation for synaptic weight updates and memory to store intermediate synaptic weights. In this paper, we proposed an approximate Spiking Neural Network (SNN) accelerator with on-chip Predictive Learning Rule (PLR), which is a biological behavior observed in the brain, named SC-PLR. In SC-PLR, the principles of predictive processing are extended to enable neurons to learn temporal sequences and anticipate future events with minimum synaptic weight updates, while stochastic computing is leveraged to balance the hardware cost, energy efficiency, and accuracy. Simulation results demonstrate that PLR-based SNNs effectively enable adaptive and anticipatory behavior in robotics and decision-making scenarios. Additionally, FPGA implementation results show that the proposed SC-PLR outperforms state-of-the-art STDP-based SNN designs in terms of resources and power consumption. Specifically, our design achieves significant resource savings, including 77.3% Look-Up Table (LUT), 79.4% Flip-Flop (FF), and 56.4% Block RAM (BRAM) resources, and power consumption reduction by 32%.(1) The code is available at https://github.com/lucy-weizi/SC-PLR.
Multicore Spiking Neuromorphic Chip in 180-nm with ReRAM Synapses and Digital Neurons

Hao Jiang,Jikai Lu,Chenggao Zhang,Shuangzhu Tang,Junjie An,Lingli Cheng,Jian Lu,Jinsong Wei,Keji Zhou,Xumeng Zhang,Tuo Shi,Qi Liu

DOI: https://doi.org/10.1109/jetcas.2023.3325158

IF: 5.877

2023-01-01

IEEE Journal on Emerging and Selected Topics in Circuits and Systems

Abstract:Neuromorphic computing based on spike neural networks (SNNs) exhibits great potential in reducing energy consumption in hardware systems. Resistive random-access memory (ReRAM) is regarded as a promising candidate to construct neuromorphic hardware, attributing to their high-density, nonvolatile, and compute-in-memory capability. However, the ReRAM-based neuromorphic chips are still in their infancy, cannot support multicore or with limited neuron configurability. To alleviate these problems, we propose a hybrid multicore SNN chip based on 60 K-ReRAM synapses and 480-digital neurons in the 180 nm node, achieving a synaptic density of 20K bit/mm2 per core. To improve the efficiency of inter-core communication, we adopt a network-on-chip architecture with a bit character encoding strategy. In addition, an adaptive multiplier-less digital neuron is designed to support both Izhikevich and leaky integrate-and-fire models through register bit control, meeting different application scenarios. Finally, we evaluate the performance of our chip on the MNIST dataset recognition tasks, achieving 97.65% accuracy. Also, a minimum energy per synaptic operation (SOP) of 6.6 pJ in the 180 nm node is obtained, outperforming the TrueNorth’s 26 pJ in 28 nm. These results show that our design has a great potential for large-scale SNN implementations and may pave the way for designing high-efficient neuromorphic hardware with ReRAM technology.

engineering, electrical & electronic
An Energy-Efficient Computing-in-Memory Neuromorphic System with On-Chip Training.

Zhao,Yuan Wang,Xinyue Zhang,Xiaoxin Cui,Ru Huang

DOI: https://doi.org/10.1109/biocas.2019.8918995

2019-01-01

Abstract:The aim of neuromorphic computing system is to implement the computational power and efficiency of the human brain. Computing-in-memory (CIM) is a promising and energy-efficient way to perform intensive computations, whose structure is similar to human brain synapse. A 8.78TOPS/W biologically-inspired neuromorphic computing system for pattern recognition based on CIM architecture is presented in this work. The proposed system supports on-chip training with energy-efficient bio-plausible spike-timing-dependent plasticity (STDP) rule and performs multiply-and-accumulate (MAC) computations inside SRAM array during inference, which greatly reduces the energy consumption. Simulated in 65-nm technology, the proposed system achieves good performance and energy efficiency for pattern recognition. The total energy consumption of training and classifying per image of the proposed system is 0.20 nJ. And the proposed spiking neural network (SNN) just consumes 0.074mW at 1.0V with the throughput of 2.5M images/s in inference phase.
PAICORE: A 1.9-Million-neuron 5.181-TSOPS/W Digital Neuromorphic Processor with Unified SNN-ANN and On-Chip Learning Paradigm

Yi Zhong,Yisong Kuang,Kefei Liu,Zilin Wang,Shuo Feng,Guang Chen,Youming Yang,Xiuping Cui,Qiankun Wang,Jian Cao,Song Jia,Yun Liang,Guangyu Sun,Xiaoxin Cui,Ru Huang,Yuan Wang

DOI: https://doi.org/10.1109/jssc.2024.3426319

IF: 5.4

2024-01-01

IEEE Journal of Solid-State Circuits

Abstract:The neuromorphic approach of fulfilling brain-like edge intelligence is confronted with three paramount challenges: 1) ever-increasing application demands versus insufficient on-chip resources; 2) diverse data sources and models versus heterogeneous computing paradigms; and 3) adaptation to real scenarios versus absence of on-chip learning. To bridge those gaps in the current research community, this article presents PAICORE, a 537.98-mm(2) digital neuromorphic processor with a unified computing and learning paradigm. PAICORE is a scalable 1024-core design, integrating over 1.919 million neurons and 4.773 billion synapses on a single chip. PAICORE is implemented in globally asynchronous locally synchronous (GALS) style with a five-level fat up-down quadtree as dedicated network-on-chip (NoC) infrastructure and tiled 2-D chip array as inter-chip architecture. The distributed processing cores fuse the hybrid spiking neural network (SNN), artificial neural network (ANN), and on-chip spike-timing-dependent plasticity (STDP) learning models into a unified description by modular-level reconfiguration. PAICORE achieves the peak performance of 20.74 TSOPS, 41.49 TOPS, and 115.25 GSOPS, with the best energy efficiency of 5.181 TSOPS/W, 10.372 TOPS/W, and 1.222 TSOPS/W for SNN, ANN, and on-chip learning paradigms, respectively. Benefiting from the PAIFLOW software framework, PAICORE hardware platform can be equivalently simulated and efficiently programmed in a large-scale deployment, in accordance with specific optimizing demands for its target multi-paradigm tasks.
Patients' rights in a technology and market driven-Europe.

H. R. Abbing

DOI: https://doi.org/10.1163/157180909X12604572349566

European Journal of Health Law

Abstract:This article deals with the impact on patients' rights of medical and technological advances in a market oriented (European) society: what are the advantages and risks, what are the challenges that lay ahead of us? After introducing the subject matter, the first part deals with risks for patients' rights in the European cross border context (health care, direct to the public screening offers and biomedical research). The second part sketches some of the implications of innovation in health care and medical technology for patients' rights to autonomy and private life, particularly when third party interests are involved. The article ends with some suggestions on how best to protect patients' rights in the perspective of innovation in health care and medical research.
μBrain: An Event-Driven and Fully Synthesizable Architecture for Spiking Neural Networks

Jan Stuijt,Manolis Sifalakis,Amirreza Yousefzadeh,Federico Corradi

DOI: https://doi.org/10.3389/fnins.2021.664208

IF: 4.3

2021-05-19

Frontiers in Neuroscience

Abstract:The development of brain-inspired neuromorphic computing architectures as a paradigm for Artificial Intelligence (AI) at the edge is a candidate solution that can meet strict energy and cost reduction constraints in the Internet of Things (IoT) application areas. Toward this goal, we present μBrain: the first digital yet fully event-driven without clock architecture, with co-located memory and processing capability that exploits event-based processing to reduce an always-on system's overall energy consumption (μW dynamic operation). The chip area in a 40 nm Complementary Metal Oxide Semiconductor (CMOS) digital technology is 2.82 mm 2 including pads (without pads 1.42 mm 2 ). This small area footprint enables μBrain integration in re-trainable sensor ICs to perform various signal processing tasks, such as data preprocessing, dimensionality reduction, feature selection, and application-specific inference. We present an instantiation of the μBrain architecture in a 40 nm CMOS digital chip and demonstrate its efficiency in a radar-based gesture classification with a power consumption of 70 μW and energy consumption of 340 nJ per classification. As a digital architecture, μBrain is fully synthesizable and lends to a fast development-to-deployment cycle in Application-Specific Integrated Circuits (ASIC). To the best of our knowledge, μBrain is the first tiny-scale digital, spike-based, fully parallel, non-Von-Neumann architecture (without schedules, clocks, nor state machines). For these reasons, μBrain is ultra-low-power and offers software-to-hardware fidelity. μBrain enables always-on neuromorphic computing in IoT sensor nodes that require running on battery power for years.

neurosciences
Homogeneous Spiking Neuromorphic System for Real-World Pattern Recognition

Xinyu Wu,Vishal Saxena,Kehan Zhu

DOI: https://doi.org/10.48550/arXiv.1506.01072

2015-06-02

Neural and Evolutionary Computing

Abstract:A neuromorphic chip that combines CMOS analog spiking neurons and memristive synapses offers a promising solution to brain-inspired computing, as it can provide massive neural network parallelism and density. Previous hybrid analog CMOS-memristor approaches required extensive CMOS circuitry for training, and thus eliminated most of the density advantages gained by the adoption of memristor synapses. Further, they used different waveforms for pre and post-synaptic spikes that added undesirable circuit overhead. Here we describe a hardware architecture that can feature a large number of memristor synapses to learn real-world patterns. We present a versatile CMOS neuron that combines integrate-and-fire behavior, drives passive memristors and implements competitive learning in a compact circuit module, and enables in-situ plasticity in the memristor synapses. We demonstrate handwritten-digits recognition using the proposed architecture using transistor-level circuit simulations. As the described neuromorphic architecture is homogeneous, it realizes a fundamental building block for large-scale energy-efficient brain-inspired silicon chips that could lead to next-generation cognitive computing.
The BrainScaleS-2 Accelerated Neuromorphic System With Hybrid Plasticity

Christian Pehle,Sebastian Billaudelle,Benjamin Cramer,Jakob Kaiser,Korbinian Schreiber,Yannik Stradmann,Johannes Weis,Aron Leibfried,Eric Müller,Johannes Schemmel

DOI: https://doi.org/10.3389/fnins.2022.795876

IF: 4.3

2022-02-24

Frontiers in Neuroscience

Abstract:Since the beginning of information processing by electronic components, the nervous system has served as a metaphor for the organization of computational primitives. Brain-inspired computing today encompasses a class of approaches ranging from using novel nano-devices for computation to research into large-scale neuromorphic architectures, such as TrueNorth, SpiNNaker, BrainScaleS, Tianjic, and Loihi. While implementation details differ, spiking neural networks—sometimes referred to as the third generation of neural networks—are the common abstraction used to model computation with such systems. Here we describe the second generation of the BrainScaleS neuromorphic architecture, emphasizing applications enabled by this architecture. It combines a custom analog accelerator core supporting the accelerated physical emulation of bio-inspired spiking neural network primitives with a tightly coupled digital processor and a digital event-routing network.

neurosciences
A Neuromorphic Core Based on Threshold Switching Memristor with Asynchronous Address Event Representation Circuits

Zhejiang Lab,Zhang Jilin,Zhang Xumeng,Wu Zuheng,Wang Rui,Chan Mansun,Chen Hong

DOI: https://doi.org/10.1007/s11432-020-3203-0

2021-01-01

Science China Information Sciences

Abstract:The full memristive network hardware features high density and excellent scalability. However, recent researches on the full memristive network have been limited to a single-layer network, due to the lack of effective and flexible communication between neurons. In this design, we demonstrate a neuromorphic core based on Ag/SiO2/Au threshold switching memristor, which has built-in asynchronous address event representation (AER) circuits to provide flexible communication between neurons. Since temporally sparse spikes are the medium of communication between neurons, the AER circuits are designed to transmit spikes serially which have been encoded with neurons’ addresses before transmission. With the asynchronous circuits design, the AER circuits will detect neurons’ output in real-time. To test the performance of the neuromorphic core, we designed a behavioral simulator for the neuromporphic core to simulate the liquid state machine (LSM) network, which achieves a 100% recognition rate in the free spoken digital dataset. The simulation results show that the neuromorphic core obtains 35 times higher performance than the CPU and 111 times higher energy efficiency than the GPU.
BrainS: Customized multi-core embedded multiple scale neuromorphic system

Bo Gong,Jiang Wang,Meili Lu,Gong Meng,Kai Sun,Siyuan Chang,Zhen Zhang,Xile Wei

DOI: https://doi.org/10.1016/j.neunet.2023.05.043

IF: 7.8

2023-08-01

Neural Networks

Abstract:Research on modeling and mechanisms of the brain remains the most urgent and challenging task. The customized embedded neuromorphic system is one of the most effective approaches for multi-scale simulations ranging from ion channel to network. This paper proposes BrainS, a scalable multi-core embedded neuromorphic system capable of accommodating massive and large-scale simulations. It is designed with rich external extension interfaces to support various types of input/output and communication requirements. The 3D mesh-based topology with an efficient memory access mechanism makes exploring the properties of neuronal networks possible. BrainS operates at 168 MHz and contains a model database ranging from ion channel to network scale within the Fundamental Computing Unit (FCU). At the ion channel scale, the Basic Community Unit (BCU) can perform real-time simulations of a Hodgkin-Huxley (HH) neuron with 16000 ion channels, using 125.54 KB of the SRAM. When the number of ion channels is within 64000, the HH neuron is simulated in real-time by 4 BCUs. At the network scale, the basal ganglia-thalamus (BG-TH) network consisting of 3200 Izhikevich neurons, providing a vital motor regulation function, is simulated in 4 BCUs with a power consumption of 364.8 mW. Overall, BrainS has an excellent performance in real-time and flexible configurability, providing an embedded application solution for multi-scale simulation.

computer science, artificial intelligence,neurosciences
Breaking Liebig's Law: An Advanced Multipurpose Neuromorphic Engine

Runchun Wang,André van Schaik

DOI: https://doi.org/10.3389/fnins.2018.00593

2018-08-29

Abstract:We present a massively-parallel scalable multi-purpose neuromorphic engine. All existing neuromorphic hardware systems suffer from Liebig's law (that the performance of the system is limited by the component in shortest supply) as they have fixed numbers of dedicated neurons and synapses for specific types of plasticity. For any application, it is always the availability of one of these components that limits the size of the model, leaving the others unused. To overcome this problem, our engine adopts a unique novel architecture: an array of identical components, each of which can be configured as a leaky-integrate-and-fire (LIF) neuron, a learning-synapse, or an axon with trainable delay. Spike timing dependent plasticity (STDP) and spike timing dependent delay plasticity (STDDP) are the two supported learning rules. All the parameters are stored in the SRAMs such that runtime reconfiguration is supported. As a proof of concept, we have implemented a prototype system with 16 neural engines, each of which consists of 32768 (32k) components, yielding half a million components, on an entry level FPGA (Altera Cyclone V). We verified the prototype system with measurement results. To demonstrate that our neuromorphic engine is a high performance and scalable digital design, we implemented it using TSMC 28nm HPC technology. Place and route results using Cadence Innovus with a clock frequency of 2.5 GHz show that this engine achieves an excellent area efficiency of 1.68 μm2 per component: 256k (218) components in a silicon area of 650 μm × 680 μm (∼0.44 mm2, the utilization of the silicon area is 98.7%). The power consumption of this engine is 37 mW, yielding a power efficiency of 0.92 pJ per synaptic operation (SOP).
A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

Mingjing Li,Huihui Zhou,Xiaofeng Xu,Zhiwei Zhong,Puli Quan,Xueke Zhu,Yanyu Lin,Wenjie Lin,Hongyu Guo,Junchao Zhang,Yunhao Ma,Wei Wang,Zhengyu Ma,Guoqi Li,Xiaoxin Cui,Yonghong Tian

2024-11-26

Abstract:There is a growing necessity for edge training to adapt to dynamically changing environment. Neuromorphic computing represents a significant pathway for high-efficiency intelligent computation in energy-constrained edges, but existing neuromorphic architectures lack the ability of directly training spiking neural networks (SNNs) based on backpropagation. We develop a multi-core neuromorphic architecture with Feedforward-Propagation, Back-Propagation, and Weight-Gradient engines in each core, supporting high efficient parallel computing at both the engine and core levels. It combines various data flows and sparse computation optimization by fully leveraging the sparsity in SNN training, obtaining a high energy efficiency of 1.05TFLOPS/W@ FP16 @ 28nm, 55 ~ 85% reduction of DRAM access compared to A100 GPU in SNN trainings, and a 20-core deep SNN training and a 5-worker federated learning on FPGAs. Our study develops the first multi-core neuromorphic architecture supporting the direct SNN training, facilitating the neuromorphic computing in edge-learnable applications.

Hardware Architecture,Distributed, Parallel, and Cluster Computing,Machine Learning
Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

Yi Zhong,Zilin Wang,Xiaoxin Cui,Jian Cao,Yuan Wang

DOI: https://doi.org/10.1109/AICAS57966.2023.10168578

2023-01-01

Abstract:Spiking neural network is a promising endeavor to fulfill brain-like intelligence on the chip. Its learning rule, i.e., spike-timing-dependent plasticity (STDP), derived from neurobiology, is perceived as a powerful candidate to facilitate low-cost and high-performance unsupervised training. In this paper, we present a temporal coding based STDP learning method (TC-STDP) to verify the counter and look-up table based circuit design on a neuromorphic prototype chip. In order to perform on-chip STDP learning in an unsupervised manner, this paper concentrates more on detailing the experimental procedures and practical evaluations, where we introduce the matching score as a quantitative index to carry out label assignment and accuracy confirmation. Evaluation experiments demonstrate that the unsupervised STDP learning achieves best on-chip recognition accuracies of 93.51%, 80.33% on MNIST and EMNIST datasets, respectively. Moreover, experiments conducted on ModelNet40 3D dataset also validate the effectiveness of unsupervised STDP rule to perform possible incremental learning.
A 64K-Neuron 64M-1b-Synapse 2.64pJ/SOP Neuromorphic Chip With All Memory on Chip for Spike-Based Models in 65nm CMOS

Yisong Kuang,Xiaoxin Cui,Yi Zhong,Kefei Liu,Chenglong Zou,Zhenhui Dai,Yuan Wang,Dunshan Yu,Ru Huang

DOI: https://doi.org/10.1109/tcsii.2021.3052172

2021-07-01

Abstract:Generally, computer-science-oriented artificial neural networks (ANNs) and neuroscience-oriented spiking neural networks (SNNs) are two main approaches to develop brain-spired non von Neumann computing systems. The goal of exploring complex artificial intelligence (AI) systems demands general neuromorphic hardware platforms compatible with both of them. However, as a result of the obvious differences in their fundamental mathematical expression and coding scheme, many neuromorphic platforms or deep neural network (DNN) accelerators accommodate only one of them. This brief presents a reconfigurable scalable neuromorphic chip based on digital leaky integrate-and-fire (LIF) neuron model targeting low-cost large-scale systems. By unifying ANN and SNN paradigms within a LIF neuron framework with point-to-point (P2P) communication, the chip can accommodate most popular neural networks. The chip adopts distributed on-chip memory architecture with a capacity of 64K neurons and 64M synapses. It achieves a peak throughput of 12.29 GSOP/s at 1.2 V, 192MHz and peak energy efficiency of 2.64 pJ/SOP at 890 mV, 24MHz. The results of implementations of a spike-based spatio-temporal memory model and ternary-weight event-based convolutional neural networks (CNNs) demonstrate outstanding compatibility of the chip.

Do kainate-lesioned hippocampi become epileptogenic?

TripleBrain: An Edge Neuromorphic Architecture for High-accuracy Single-layer Spiking Neural Network with On-chip Self-organizing and Reinforcement Learning

Brain-Inspired Hardware for Artificial Intelligence: Accelerated Learning in a Physical-Model Spiking Neural Network

An Efficient Neuromorphic Implementation of Temporal Coding-Based On-Chip STDP Learning

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

eBrainII: a 3 kW Realtime Custom 3D DRAM Integrated ASIC Implementation of a Biologically Plausible Model of a Human Scale Cortex

Emulating Brain-like Rapid Learning in Neuromorphic Edge Computing

SC-PLR: an Approximate Spiking Neural Network Accelerator with On-Chip Predictive Learning Rule

Multicore Spiking Neuromorphic Chip in 180-nm with ReRAM Synapses and Digital Neurons

An Energy-Efficient Computing-in-Memory Neuromorphic System with On-Chip Training.

PAICORE: A 1.9-Million-neuron 5.181-TSOPS/W Digital Neuromorphic Processor with Unified SNN-ANN and On-Chip Learning Paradigm

Patients' rights in a technology and market driven-Europe.

μBrain: An Event-Driven and Fully Synthesizable Architecture for Spiking Neural Networks

Homogeneous Spiking Neuromorphic System for Real-World Pattern Recognition

The BrainScaleS-2 Accelerated Neuromorphic System With Hybrid Plasticity

A Neuromorphic Core Based on Threshold Switching Memristor with Asynchronous Address Event Representation Circuits

BrainS: Customized multi-core embedded multiple scale neuromorphic system

Breaking Liebig's Law: An Advanced Multipurpose Neuromorphic Engine

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

A 64K-Neuron 64M-1b-Synapse 2.64pJ/SOP Neuromorphic Chip With All Memory on Chip for Spike-Based Models in 65nm CMOS