Abstract:Toward the long-standing dream of artificial intelligence, two successful solution paths have been paved: 1) neuromorphic computing and 2) deep learning. Recently, they tend to interact for simultaneously achieving biological plausibility and powerful accuracy. However, models from these two domains have to run on distinct substrates, i.e., neuromorphic platforms and deep learning accelerators, respectively. This architectural incompatibility greatly compromises the modeling flexibility and hinders promising interdisciplinary research. To address this issue, we build a unified model description framework and a unified processing architecture (Tianjic), which covers the full stack from software to hardware. By implementing a set of integration and transformation operations, Tianjic is able to support spiking neural networks, biological dynamic neural networks, multilayered perceptron, convolutional neural networks, recurrent neural networks, and so on. A compatible routing infrastructure enables homogeneous and heterogeneous scalability on a decentralized many-core network. Several optimization methods are incorporated, such as resource and data sharing, near-memory processing, compute/access skipping, and intra-/inter-core pipeline, to improve performance and efficiency. We further design streaming mapping schemes for efficient network deployment with a flexible tradeoff between execution throughput and resource overhead. A 28-nm prototype chip is fabricated with >610-GB/s internal memory bandwidth. A variety of benchmarks are evaluated and compared with GPUs and several existing specialized platforms. In summary, the fully unfolded mapping can achieve significantly higher throughput and power efficiency; the semi-folded mapping can save 30x resources while still presenting comparable performance on average. Finally, two hybrid-paradigm examples, a multimodal unmanned bicycle and a hybrid neural network, are demonstrated to show the potential of our unified architecture. This article paves a new way to explore neural computing.

CorTile: A Scalable Neuromorphic Processing Core for Cortical Simulation with Hybrid-Mode Router and TCAM

TSCM: A TCAM-Based Sparse Connection Memory Architecture in Neuromorphic Computing System for Cortical Simulation

An Ultra-Low Latency Multicast Router for Large-Scale Multi-Chip Neuromorphic Processing

Mosaic: in-memory computing and routing for small-world spike-based neuromorphic systems

BrainS: Customized multi-core embedded multiple scale neuromorphic system

Scalable Digital Neuromorphic Architecture for Large-Scale Biophysically Meaningful Neural Network With Multi-Compartment Neurons

A Co-Designed Neuromorphic Chip with Compact (17.9K F2) and Weak Neuron Number-Dependent Neuron/Synapse Modules

Mapping Very Large Scale Spiking Neuron Network to Neuromorphic Hardware.

A Hybrid-Mode On-Chip Router for the Large-Scale FPGA-Based Neuromorphic Platform

Core interface optimization for multi-core neuromorphic processors

PAICORE: A 1.9-Million-neuron 5.181-TSOPS/W Digital Neuromorphic Processor with Unified SNN-ANN and On-Chip Learning Paradigm

Tianjic: A Unified and Scalable Chip Bridging Spike-Based and Continuous Neural Computation

Real-Time Cortical Simulation on Neuromorphic Hardware

A Neuromorphic Core Based on Threshold Switching Memristor with Asynchronous Address Event Representation Circuits

ActiveN: A Scalable and Flexibly-Programmable Event-Driven Neuromorphic Processor

A System-on-Chip Based Hybrid Neuromorphic Compute Node Architecture for Reproducible Hyper-Real-Time Simulations of Spiking Neural Networks

Extensible neuromorphic computing simulator based on a programmable hardware

TripleBrain: A Compact Neuromorphic Hardware Core With Fast On-Chip Self-Organizing and Reinforcement Spike-Timing Dependent Plasticity

SFANC: Scalable and Flexible Architecture for Neuromorphic Computing

Scaling Limits of Memristor-Based Routers for Asynchronous Neuromorphic Systems

Modular Building Blocks for Mapping Spiking Neural Networks Onto a Programmable Neuromorphic Processor