Abstract:Toward the long-standing dream of artificial intelligence, two successful solution paths have been paved: 1) neuromorphic computing and 2) deep learning. Recently, they tend to interact for simultaneously achieving biological plausibility and powerful accuracy. However, models from these two domains have to run on distinct substrates, i.e., neuromorphic platforms and deep learning accelerators, respectively. This architectural incompatibility greatly compromises the modeling flexibility and hinders promising interdisciplinary research. To address this issue, we build a unified model description framework and a unified processing architecture (Tianjic), which covers the full stack from software to hardware. By implementing a set of integration and transformation operations, Tianjic is able to support spiking neural networks, biological dynamic neural networks, multilayered perceptron, convolutional neural networks, recurrent neural networks, and so on. A compatible routing infrastructure enables homogeneous and heterogeneous scalability on a decentralized many-core network. Several optimization methods are incorporated, such as resource and data sharing, near-memory processing, compute/access skipping, and intra-/inter-core pipeline, to improve performance and efficiency. We further design streaming mapping schemes for efficient network deployment with a flexible tradeoff between execution throughput and resource overhead. A 28-nm prototype chip is fabricated with >610-GB/s internal memory bandwidth. A variety of benchmarks are evaluated and compared with GPUs and several existing specialized platforms. In summary, the fully unfolded mapping can achieve significantly higher throughput and power efficiency; the semi-folded mapping can save 30x resources while still presenting comparable performance on average. Finally, two hybrid-paradigm examples, a multimodal unmanned bicycle and a hybrid neural network, are demonstrated to show the potential of our unified architecture. This article paves a new way to explore neural computing.

End-to-End Implementation of Various Hybrid Neural Networks on a Cross-Paradigm Neuromorphic Chip

Towards Efficient Deployment of Hybrid SNNs on Neuromorphic and Edge AI Hardware

Multi-grained system integration for hybrid-paradigm brain-inspired computing

NEUTRAMS: Neural Network Transformation and Co-Design under Neuromorphic Hardware Constraints

Tianjic: A Unified and Scalable Chip Bridging Spike-Based and Continuous Neural Computation

Modular Building Blocks for Mapping Spiking Neural Networks Onto a Programmable Neuromorphic Processor

A Hybrid Heterogeneous Neural Network Accelerator Based on Systolic Array

Bridging the Gap Between Neural Networks and Neuromorphic Hardware with A Neural Network Compiler

Neuromorphic Architectures For Hybrid Nanoelectronic Circuits

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

Compiling Spiking Neural Networks to Neuromorphic Hardware

Accelerating Hybrid And Compact Neural Networks Targeting Perception And Control Domains With Coarse-Grained Dataflow Reconfiguration

Bridge the Gap Between Neural Networks and Neuromorphic Hardware with a Neural Network Compiler

Sparsity-Aware In-Memory Neuromorphic Computing Unit With Configurable Topology of Hybrid Spiking and Artificial Neural Network

Mapping Very Large Scale Spiking Neuron Network to Neuromorphic Hardware.

A Mapping Model of SNNs to Neuromorphic Hardware

Heterogeneous Systems with Reconfigurable Neuromorphic Computing Accelerators

A Framework for the General Design and Computation of Hybrid Neural Networks

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Approaching the mapping limit with closed-loop mapping strategy for deploying neural networks on neuromorphic hardware

Neuromorphic Architectures for Nanoelectronic Circuits