Abstract:Toward the long-standing dream of artificial intelligence, two successful solution paths have been paved: 1) neuromorphic computing and 2) deep learning. Recently, they tend to interact for simultaneously achieving biological plausibility and powerful accuracy. However, models from these two domains have to run on distinct substrates, i.e., neuromorphic platforms and deep learning accelerators, respectively. This architectural incompatibility greatly compromises the modeling flexibility and hinders promising interdisciplinary research. To address this issue, we build a unified model description framework and a unified processing architecture (Tianjic), which covers the full stack from software to hardware. By implementing a set of integration and transformation operations, Tianjic is able to support spiking neural networks, biological dynamic neural networks, multilayered perceptron, convolutional neural networks, recurrent neural networks, and so on. A compatible routing infrastructure enables homogeneous and heterogeneous scalability on a decentralized many-core network. Several optimization methods are incorporated, such as resource and data sharing, near-memory processing, compute/access skipping, and intra-/inter-core pipeline, to improve performance and efficiency. We further design streaming mapping schemes for efficient network deployment with a flexible tradeoff between execution throughput and resource overhead. A 28-nm prototype chip is fabricated with >610-GB/s internal memory bandwidth. A variety of benchmarks are evaluated and compared with GPUs and several existing specialized platforms. In summary, the fully unfolded mapping can achieve significantly higher throughput and power efficiency; the semi-folded mapping can save 30x resources while still presenting comparable performance on average. Finally, two hybrid-paradigm examples, a multimodal unmanned bicycle and a hybrid neural network, are demonstrated to show the potential of our unified architecture. This article paves a new way to explore neural computing.

Multi-grained system integration for hybrid-paradigm brain-inspired computing

Towards artificial general intelligence with hybrid Tianjic chip architecture

Tianjic: A Unified and Scalable Chip Bridging Spike-Based and Continuous Neural Computation

End-to-End Implementation of Various Hybrid Neural Networks on a Cross-Paradigm Neuromorphic Chip

DaDianNao: A Machine-Learning Supercomputer

Development of a Neuromorphic Computing System

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Research on General-Purpose Brain-Inspired Computing Systems

BiCoSS: Toward Large-Scale Cognition Brain With Multigranular Neuromorphic Architecture

UIC: A Unified and Scalable Chip Integrating Neuromorphic Computation and General Purpose Processor

Neuromorphic computing chip with spatiotemporal elasticity for multi-intelligent-tasking robots

Hybrid Signal Integrity Modeling and Analysis of Heterogeneous Integrated System with Neuromorphic Darwin Chip

A Brain-Inspired Hierarchical Interactive In-Memory Computing System and Its Application in Video Sentiment Analysis

Towards "general Purpose" Brain-Inspired Computing System

Brain-inspired Global-Local Learning Incorporated with Neuromorphic Computing

A hybrid and scalable brain-inspired robotic platform

Hybrid Neural State Machine for Neural Network

Post-silicon nano-electronic device and its application in brain-inspired chips

BrainS: Customized multi-core embedded multiple scale neuromorphic system

Brain Inspired Computing Devices, Chips and System

A Hybrid Brain-Inspired Computing Architecture towards Artificial General Intelligence