Abstract:<p>The astonishing development in the field of artificial neural networks (ANN) has brought significant advancement in many application domains, such as pattern recognition, image classification, and computer vision. ANN imitates neuron behaviors and makes a decision or prediction by learning patterns and features from the given data set. To reach higher accuracies, neural networks are getting deeper, and consequently, the computation and storage demands on hardware platforms are steadily increasing. In addition, the massive data communication among neurons makes the interconnection more complex and challenging. To overcome these challenges, ASIC-based DNN accelerators are being designed which usually incorporate customized processing elements, fixed interconnection, and large off-chip memory storage. As a result, DNN computation involves large memory accesses due to frequent load/off-loading data, which significantly increases the energy consumption and latency. Also, the rigid architecture and interconnection among processing elements limit the efficiency of the platform to specific applications. In recent years, Network-on-Chip-based (NoC-based) DNN becomes an emerging design paradigm because the NoC interconnection can help to reduce the off-chip memory accesses while offers better scalability and flexibility. To evaluate the NoC-based DNN in the early design stage, we introduce a cycle-accurate NoC-based DNN simulator, called DNNoC-sim. To support various operations such as convolution and pooling in the modern DNN models, we first propose a DNN flattening technique to convert diverse DNN operation into MAC-like operations. In addition, we propose a DNN slicing method to evaluate the large-scale DNN models on a resource-constraint NoC platform. The evaluation results show a significant reduction in the off-chip memory accesses compared to the state-of-the-art DNN model. We also analyze the performance and discuss the trade-off between different design parameters.</p>

A Novel Scheme to Map Convolutional Networks to Network-on-Chip with Computing-In-Memory Nodes

An Efficient Algorithm for Mapping Deep Learning Applications on the NoC Architecture

DaDianNao: A Machine-Learning Supercomputer

Optimized Mapping Spiking Neural Networks onto Network-on-Chip.

A Customized NoC Architecture to Enable Highly Localized Computing-On-the-Move DNN Dataflow

Domino: A Tailored Network-on-Chip Architecture to Enable Highly Localized Inter- and Intra-Memory DNN Computing

5 Parallel Prism: A topology for pipelined implementations of convolutional neural networks using computational memory

Memory and Computation Coordinated Mapping of DNNs Onto Complex Heterogeneous SoC.

Minimizing Communication Conflicts in Network-On-Chip Based Processing-In-Memory Architecture

Dataflow Aware Mapping of Convolutional Neural Networks Onto Many-Core Platforms With Network-on-Chip Interconnect

CINOC: Computing in Network-On-Chip with Tiled Many-Core Architectures for Large-Scale General Matrix Multiplications

A Spatial-Designed Computing-In-Memory Architecture Based on Monolithic 3D Integration for High-Performance Systems.

A Reconfigurable Computing-in-Memory Accelerator with Dynamic Group-Based Dataflow and Dual-Input Macro Designs

A NoC-based simulator for design and evaluation of deep neural networks

Pipeline Design of Nonvolatile-based Computing in Memory for Convolutional Neural Networks Inference Accelerators

A Cross-layer Based Mapping for Spiking Neural Network Onto Network on Chip.

Towards efficient allocation of graph convolutional networks on hybrid computation-in-memory architecture

Lattice: an ADC/DAC-less ReRAM-based Processing-In-Memory Architecture for Accelerating Deep Convolution Neural Networks

Approaching the mapping limit with closed-loop mapping strategy for deploying neural networks on neuromorphic hardware

A Configurable Computing-in-Memory Structure Based on Convolutional Neural Network

Memory-aware Scheduling for Complex Wired Networks with Iterative Graph Optimization