Abstract:<p>The astonishing development in the field of artificial neural networks (ANN) has brought significant advancement in many application domains, such as pattern recognition, image classification, and computer vision. ANN imitates neuron behaviors and makes a decision or prediction by learning patterns and features from the given data set. To reach higher accuracies, neural networks are getting deeper, and consequently, the computation and storage demands on hardware platforms are steadily increasing. In addition, the massive data communication among neurons makes the interconnection more complex and challenging. To overcome these challenges, ASIC-based DNN accelerators are being designed which usually incorporate customized processing elements, fixed interconnection, and large off-chip memory storage. As a result, DNN computation involves large memory accesses due to frequent load/off-loading data, which significantly increases the energy consumption and latency. Also, the rigid architecture and interconnection among processing elements limit the efficiency of the platform to specific applications. In recent years, Network-on-Chip-based (NoC-based) DNN becomes an emerging design paradigm because the NoC interconnection can help to reduce the off-chip memory accesses while offers better scalability and flexibility. To evaluate the NoC-based DNN in the early design stage, we introduce a cycle-accurate NoC-based DNN simulator, called DNNoC-sim. To support various operations such as convolution and pooling in the modern DNN models, we first propose a DNN flattening technique to convert diverse DNN operation into MAC-like operations. In addition, we propose a DNN slicing method to evaluate the large-scale DNN models on a resource-constraint NoC platform. The evaluation results show a significant reduction in the off-chip memory accesses compared to the state-of-the-art DNN model. We also analyze the performance and discuss the trade-off between different design parameters.</p>

A Scalable Distributed Memory Architecture For Network On Chip

DaDianNao: A Machine-Learning Supercomputer

A Physical-Aware Framework for Memory Network Design Space Exploration

Distributed Memory Management Units Architecture for NoC-based CMPs

Network Main Memory Architecture for NoC-Based Chips

SAMNoC: A Novel Optical Network-on-Chip for Energy-Efficient Memory Access

High Throughput Memory Data-Path Design For Multi-Core Architecture

Performance and power consumption analysis of memory efficient 3D network-on-chip architecture

Network caching for Chip Multiprocessors

Combinatorics and Geometry for the Many-ported, Distributed and Shared Memory Architecture

MultiNoC: A Multiprocessing System Enabled by a Network on Chip

A NoC-based simulator for design and evaluation of deep neural networks

Implementation and Simulation Ofa Cluster-Based Hierarchical NoC Architecture for Multi-Processor SoC

A hybird hierarchical architecture for 3D multi-cluster NoC

Distributed memory interface synthesis for network-on-chips with 3D-stacked DRAMs

Design and Implementation of a Memory Architecture in Dsp for Wireless Communication

A Reconfigurable 2D-Mesh NoC Design with Agile Development Technique of SpinalHDL

FCUDA-NoC: A Scalable and Efficient Network-on-Chip Implementation for the CUDA-to-FPGA Flow

Parallel Solution of FFT on FPGA-Based NUMA Multiprocessor System on Chip

Fpga Implementation Of Hierarchical Memory Architecture For Network Processors

Optimal Placement of Cores, Caches and Memory Controllers in Network On-Chip