Abstract:<p>The astonishing development in the field of artificial neural networks (ANN) has brought significant advancement in many application domains, such as pattern recognition, image classification, and computer vision. ANN imitates neuron behaviors and makes a decision or prediction by learning patterns and features from the given data set. To reach higher accuracies, neural networks are getting deeper, and consequently, the computation and storage demands on hardware platforms are steadily increasing. In addition, the massive data communication among neurons makes the interconnection more complex and challenging. To overcome these challenges, ASIC-based DNN accelerators are being designed which usually incorporate customized processing elements, fixed interconnection, and large off-chip memory storage. As a result, DNN computation involves large memory accesses due to frequent load/off-loading data, which significantly increases the energy consumption and latency. Also, the rigid architecture and interconnection among processing elements limit the efficiency of the platform to specific applications. In recent years, Network-on-Chip-based (NoC-based) DNN becomes an emerging design paradigm because the NoC interconnection can help to reduce the off-chip memory accesses while offers better scalability and flexibility. To evaluate the NoC-based DNN in the early design stage, we introduce a cycle-accurate NoC-based DNN simulator, called DNNoC-sim. To support various operations such as convolution and pooling in the modern DNN models, we first propose a DNN flattening technique to convert diverse DNN operation into MAC-like operations. In addition, we propose a DNN slicing method to evaluate the large-scale DNN models on a resource-constraint NoC platform. The evaluation results show a significant reduction in the off-chip memory accesses compared to the state-of-the-art DNN model. We also analyze the performance and discuss the trade-off between different design parameters.</p>

An Effective Data Representation And Computation Scheme In Computer Simulation For Neural Networks

Data Representation and Parallel Processing in Computer Simulation for Biological Neural Networks

Parallel Computation in Computer Simulation for Neural Networks

Research and implementation of computer simulation system for neural networks

Study on Simulator for Biological Neural Networks

Mathematical Modeling and Signal Processing in Computer Simulation for Biological Neural Networks

Mapping Very Large Scale Spiking Neuron Network to Neuromorphic Hardware.

Equation-oriented specification of neural models for simulations

A New Hybrid Neural System Interfacing Neurons and Silicon Hardware for Fast Signal Recognition

Exploration Of A Mechanism To Form Bionic, Self-Growing And Self-Organizing Neural Network

A Biologically Inspired Neurocomputing Circuit for Image Representation

A NoC-based simulator for design and evaluation of deep neural networks

Computational Modeling of Neuronal Networks

A 5.37-TSOPS/W Reconfigurable Neuron Array with Dual-mode Neurons and Asynchronous Synapses for Energy-Efficient Inference and Biological Neural Network Simulation

Spiking Neural Networks Based Cortex Like Mechanism: A Case Study for Facial Expression Recognition

A Modular Workflow for Performance Benchmarking of Neuronal Network Simulations

A Compressed Data Partition and Loop Scheduling Scheme for Neural Networks

A lightweight data-driven spiking neuronal network model of Drosophila olfactory nervous system with dedicated hardware support

FangTianSim: High-Level Cycle-Accurate Resistive Random-Access Memory-Based Multi-Core Spiking Neural Network Processor Simulator

An Architecture for Neural Network Parallel Processor

MODELING NEURAL PATHWAY USING NEURAL NETWORK