Abstract:<p>The astonishing development in the field of artificial neural networks (ANN) has brought significant advancement in many application domains, such as pattern recognition, image classification, and computer vision. ANN imitates neuron behaviors and makes a decision or prediction by learning patterns and features from the given data set. To reach higher accuracies, neural networks are getting deeper, and consequently, the computation and storage demands on hardware platforms are steadily increasing. In addition, the massive data communication among neurons makes the interconnection more complex and challenging. To overcome these challenges, ASIC-based DNN accelerators are being designed which usually incorporate customized processing elements, fixed interconnection, and large off-chip memory storage. As a result, DNN computation involves large memory accesses due to frequent load/off-loading data, which significantly increases the energy consumption and latency. Also, the rigid architecture and interconnection among processing elements limit the efficiency of the platform to specific applications. In recent years, Network-on-Chip-based (NoC-based) DNN becomes an emerging design paradigm because the NoC interconnection can help to reduce the off-chip memory accesses while offers better scalability and flexibility. To evaluate the NoC-based DNN in the early design stage, we introduce a cycle-accurate NoC-based DNN simulator, called DNNoC-sim. To support various operations such as convolution and pooling in the modern DNN models, we first propose a DNN flattening technique to convert diverse DNN operation into MAC-like operations. In addition, we propose a DNN slicing method to evaluate the large-scale DNN models on a resource-constraint NoC platform. The evaluation results show a significant reduction in the off-chip memory accesses compared to the state-of-the-art DNN model. We also analyze the performance and discuss the trade-off between different design parameters.</p>

Neural Network Online Training Platform Based on Embedded System

Realization of SVM Soft Measurement Platform Based on Embedded System

Implementation of SoC of Soft Measurement Algorithm Based on RBF Neural Network

DaDianNao: A Machine-Learning Supercomputer

Design and Implementation of Predictive Control Based on Embedded System

A 0.99-to-4.38 Uj/class Event-Driven Hybrid Neural Network Processor for Full-Spectrum Neural Signal Analyses

A 510 μW 0.738-mm 2 6.2-pJ/SOP Online Learning Multi-Topology SNN Processor With Unified Computation Engine in 40-nm CMOS

EON-1: A Brain-Inspired Processor for Near-Sensor Extreme Edge Online Feature Extraction

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

Real-time Neural Networks Implementation Proposal for Microcontrollers

Optimizing DNN Training with Pipeline Model Parallelism for Enhanced Performance in Embedded Systems

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms

An Energy-Efficient Deep Belief Network Processor Based on Heterogeneous Multi-Core Architecture With Transposable Memory and On-Chip Learning

DYNAP-SE2: a scalable multi-core dynamic neuromorphic asynchronous spiking neural network processor

OCEAN: an On-Chip Incremental-Learning Enhanced Processor with Gated Recurrent Neural Network Accelerators.

CAMEL: Co-Designing AI Models and Embedded DRAMs for Efficient On-Device Learning

Enabling High Performance Deep Learning Networks on Embedded Systems

Neural Network Training for OSNR Estimation -- From Prototype to Product

A NoC-based simulator for design and evaluation of deep neural networks

A 0.086-mm$^2$ 12.7-pJ/SOP 64k-Synapse 256-Neuron Online-Learning Digital Spiking Neuromorphic Processor in 28nm CMOS