Abstract:<p>The astonishing development in the field of artificial neural networks (ANN) has brought significant advancement in many application domains, such as pattern recognition, image classification, and computer vision. ANN imitates neuron behaviors and makes a decision or prediction by learning patterns and features from the given data set. To reach higher accuracies, neural networks are getting deeper, and consequently, the computation and storage demands on hardware platforms are steadily increasing. In addition, the massive data communication among neurons makes the interconnection more complex and challenging. To overcome these challenges, ASIC-based DNN accelerators are being designed which usually incorporate customized processing elements, fixed interconnection, and large off-chip memory storage. As a result, DNN computation involves large memory accesses due to frequent load/off-loading data, which significantly increases the energy consumption and latency. Also, the rigid architecture and interconnection among processing elements limit the efficiency of the platform to specific applications. In recent years, Network-on-Chip-based (NoC-based) DNN becomes an emerging design paradigm because the NoC interconnection can help to reduce the off-chip memory accesses while offers better scalability and flexibility. To evaluate the NoC-based DNN in the early design stage, we introduce a cycle-accurate NoC-based DNN simulator, called DNNoC-sim. To support various operations such as convolution and pooling in the modern DNN models, we first propose a DNN flattening technique to convert diverse DNN operation into MAC-like operations. In addition, we propose a DNN slicing method to evaluate the large-scale DNN models on a resource-constraint NoC platform. The evaluation results show a significant reduction in the off-chip memory accesses compared to the state-of-the-art DNN model. We also analyze the performance and discuss the trade-off between different design parameters.</p>

DANoC: An Efficient Algorithm and Hardware Codesign of Deep Neural Networks on Chip.

Algorithm and hardware codesign of sparse binary network on-chip

DaDianNao: A Machine-Learning Supercomputer

DACO: Pursuing Ultra-low Power Consumption Via DNN-Adaptive CPU-GPU CO-optimization on Mobile Devices

A NoC-based simulator for design and evaluation of deep neural networks

Towards Efficient Neural Networks On-a-chip: Joint Hardware-Algorithm Approaches

Hardware Implementation of Energy Efficient Deep Learning Neural Network Based on Nanoscale Flash Computing Array

A Compact Butterfly-Style Silicon Photonic–Electronic Neural Chip for Hardware-Efficient Deep Learning

Deep Adaptive Network: An Efficient Deep Neural Network with Sparse Binary Connections

Algorithm and Hardware Co-design for Reconfigurable CNN Accelerator

Optical coherent dot-product chip for sophisticated deep learning regression

An Efficient Ensemble Binarized Deep Neural Network on Chip with Perception-Control Integrated.

Invited: Algorithm-Software-Hardware Co-Design for Deep Learning Acceleration

Efficient DNN Algorithm Design and Hardware Acceleration for Low-Level Vision

An Energy-Efficient Deep Belief Network Processor Based on Heterogeneous Multi-Core Architecture With Transposable Memory and On-Chip Learning

Work-in-Progress: BloCirNN: an Efficient Software/hardware Codesign Approach for Neural Network Accelerators with Block-Circulant Matrix

DNA Computing Inspired Deep Networks Design.

Towards Ultra-High Performance and Energy Efficiency of Deep Learning Systems: An Algorithm-Hardware Co-Optimization Framework

Design and Implementation of Deep Neural Network for Edge Computing

Efficient Hardware Optimization Strategies For Deep Neural Networks Acceleration Chip