Abstract:With recent advancing of Internet of Things (IoTs), it becomes very attractive to implement the deep convolutional neural networks (DCNNs) onto embedded/portable systems. Presently, executing the software-based DCNNs requires high-performance server clusters in practice, restricting their widespread deployment on the mobile devices. To overcome this issue, considerable research efforts have been conducted in the context of developing highly-parallel and specific DCNN hardware, utilizing GPGPUs, FPGAs, and ASICs. Stochastic Computing (SC), which uses bit-stream to represent a number within [-1, 1] by counting the number of ones in the bit-stream, has a high potential for implementing DCNNs with high scalability and ultra-low hardware footprint. Since multiplications and additions can be calculated using AND gates and multiplexers in SC, significant reductions in power/energy and hardware footprint can be achieved compared to the conventional binary arithmetic implementations. The tremendous savings in power (energy) and hardware resources bring about immense design space for enhancing scalability and robustness for hardware DCNNs. This paper presents the first comprehensive design and optimization framework of SC-based DCNNs (SC-DCNNs). We first present the optimal designs of function blocks that perform the basic operations, i.e., inner product, pooling, and activation function. Then we propose the optimal design of four types of combinations of basic function blocks, named feature extraction blocks, which are in charge of extracting features from input feature maps. Besides, weight storage methods are investigated to reduce the area and power/energy consumption for storing weights. Finally, the whole SC-DCNN implementation is optimized, with feature extraction blocks carefully selected, to minimize area and power/energy consumption while maintaining a high network accuracy level.

A Survey of Stochastic Computing in Energy-Efficient DNNs On-Edge

Unlocking the Non-deterministic Computing Power with Memory-Elastic Multi-Exit Neural Networks

Efficient Partitioning and Communication Scheme-Based Distributed Edge Computing to Accelerate Deep Neural Network

Condense: A Framework for Device and Frequency Adaptive Neural Network Models on the Edge.

Survey on Energy-Efficient Deep Neural Networks for Computer Vision

A Survey of Stochastic Computing Neural Networks for Machine Learning Applications

CoEdge: Cooperative DNN Inference With Adaptive Workload Partitioning Over Heterogeneous Edge Devices

Energy-Efficient Distributed Spiking Neural Network for Wireless Edge Intelligence

New paradigm of FPGA-based computational intelligence from surveying the implementation of DNN accelerators

Stochastic Computing for Sub-0.2V Applications-Technology Evaluation and Design Optimization

A Survey of Intelligent Chip Design Research Based on Spiking Neural Networks

Hardware-aware Neural Architecture Search for Stochastic Computing-Based Neural Networks on Tiny Devices

A Case For Adaptive Deep Neural Networks in Edge Computing

Energy-efficient offloading for DNN-based applications in edge-cloud computing: A hybrid chaotic evolutionary approach

Green Edge AI: A Contemporary Survey

An Online Approach for DNN Model Caching and Processor Allocation in Edge Computing

Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework

Enabling Deep Learning on Edge Devices

Adaptive Distributed Convolutional Neural Network Inference at the Network Edge with ADCNN

SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing

Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing