Abstract:Convolutional neural networks (CNNs) have been widely utilized in modern artificial intelligent (AI) systems. In particular, GoogLeNet, one of the most popular CNNs, consisting of a number of inception layers and max-pooling layers, has been intensively studied for mobile and embedded scenarios. However, the energy efficiency of GoogLeNet in hardware is still limited as the huge data movement between the processor and the memory. Therefore, designing a dataflow and the corresponding hardware architecture to achieve parallel processing with minimal data movement is rather critical to achieve high energy efficiency and throughput. In this paper, we propose a novel column stationary (CS) dataflow that maximally exploits the local data reuse of both the filter weights and feature maps. Moreover, a reconfigurable spatial architecture was proposed to map multiple convolution kernels (with different types and dimensions) in parallel to the processing engines (PEs) array. In this case, multiple convolution kernels can share the same input feature maps (activations) in computing process. In our hardware design, we utilize three typical convolution kernels (i.e., , , , corresponding to the inception layers of GoogLeNet) as an example to test the efficiency of our proposed dataflow and hardware architecture. The accelerator was implemented for one inception layer of the GoogLeNet in a 55-nm foundry's CMOS process. The test results show that our CS dataflow can reduce ~85% energy consumption for memory access and save area of 13% and power of 12% for computing. In summary, our CS dataflow is more energy-efficient compared to state-of-the-art dataflows.

Unified energy-efficient reconfigurable MAC for dynamic Convolutional Neural Network based on Winograd algorithm

EWS: an Energy-Efficient CNN Accelerator with Enhanced Weight Stationary Dataflow

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A Novel Low-Communication Energy-Efficient Reconfigurable CNN Acceleration Architecture

An Energy-Efficient Mixed-Signal Parallel Multiply-Accumulate (MAC) Engine Based on Stochastic Computing

Memory System Designed for Multiply-Accumulate (MAC) Engine Based on Stochastic Computing.

A Reconfigurable Spatial Architecture for Energy-Efficient Inception Neural Networks

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

Energy-Efficient Architecture for FPGA-based Deep Convolutional Neural Networks with Binary Weights

Design of a Generic Dynamically Reconfigurable Convolutional Neural Network Accelerator with Optimal Balance

Optimizing Stochastic Computing for Low Latency Inference of Convolutional Neural Networks

An Asynchronous Energy-Efficient CNN Accelerator with Reconfigurable Architecture.

EncodingNet: A Novel Encoding-based MAC Design for Efficient Neural Network Acceleration

An FPGA-Based Energy-Efficient Reconfigurable Convolutional Neural Network Accelerator for Object Recognition Applications

A High-Performance Systolic Array Accelerator Dedicated for CNN.

A Low-Power Sparse Convolutional Neural Network Accelerator with Pre-Encoding Radix-4 Booth Multiplier

A 65-Nm Energy-Efficient Interframe Data Reuse Neural Network Accelerator for Video Applications

A High Efficient Architecture for Convolution Neural Network Accelerator

MAC-DO: An Efficient Output-Stationary GEMM Accelerator for CNNs Using DRAM Technology

A High-efficiency FPGA-based Accelerator for Convolutional Neural Networks using Winograd Algorithm