Abstract:Convolutional neural networks (CNNs) have become powerful algorithms in various tasks. Application-specific integrated circuit (ASIC) has been widely used to accelerate CNN on mobile platforms because of its tremendous energy efficiency and performance. Meanwhile, CNNs have become much sparser with the development of network pruning algorithms. Recent works have employed different methods to improve the energy efficiency and performance of ASIC accelerators by utilizing the sparsity character of CNN. However, some of these methods suffer from tremendous output memory overhead and performance degradation induced by hash collisions. To overcome the aforementioned problem, we propose GAAS: an efficient group associated architecture and scheduler module for sparse CNN accelerators. It achieves smaller output memory overhead and higher performance compared with the state-of-the-art accelerator. Our proposed method GAAS mainly consists of two parts: 1) an n-way group associated architecture to reduce the output memory overhead and 2) a scheduler module to improve the performance. Besides, a load-balancing algorithm is proposed and implemented in the scheduler module to improve the performance by reducing the hash collision rate. To demonstrate the efficiency of GAAS, we implement a 4-way image-principal associated architecture with a 16x16 PE array and the scheduler module on our proposed method. The experimental results on AlexNet, VGG16, ResNet18, and MobileNet show that GAAS can reduce the output memory overhead by 50%, and it can surely improve the performance of them by 1.53x, 1.62x, 1.46x, and 1.55x, respectively.

An Implementation and Improvement of Convolutional Neural Networks on HSA Platform.

EWS: an Energy-Efficient CNN Accelerator with Enhanced Weight Stationary Dataflow

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

Design of FPGA-Based Accelerator for Convolutional Neural Network under Heterogeneous Computing Framework with OpenCL

A High-Performance Systolic Array Accelerator Dedicated for CNN.

A High Efficient Architecture for Convolution Neural Network Accelerator

Optimizing Convolutional Neural Network on FPGA under Heterogeneous Computing Framework with OpenCL

A Flexible and Energy-Efficient Convolutional Neural Network Acceleration with Dedicated ISA and Accelerator

An Efficient Streaming Accelerator for Low Bit-Width Convolutional Neural Networks

A Parallel Loading Based Accelerator for Convolution Neural Network

Heterogeneous Computing for CNN

HBCA: A Toolchain for High-Accuracy Branch-Fused CNN Accelerator on FPGA with Dual-Decimal-Fused Technique

A FPGA-based end-to-end acceleration framework for fast deployment of Convolutional Neural Networks

Efficient Hardware Architectures for Deep Convolutional Neural Network

GAAS: An Efficient Group Associated Architecture and Scheduler Module for Sparse CNN Accelerators

A Software-Hardware Collaboration System for CNN Algorithms Based on FPGA

A High Performance Multi-Bit-Width Booth Vector Systolic Accelerator for NAS Optimized Deep Learning Neural Networks

Exploring Heterogeneous Algorithms for Accelerating Deep Convolutional Neural Networks on FPGAs

A Flexible and Efficient FPGA Accelerator for Various Large-Scale and Lightweight CNNs