Abstract:<p>Embedded devices are common carriers for deploying inference networks, which leverage the customized accelerator to achieve the promised performance with strict resource constraints. In the inference of DNN, the sparsity existing in the activations and weights of every layer contributes massive non-effictive memory accesses and computing operations. The data compression is adopted as a data pruning methed for accelerator design, which eliminates the zero-valued data with a specific data packaging method. However, the data compression, in varying degrees, breaks the data regularity of the processing array DNN accelerators caculates with. The complexity of data access caused by irregular data organization will add extra control logic and decoding logic to compensate.</p><p>The accelerator architecture that supports sparsity can use the sophisticated memory access scheming and parallel on-chip decoder structure via an efficient data packaging method to balance memory-accessing and computing for acceleration. In this paper, we propose a flexible and highly parallel accelerator architecture that uses a quantitative data packaging method which is efficient and stable for different degree of sparsity and parallel optimization to explore the sparsity in DNN to achieve high performance with low energy consumption. The total DRAM accesses, performance and energy consumption of the proposed sparse architecture are evaluated with different inference networks. Experiments show that the DRAM accesses of the proposed efficient data packaging method is significantly lower than other commonly used sparse data compression storage methods, the improved performance and saved energy of the sparse accelerator architecture after adopting the optimization method proposed in this paper are up to 1.2x and 1.6x, respectively, over a comparably provisioned do not support sparsity accelerator. In addition, the accelerator architecture proposed has achieved energy efficiency and performance improvements of up to 1.70x and 1.56x,compared with the state-of-the-art architectures.</p>

An N-way Group Association Architecture and Sparse Data Group Association Load Balancing Algorithm for Sparse CNN Accelerators

EWS: an Energy-Efficient CNN Accelerator with Enhanced Weight Stationary Dataflow

GAAS: An Efficient Group Associated Architecture and Scheduler Module for Sparse CNN Accelerators

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

An Efficient CNN Accelerator for Pattern-Compressed Sparse Neural Networks on FPGA

An Efficient Sparse CNNs Accelerator on FPGA

A Sparse-Adaptive CNN Processor with Area/Performance balanced N-Way Set-Associate PE Arrays Assisted by a Collision-Aware Scheduler

A Computing Efficient Hardware Architecture for Sparse Deep Neural Network Computing

Balancing memory-accessing and computing over sparse DNN accelerator via efficient data packaging

Crane: Mitigating Accelerator Under-utilization Caused by Sparsity Irregularities in CNNs

An Efficient FPGA Accelerator Optimized for High Throughput Sparse CNN Inference.

Reconfigurable Spatial-Parallel Stochastic Computing for Accelerating Sparse Convolutional Neural Networks

A High-Efficient and Configurable Hardware Accelerator for Convolutional Neural Network

A High-Throughput FPGA Accelerator for Lightweight CNNs With Balanced Dataflow

High Area/Energy Efficiency RRAM CNN Accelerator with Pattern-Pruning-Based Weight Mapping Scheme

A Reconfigurable Accelerator for Sparse Convolutional Neural Networks.

ALSCA: A Large-Scale Sparse CNN Accelerator Using Position-First Dataflow and Input Channel Merging Approach

An Efficient Hardware Design for Accelerating Sparse CNNs With NAS-Based Models

An Efficient Hardware Accelerator for Sparse Convolutional Neural Networks on FPGAs

A Parallel Loading Based Accelerator for Convolution Neural Network

An Efficient Accelerator for Sparse Convolutional Neural Networks