Abstract:<p>Embedded devices are common carriers for deploying inference networks, which leverage the customized accelerator to achieve the promised performance with strict resource constraints. In the inference of DNN, the sparsity existing in the activations and weights of every layer contributes massive non-effictive memory accesses and computing operations. The data compression is adopted as a data pruning methed for accelerator design, which eliminates the zero-valued data with a specific data packaging method. However, the data compression, in varying degrees, breaks the data regularity of the processing array DNN accelerators caculates with. The complexity of data access caused by irregular data organization will add extra control logic and decoding logic to compensate.</p><p>The accelerator architecture that supports sparsity can use the sophisticated memory access scheming and parallel on-chip decoder structure via an efficient data packaging method to balance memory-accessing and computing for acceleration. In this paper, we propose a flexible and highly parallel accelerator architecture that uses a quantitative data packaging method which is efficient and stable for different degree of sparsity and parallel optimization to explore the sparsity in DNN to achieve high performance with low energy consumption. The total DRAM accesses, performance and energy consumption of the proposed sparse architecture are evaluated with different inference networks. Experiments show that the DRAM accesses of the proposed efficient data packaging method is significantly lower than other commonly used sparse data compression storage methods, the improved performance and saved energy of the sparse accelerator architecture after adopting the optimization method proposed in this paper are up to 1.2x and 1.6x, respectively, over a comparably provisioned do not support sparsity accelerator. In addition, the accelerator architecture proposed has achieved energy efficiency and performance improvements of up to 1.70x and 1.56x,compared with the state-of-the-art architectures.</p>

DF-BETA: An FPGA-based Memory Locality Aware Decision Forest Accelerator via Bit-Level Early Termination

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

Towards Efficient and Scalable Acceleration of Online Decision Tree Learning on FPGA

DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference

HarpGBDT: Optimizing Gradient Boosting Decision Tree for Parallel Efficiency

FPGA-Based Near-Memory Acceleration of Modern Data-Intensive Applications

FlexiBit: Fully Flexible Precision Bit-parallel Accelerator Architecture for Arbitrary Mixed Precision AI

Deep random forest with ferroelectric analog content addressable memory

RF-RISA: A novel flexible random forest accelerator based on FPGA

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

Accelerating Bandwidth-Bound Deep Learning Inference with Main-Memory Accelerators

Nanosecond hardware regression trees in FPGA at the LHC

An Area- and Energy-Efficient Hybrid Architecture for Floating-Point FFT Computations.

Balancing memory-accessing and computing over sparse DNN accelerator via efficient data packaging

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

UpDown: Programmable fine-grained Events for Scalable Performance on Irregular Applications

Deep Learning Accelerators' Configuration Space Exploration Effect on Performance and Resource Utilization: A Gemmini Case Study

Accelerating 128-bit Floating-Point Matrix Multiplication on FPGAs

DRAF: A Low-Power DRAM-Based Reconfigurable Acceleration Fabric

A Novel FPGA-Based High Throughput Accelerator For Binary Search Trees