Abstract:<p>Embedded devices are common carriers for deploying inference networks, which leverage the customized accelerator to achieve the promised performance with strict resource constraints. In the inference of DNN, the sparsity existing in the activations and weights of every layer contributes massive non-effictive memory accesses and computing operations. The data compression is adopted as a data pruning methed for accelerator design, which eliminates the zero-valued data with a specific data packaging method. However, the data compression, in varying degrees, breaks the data regularity of the processing array DNN accelerators caculates with. The complexity of data access caused by irregular data organization will add extra control logic and decoding logic to compensate.</p><p>The accelerator architecture that supports sparsity can use the sophisticated memory access scheming and parallel on-chip decoder structure via an efficient data packaging method to balance memory-accessing and computing for acceleration. In this paper, we propose a flexible and highly parallel accelerator architecture that uses a quantitative data packaging method which is efficient and stable for different degree of sparsity and parallel optimization to explore the sparsity in DNN to achieve high performance with low energy consumption. The total DRAM accesses, performance and energy consumption of the proposed sparse architecture are evaluated with different inference networks. Experiments show that the DRAM accesses of the proposed efficient data packaging method is significantly lower than other commonly used sparse data compression storage methods, the improved performance and saved energy of the sparse accelerator architecture after adopting the optimization method proposed in this paper are up to 1.2x and 1.6x, respectively, over a comparably provisioned do not support sparsity accelerator. In addition, the accelerator architecture proposed has achieved energy efficiency and performance improvements of up to 1.70x and 1.56x,compared with the state-of-the-art architectures.</p>

Spac: A Segment-Based Parallel Compression For Backup Acceleration In Nonvolatile Processors

Reinforcement Learning Based Data Compression for Energy-Efficient Non-volatile Caches.

A Compression-Based Area-Efficient Recovery Architecture for Nonvolatile Processors

PaCC: A Parallel Compare and Compress Codec for Area Reduction in Nonvolatile Processors

NVPC: A Transparent NVM Page Cache

C-Pack: A High-Performance Microprocessor Cache Compression Algorithm

Balancing memory-accessing and computing over sparse DNN accelerator via efficient data packaging

Work-in-Progress: A High-Bandwidth Snappy Decompressor in Reconfigurable Logic

A 3.89-Gops/mw Scalable Recurrent Neural Network Processor with Improved Efficiency on Memory and Computation

Design and Implementation of A High-Performance Microprocessor Cache Compression Algorithm

Register allocation for hybrid register architecture in nonvolatile processors

A 65-Nm ReRAM-Enabled Nonvolatile Processor with Time-Space Domain Adaption and Self-Write-Termination Achieving $> 4\times $ Faster Clock Frequency and $> 6\times $ Higher Restore Speed

Nonvolatile Processor Architectures: Efficient, Reliable Progress with Unstable Power

Refine and Recycle: A Method to Increase Decompression Parallelism.

Forecasting lifetime and performance of a novel NVM last-level cache with compression

Towards Fast De-duplication Using Low Energy Coprocessor

A novel non-volatile memory storage system for I/O-intensive applications

Near-Memory Parallel Indexing and Coalescing: Enabling Highly Efficient Indirect Access for SpMV

Nonvolatile processor optimization for ambient energy harvesting scenarios

Demystifying the Performance of HPC Scientific Applications on NVM-based Memory Systems

On Designing Efficient and Reliable Nonvolatile Memory-Based Computing-In-Memory Accelerators