Abstract:Convolutional neural networks have shown tremendous performance capabilities in computer vision tasks, but their excessive amounts of weight storage and arithmetic operations prevent them from being adopted in embedded environments. One of the solutions involves pruning, where certain unimportant weights are forced to have a value of zero. Many pruning schemes have been proposed, but these have mainly focused on the number of pruned weights. Previous pruning schemes scarcely considered ASIC or FPGA accelerator architectures. When these pruned networks are run on accelerators, the lack of consideration of the architecture causes some inefficiency problems, including internal buffer misalignments and load imbalances. This paper proposes a new pruning scheme that reflects accelerator architectures. In the proposed scheme, pruning is performed so that the same number of weights remain for each weight group corresponding to activations fetched simultaneously. In this way, the pruning scheme resolves the inefficiency problems, doubling the accelerator performance. Even with this constraint, the proposed pruning scheme reached a pruning ratio similar to that of previous unconstrained pruning schemes, not only on AlexNet and VGG16 but also on state-of-the-art very deep networks such as ResNet. Furthermore, the proposed scheme demonstrated a comparable pruning ratio on compact networks such as MobileNet and on slimmed networks that were already pruned in a channel-wise manner. In addition to improving the efficiency of previous sparse accelerators, it will be also shown that the proposed pruning scheme can be used to reduce the logic complexity of sparse <a class="link-external link-http" href="http://accelerators.The" rel="external noopener nofollow">this http URL</a> pruned models are publicly available at <a class="link-external link-https" href="https://github.com/HyeongjuKang/accelerator-aware-pruning" rel="external noopener nofollow">this https URL</a>.

Data Stream Oriented Fine-grained Sparse CNN Accelerator with Efficient Unstructured Pruning Strategy

Structured Probabilistic Pruning for Convolutional Neural Network Acceleration.

Structured Deep Neural Network Pruning by Varying Regularization Parameters.

Regularization-Free Structural Pruning for GPU Inference Acceleration

Structured Pruning for Efficient Convolutional Neural Networks Via Incremental Regularization

A High-Speed CNN Hardware Accelerator with Regular Pruning

Tight Compression: Compressing CNN Through Fine-Grained Pruning and Weight Permutation for Efficient Implementation

Tight Compression: Compressing CNN Through Fine-Grained Pruning and Weight Permutation for Efficient Implementation

PCNN: Pattern-based Fine-Grained Regular Pruning Towards Optimizing CNN Accelerators

A Pruning Method Based on the Dissimilarity of Angle among Channels and Filters

Tight Compression: Compressing CNN Model Tightly Through Unstructured Pruning and Simulated Annealing Based Permutation

A Sparse CNN Accelerator for Eliminating Redundant Computations in Intra- and Inter-Convolutional/Pooling Layers

A Mixed-Pruning Based Framework for Embedded Convolutional Neural Network Acceleration.

High Performance CNN Accelerators Based on Hardware and Algorithm Co-Optimization

Accelerator-Aware Pruning for Convolutional Neural Networks

FASS-pruner: Customizing a Fine-Grained CNN Accelerator-Aware Pruning Framework Via Intra-Filter Splitting and Inter-Filter Shuffling

Efficient Structured Pruning Based on Deep Feature Stabilization

Where to Prune: Using LSTM to Guide Data-Dependent Soft Pruning

LAPP: Layer Adaptive Progressive Pruning for Compressing CNNs from Scratch

StructADMM: A Systematic, High-Efficiency Framework of Structured Weight Pruning for DNNs

Dynamic Structure Pruning for Compressing CNNs