Abstract:Convolutional neural networks have shown tremendous performance capabilities in computer vision tasks, but their excessive amounts of weight storage and arithmetic operations prevent them from being adopted in embedded environments. One of the solutions involves pruning, where certain unimportant weights are forced to have a value of zero. Many pruning schemes have been proposed, but these have mainly focused on the number of pruned weights. Previous pruning schemes scarcely considered ASIC or FPGA accelerator architectures. When these pruned networks are run on accelerators, the lack of consideration of the architecture causes some inefficiency problems, including internal buffer misalignments and load imbalances. This paper proposes a new pruning scheme that reflects accelerator architectures. In the proposed scheme, pruning is performed so that the same number of weights remain for each weight group corresponding to activations fetched simultaneously. In this way, the pruning scheme resolves the inefficiency problems, doubling the accelerator performance. Even with this constraint, the proposed pruning scheme reached a pruning ratio similar to that of previous unconstrained pruning schemes, not only on AlexNet and VGG16 but also on state-of-the-art very deep networks such as ResNet. Furthermore, the proposed scheme demonstrated a comparable pruning ratio on compact networks such as MobileNet and on slimmed networks that were already pruned in a channel-wise manner. In addition to improving the efficiency of previous sparse accelerators, it will be also shown that the proposed pruning scheme can be used to reduce the logic complexity of sparse <a class="link-external link-http" href="http://accelerators.The" rel="external noopener nofollow">this http URL</a> pruned models are publicly available at <a class="link-external link-https" href="https://github.com/HyeongjuKang/accelerator-aware-pruning" rel="external noopener nofollow">this https URL</a>.

Exploiting Weight-Level Sparsity in Channel Pruning with Low-Rank Approximation

Deep Neural Network Acceleration Based on Low-Rank Approximated Channel Pruning

Class-Aware Pruning for Efficient Neural Networks

Decouple and Stretch: A Boost to Channel Pruning

Three-Stage Global Channel Pruning for Resources-Limited Platform

A Pruning Method Based on the Dissimilarity of Angle among Channels and Filters

Tight Compression: Compressing CNN Through Fine-Grained Pruning and Weight Permutation for Efficient Implementation

Tight Compression: Compressing CNN Through Fine-Grained Pruning and Weight Permutation for Efficient Implementation

AdaPruner: Adaptive Channel Pruning and Effective Weights Inheritance

Harmonious Coexistence of Structured Weight Pruning and Ternarization for Deep Neural Networks

Adaptive Weight Learning for Dynamic Channel Pruning

Efficient Micro-Structured Weight Unification and Pruning for Neural Network Compression

Weight-adaptive Channel Pruning for CNNs Based on Closeness-Centrality Modeling

A CNN Channel Pruning Low-Bit Framework Using Weight Quantization with Sparse Group Lasso Regularization.

Learning Low Resource Consumption CNN through Pruning and Quantization

Learning Sparse Convolutional Neural Network Via Quantization with Low Rank Regularization

Highly Efficient Sparse Neural Network Computing - Hardware and Software Solutions.

Small-world-based Structural Pruning for Efficient FPGA Inference of Deep Neural Networks

Structured Term Pruning for Computational Efficient Neural Networks Inference

ACP: Adaptive Channel Pruning for Efficient Neural Networks.

Accelerator-Aware Pruning for Convolutional Neural Networks