Abstract:Neural network pruning provides significant performance in reducing the resource requirements for deploying deep convolutional models. Recent pruning techniques concentrate on eliminating less important or redundant channels from the network. However, these well-designed methods conflict in some situations. For example, some filters are important in importance-based methods but may be regarded as redundant in similarity-based methods. So, the correctness of some existing methods is questionable. In this paper, a novel pruning approach, entitled weight-adaptive channel pruning (WACP), is presented to address the problem. Our approach takes full advantage of the feature similarity information instead of simply categorizing the similarity feature as redundant. Specifically, we first reveal that there is a stable similarity relationship between different output features, independent of the batch size of input images. Then, based on the similarity information, we propose a weight-adaptive compensation strategy to minimize the performance loss caused by pruning. Moreover, we design a novel channel pruning algorithm that determines which features should be retained from a set of similar features by introducing the closeness centrality of graph theory. Extensive and targeted experiments have demonstrated the validity of our proposed WACP for compressing networks. The comparison results demonstrate that the WACP achieves state-of-the-art performance on several benchmark networks and datasets, even for a very high compression rate. For example, WACP improves accuracy by 0.46% while reducing FLOPs by 52.2% and parameters by 43.5% with ResNet-56 on CIFAR-10. For ResNet-50 on ImageNet, WACP prunes more than 55% of FLOPs with only a 0.70%/0.42% decline in top-1/top-5 accuracy. The codes are at https://github.com/lsianke/WACP .

A Hybrid Kernel Pruning Approach for Efficient and Accurate CNNs.

Class-Aware Pruning for Efficient Neural Networks

Loss Constrains Added Squeeze and Excitation Blocks for Pruning Deep Neural Networks

Structured Pruning for Efficient Convolutional Neural Networks Via Incremental Regularization

A Pruning Method Based on the Dissimilarity of Angle among Channels and Filters

Convolutional neural network acceleration algorithm based on filters pruning

Students and teachers learning together: a robust training strategy for neural network pruning

Exploiting Channel Similarity for Network Pruning.

Efficient Block Pruning Based on Kernel and Feature Stablization

Accelerate CNNs from Three Dimensions: A Comprehensive Pruning Framework

Network Pruning Using Sparse Learning and Genetic Algorithm

Complex hybrid weighted pruning method for accelerating convolutional neural networks

Dynamic CNN Accelerator Supporting Efficient Filter Generator with Kernel Enhancement and Online Channel Pruning

A Sensitivity-based Pruning Method for Convolutional Neural Networks.

Weight-adaptive Channel Pruning for CNNs Based on Closeness-Centrality Modeling

Attention-based Adaptive Structured Continuous Sparse Network Pruning

Pruning filters with L1-norm and standard deviation for CNN compression

Multi-grained Pruning Method of Convolutional Neural Network.

Reliable Identification of Redundant Kernels for Convolutional Neural Network Compression.

Adaptive Pruning of Channel Spatial Dependability in Convolutional Neural Networks

Structure Characteristic-Aware Pruning Strategy for Convolutional Neural Networks.