Abstract:Neural network pruning provides significant performance in reducing the resource requirements for deploying deep convolutional models. Recent pruning techniques concentrate on eliminating less important or redundant channels from the network. However, these well-designed methods conflict in some situations. For example, some filters are important in importance-based methods but may be regarded as redundant in similarity-based methods. So, the correctness of some existing methods is questionable. In this paper, a novel pruning approach, entitled weight-adaptive channel pruning (WACP), is presented to address the problem. Our approach takes full advantage of the feature similarity information instead of simply categorizing the similarity feature as redundant. Specifically, we first reveal that there is a stable similarity relationship between different output features, independent of the batch size of input images. Then, based on the similarity information, we propose a weight-adaptive compensation strategy to minimize the performance loss caused by pruning. Moreover, we design a novel channel pruning algorithm that determines which features should be retained from a set of similar features by introducing the closeness centrality of graph theory. Extensive and targeted experiments have demonstrated the validity of our proposed WACP for compressing networks. The comparison results demonstrate that the WACP achieves state-of-the-art performance on several benchmark networks and datasets, even for a very high compression rate. For example, WACP improves accuracy by 0.46% while reducing FLOPs by 52.2% and parameters by 43.5% with ResNet-56 on CIFAR-10. For ResNet-50 on ImageNet, WACP prunes more than 55% of FLOPs with only a 0.70%/0.42% decline in top-1/top-5 accuracy. The codes are at https://github.com/lsianke/WACP .

Channel Pruning for Efficient Convolution Neural Networks

A Pruning Method Based on the Dissimilarity of Angle among Channels and Filters

Pruning by Training: A Novel Deep Neural Network Compression Framework for Image Processing.

Structured Pruning for Efficient Convolutional Neural Networks Via Incremental Regularization

Reliable Identification of Redundant Kernels for Convolutional Neural Network Compression.

Loss-Driven Channel Pruning of Convolutional Neural Networks.

Pruning filters with L1-norm and standard deviation for CNN compression

Efficient Network Compression Through Smooth-Lasso Constraint

CCPrune: Collaborative Channel Pruning for Learning Compact Convolutional Networks

Weight-adaptive Channel Pruning for CNNs Based on Closeness-Centrality Modeling

A Novel Channel Pruning Approach Based on Local Attention and Global Ranking for CNN Model Compression

Filter Pruning Via Feature Map Clustering.

A Channel-level Pruning Strategy for Convolutional Layers in CNNs

Compressing Convolutional Neural Networks Via Factorized Convolutional Filters

Channel Pruning Based on Mean Gradient for Accelerating Convolutional Neural Networks

Filter Pruning with a Feature Map Entropy Importance Criterion for Convolution Neural Networks Compressing

Convolutional Neural Network Compression Method Based on Multi-Factor Channel Pruning

Learning Low Resource Consumption CNN through Pruning and Quantization

Exploiting Channel Similarity for Network Pruning.

Filter Pruning-Based Two-Step Feature Map Reconstruction

Pruning the Deep Neural Network by Similar Function