Structure Level Pruning of Efficient Convolutional Neural Networks with Sparse Group LASSO

Aakash Kumar,Baocai Yin,Ajeet Kumar Bhatia,Avinash Rohra,Arti Bhatia
DOI: https://doi.org/10.18178/ijmlc.2022.12.5.1111
2022-01-01
International Journal of Machine Learning and Computing
Abstract:The rapid progress of convolutional neural networks (CNNs) in multiple applications of practical implementation is generally hindered by an upsurge in network size and computational complexity.Currently, engineers focus on reducing these problems through compressing the CNNs by pruning filters and their weights.In this paper, we present a fresh and easy-to-use pruning approach that reduces the model size by eliminating complete filters and filter weights based on the sparse group LASSO (Least Absolute Shrinkage and Selection Operator) method across the convolutional layers.More precisely, it regulates the sparsity at the feature level and the group level.During the process of pruning, the unnecessary filters with their weights eliminate directly without sacrificing accuracy in the test, resulting in much compact and slimmer architectures.We experimentally compute the effectiveness of our methodology with various state-of-art CNN models on various benchmark data sets.Mainly, CIFAR-10 data sets applied on VGG-16 model and reduce the parameters approx.96.1% and saved approx.83.55% float-point-operations (FLOPs) without sacrificing accuracy and have obtained development in state-of-art.
What problem does this paper attempt to address?