Abstract:Convolutional neural networks (CNNs) possess strong expressive capabilities, but with the increasing size and cost of modern CNNs, deploying large-scale CNNs in resource-limited environments remains a challenge, making neural network compression a hot topic in contemporary research. Among various compression methods, tensor decomposition shows numerous unique advantages, such as regular data structure, solid mathematical foundation, convenience in training from scratch, and ideal compression rates. However, most existing tensor decompositions do not perform well in compressing CNNs, struggling to balance time and space complexity, and failing to accelerate CNNs in reality. To address these issues. In this paper, we propose a fine-grained KCP tensor decomposition for CNN convolution kernel compression with considerable compression rate and acceleration capability. First, convolution kernels are compressed using 2nd-order KCP decomposition. The decomposed factor tensors are then converted into a four-layer lightweight convolution kernel structure. This structure conducts continuous contraction computations with the input, transforming the convolution computations into a highly efficient lightweight layered matrix multiplication structure. Secondly, we conduct a comprehensive comparison with other methods and analyze the superiority of our method. Comparisons of computational complexity with other typical tensor compression methods, along with simulation experiments on CIFAR-10 and ImageNet datasets, demonstrate that our method can achieve more efficient comprehensive results. These include acceptable accuracy, significantly reduced model size, and real-world acceleration of network inference times. Finally, we further analyze how different combinations of KT rank and CP rank impact the compression effectiveness and expressive capacity of CNNs.

Symmetric Decomposition of Convolution Kernels

Sparse Kronecker Canonical Polyadic Decomposition for Convolutional Neural Networks Compression

Compression Method for Convolution Kernel with KCP-FGTD

Depth-wise Decomposition for Accelerating Separable Convolutions in Efficient Convolutional Neural Networks

Speeding Up Deep Convolutional Neural Networks Based on Tucker-CP Decomposition

Accelerating Convolutional Neural Networks by Removing Interspatial and Interkernel Redundancies.

Drastically Reducing the Number of Trainable Parameters in Deep CNNs by Inter-layer Kernel-sharing

Stable Low-rank Tensor Decomposition for Compression of Convolutional Neural Network

SOKS: Automatic Searching of the Optimal Kernel Shapes for Stripe-Wise Network Pruning

XSepConv: Extremely Separated Convolution for Efficient Deep Networks with Large Kernels

ASKs: Convolution with Any-Shape Kernels for Efficient Neural Networks

Deep Convolutional Neural Networks Compression Method Based on Linear Representation of Kernels

A Pre-defined Sparse Kernel Based Convolution for Deep CNNs

Network Decoupling: From Regular to Depthwise Separable Convolutions

Speeding-up and compression convolutional neural networks by low-rank decomposition without fine-tuning

Fast CNN Inference by Adaptive Sparse Matrix Decomposition.

ACNet: Strengthening the Kernel Skeletons for Powerful CNN Via Asymmetric Convolution Blocks

Sparsing Deep Neural Network Using Semi-Discrete Matrix Decomposition

Enabling Efficient Fast Convolution Algorithms on GPUs Via MegaKernels

TEC-CNN: Towards Efficient Compressing Convolutional Neural Nets with Low-rank Tensor Decomposition

Balanced Decoupled Spatial Convolution for CNNs