Abstract:Deep convolutional neural networks have a large number of parameters and require a significant number of floating-point operations during computation, which limits their deployment in situations where the storage space is limited and computational resources are insufficient, such as in mobile phones and small robots. Many network compression methods have been proposed to address the aforementioned issues, including pruning, low-rank decomposition, quantization, etc. However, these methods typically fail to achieve a significant compression ratio in terms of the parameter count. Even when high compression rates are achieved, the network's performance is often significantly deteriorated, making it difficult to perform tasks effectively. In this study, we propose a more compact representation for neural networks, named Quantized Low-Rank Tensor Decomposition (QLTD), to super compress deep convolutional neural networks. Firstly, we employed low-rank Tucker decomposition to compress the pre-trained weights. Subsequently, to further exploit redundancies within the core tensor and factor matrices obtained through Tucker decomposition, we employed vector quantization to partition and cluster the weights. Simultaneously, we introduced a self-attention module for each core tensor and factor matrix to enhance the training responsiveness in critical regions. The object identification results in the CIFAR10 experiment showed that QLTD achieved a compression ratio of 35.43×, with less than 1% loss in accuracy and a compression ratio of 90.61×, with less than a 2% loss in accuracy. QLTD was able to achieve a significant compression ratio in terms of the parameter count and realize a good balance between compressing parameters and maintaining identification accuracy.

Compression for Text Detection and Recognition Based on Low Bit-Width Quantization

Bit-Quantized-Net: an Effective Method for Compressing Deep Neural Networks.

Bit-shrinking: Limiting Instantaneous Sharpness for Improving Post-training Quantization

Mixed-Precision Quantized Neural Network with Progressively Decreasing Bitwidth For Image Classification and Object Detection.

Regularized Training Framework for Combining Pruning and Quantization to Compress Neural Networks

Focused Quantization for Sparse CNNs

Towards Super Compressed Neural Networks for Object Identification: Quantized Low-Rank Tensor Decomposition with Self-Attention

A Novel Low-Bit Quantization Strategy for Compressing Deep Neural Networks

Fully Quantized Network For Object Detection

Improving Neural Network Efficiency Via Post-training Quantization with Adaptive Floating-Point

Space Efficient Quantization for Deep Convolutional Neural Networks

Deep Neural Network Compression With Single and Multiple Level Quantization

Cnq: Compressor-Based Non-Uniform Quantization Of Deep Neural Networksinspec Keywordsother Keywordskey Words

Residual Quantization for Low Bit-Width Neural Networks.

Unsupervised Network Quantization via Fixed-Point Factorization

Quantization of Deep Neural Networks for Accurate Edge Computing

Μl2q: an Ultra-Low Loss Quantization Method for DNN Compression

Adaptive Layerwise Quantization for Deep Neural Network Compression

CNQ: Compressor‐Based Non‐uniform Quantization of Deep Neural Networks

Towards Low-Bit Quantization of Deep Neural Networks with Limited Data.

Effective Quantization Methods for Recurrent Neural Networks