Abstract:Convolutional neural networks (CNNs) have demonstrated encouraging results in image classification tasks. However, the prohibitive computational cost of CNNs hinders the deployment of CNNs onto resource-constrained embedded devices. To address this issue, we propose EdgeCompress, a comprehensive compression framework to reduce the computational overhead of CNNs. In EdgeCompress, we first introduce dynamic image cropping (DIC), where we design a lightweight foreground predictor to accurately crop the most informative foreground object of input images for inference, which avoids redundant computation on background regions. Subsequently, we present compound shrinking (CS) to collaboratively compress the three dimensions (depth, width, and resolution) of CNNs according to their contribution to accuracy and model computation. DIC and CS together constitute a multidimensional CNN compression framework, which is able to comprehensively reduce the computational redundancy in both input images and neural network architectures, thereby improving the inference efficiency of CNNs. Further, we present a dynamic inference framework to efficiently process input images with different recognition difficulties, where we cascade multiple models with different complexities from our compression framework and dynamically adopt different models for different input images, which further compresses the computational redundancy and improves the inference efficiency of CNNs, facilitating the deployment of advanced CNNs onto embedded hardware. Experiments on ImageNet-1K demonstrate that EdgeCompress reduces the computation of ResNet-50 by 48.8% while improving the top-1 accuracy by 0.8%. Meanwhile, we improve the accuracy by 4.1% with similar computation compared to HRank. The state-of-the-art compression framework. The source code and models are available at https://github.com/ntuliuteam/edge-compress .

Improved JPEG Lossless Compression for Compression of Intermediate Layers in Neural Networks Based on Compute-In-Memory

Sensitivity-Oriented Layer-Wise Acceleration and Compression for Convolutional Neural Network.

Memory-Efficient Compression Based on Least-Squares Fitting in Convolutional Neural Network Accelerators.

Layer-Wise Training To Create Efficient Convolutional Neural Networks

Joint Optimization of Dimension Reduction and Mixed-Precision Quantization for Activation Compression of Neural Networks

Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding

CNNs for JPEGs: A Study in Computational Cost

Efficient Learned Lossless JPEG Recompression

EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

DeepN-JPEG: A Deep Neural Network Favorable JPEG-based Image Compression Framework

A New Compression Method for Deep Neural Networks with Accuracy Improvement

Improved deep learning image compression model: performance optimization based on convolutional modules and local attention mechanism

Deep Neural Network Interlayer Feature Map Compression Based on Least-Squares Fitting.

Partial Sum Quantization for Computing-In-Memory-Based Neural Network Accelerator

On the Impact of Lossy Image and Video Compression on the Performance of Deep Convolutional Neural Network Architectures

Transform-Based Feature Map Compression for CNN Inference

JPEG Inspired Deep Learning

Sensitivity-based Acceleration and Compression Algorithm for Convolution Neural Network.

TEC-CNN: Towards Efficient Compressing Convolutional Neural Nets with Low-rank Tensor Decomposition

Towards Convolutional Neural Networks Compression Via Global Error Reconstruction.

Deep learning-based Edge-aware pre and post-processing methods for JPEG compressed images