Abstract:Convolutional neural networks (CNNs) have demonstrated encouraging results in image classification tasks. However, the prohibitive computational cost of CNNs hinders the deployment of CNNs onto resource-constrained embedded devices. To address this issue, we propose EdgeCompress, a comprehensive compression framework to reduce the computational overhead of CNNs. In EdgeCompress, we first introduce dynamic image cropping (DIC), where we design a lightweight foreground predictor to accurately crop the most informative foreground object of input images for inference, which avoids redundant computation on background regions. Subsequently, we present compound shrinking (CS) to collaboratively compress the three dimensions (depth, width, and resolution) of CNNs according to their contribution to accuracy and model computation. DIC and CS together constitute a multidimensional CNN compression framework, which is able to comprehensively reduce the computational redundancy in both input images and neural network architectures, thereby improving the inference efficiency of CNNs. Further, we present a dynamic inference framework to efficiently process input images with different recognition difficulties, where we cascade multiple models with different complexities from our compression framework and dynamically adopt different models for different input images, which further compresses the computational redundancy and improves the inference efficiency of CNNs, facilitating the deployment of advanced CNNs onto embedded hardware. Experiments on ImageNet-1K demonstrate that EdgeCompress reduces the computation of ResNet-50 by 48.8% while improving the top-1 accuracy by 0.8%. Meanwhile, we improve the accuracy by 4.1% with similar computation compared to HRank. The state-of-the-art compression framework. The source code and models are available at https://github.com/ntuliuteam/edge-compress .

A feature compression method based on similarity matching

Low-Rate Feature Compression for Collaborative Intelligence: Reducing Redundancy in Spatial and Statistical Levels

2C-Net: integrate image compression and classification via deep neural network

Agnostic Feature Compression with Semantic Guided Channel Importance Analysis

Towards On-demand Transmission: Joint Feature and Image Coding with Reversible Neural Networks

Toward Intelligent Sensing: Intermediate Deep Feature Compression

Lossy Intermediate Deep Learning Feature Compression and Evaluation

Lightweight compression of neural network feature tensors for collaborative intelligence

High Efficient 3D Convolution Feature Compression

Lightweight Compression of Intermediate Neural Network Features for Collaborative Intelligence

Intermediate Deep Feature Compression: the Next Battlefield of Intelligent Sensing

An End-to-End Channel-Adaptive Feature Compression Approach in Device-Edge Co-Inference Systems

Video Feature Compression for Machine Tasks

Efficient Feature Compression for Edge-Cloud Systems

Transform-Based Feature Map Compression for CNN Inference

A Joint Compression Scheme of Video Feature Descriptors and Visual Content.

EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

Compressing complex convolutional neural network based on an improved deep compression algorithm

Merging Similar Neurons for Deep Networks Compression

Flexible Variable-Rate Image Feature Compression for Edge-Cloud Systems

Attention-based Variable-Size Feature Compression Module for Edge Inference