Abstract:Convolutional neural networks (CNNs) have demonstrated encouraging results in image classification tasks. However, the prohibitive computational cost of CNNs hinders the deployment of CNNs onto resource-constrained embedded devices. To address this issue, we propose EdgeCompress, a comprehensive compression framework to reduce the computational overhead of CNNs. In EdgeCompress, we first introduce dynamic image cropping (DIC), where we design a lightweight foreground predictor to accurately crop the most informative foreground object of input images for inference, which avoids redundant computation on background regions. Subsequently, we present compound shrinking (CS) to collaboratively compress the three dimensions (depth, width, and resolution) of CNNs according to their contribution to accuracy and model computation. DIC and CS together constitute a multidimensional CNN compression framework, which is able to comprehensively reduce the computational redundancy in both input images and neural network architectures, thereby improving the inference efficiency of CNNs. Further, we present a dynamic inference framework to efficiently process input images with different recognition difficulties, where we cascade multiple models with different complexities from our compression framework and dynamically adopt different models for different input images, which further compresses the computational redundancy and improves the inference efficiency of CNNs, facilitating the deployment of advanced CNNs onto embedded hardware. Experiments on ImageNet-1K demonstrate that EdgeCompress reduces the computation of ResNet-50 by 48.8% while improving the top-1 accuracy by 0.8%. Meanwhile, we improve the accuracy by 4.1% with similar computation compared to HRank. The state-of-the-art compression framework. The source code and models are available at https://github.com/ntuliuteam/edge-compress .

Accelerated Inference of Face Detection under Edge-Cloud Collaboration

Extendable Multi-Device Collaborative Pipeline Parallel Inference in the Edge-Cloud Scenario

Optimizing Face Recognition Inference with a Collaborative Edge–Cloud Network

Condense: A Framework for Device and Frequency Adaptive Neural Network Models on the Edge.

AccEPT: an Acceleration Scheme for Speeding Up Edge Pipeline-parallel Training

Cloud–Edge Collaborative Inference with Network Pruning

Accelerating DNN Inference by Edge-Cloud Collaboration

DECC: Delay-Aware Edge-Cloud Collaboration for Accelerating DNN Inference

Performance optimization of target detection based on edge-to-cloud deep learning

Optimization of the Pedestrian and Vehicle Detection Model based on Cloud-Edge Collaboration

Joint Compressing and Partitioning of CNNs for Fast Edge-Cloud Collaborative Intelligence for IoT

Collaborative edge computing for distributed CNN inference acceleration using receptive field-based segmentation

Collaborative DNNs Inference with Joint Model Partition and Compression in Mobile Edge-Cloud Computing Networks

Multi-Compression Scale DNN Inference Acceleration based on Cloud-Edge-End Collaboration

Adaptive Deep Inference Framework for Cloud-Edge Collaboration

Feature Compression for Cloud-Edge Multimodal 3D Object Detection

EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

An Adaptive DNN Inference Acceleration Framework with End–edge–cloud Collaborative Computing

Edge-Cloud Collaborated Object Detection Via Bandwidth Adaptive Difficult-Case Discriminator

Edge-Cloud Collaborated Object Detection via Difficult-Case Discriminator

Context-Aware Deep Model Compression for Edge Cloud Computing