Abstract:Convolutional neural networks (CNNs) have demonstrated encouraging results in image classification tasks. However, the prohibitive computational cost of CNNs hinders the deployment of CNNs onto resource-constrained embedded devices. To address this issue, we propose EdgeCompress, a comprehensive compression framework to reduce the computational overhead of CNNs. In EdgeCompress, we first introduce dynamic image cropping (DIC), where we design a lightweight foreground predictor to accurately crop the most informative foreground object of input images for inference, which avoids redundant computation on background regions. Subsequently, we present compound shrinking (CS) to collaboratively compress the three dimensions (depth, width, and resolution) of CNNs according to their contribution to accuracy and model computation. DIC and CS together constitute a multidimensional CNN compression framework, which is able to comprehensively reduce the computational redundancy in both input images and neural network architectures, thereby improving the inference efficiency of CNNs. Further, we present a dynamic inference framework to efficiently process input images with different recognition difficulties, where we cascade multiple models with different complexities from our compression framework and dynamically adopt different models for different input images, which further compresses the computational redundancy and improves the inference efficiency of CNNs, facilitating the deployment of advanced CNNs onto embedded hardware. Experiments on ImageNet-1K demonstrate that EdgeCompress reduces the computation of ResNet-50 by 48.8% while improving the top-1 accuracy by 0.8%. Meanwhile, we improve the accuracy by 4.1% with similar computation compared to HRank. The state-of-the-art compression framework. The source code and models are available at https://github.com/ntuliuteam/edge-compress .

JointCS: Joint Search for Deep Model Compression and Segmentation on Heterogeneous IoT Devices

MCMC: Multi-Constrained Model Compression Via One-Stage Envelope Reinforcement Learning.

On-Demand Deep Model Compression for Mobile Devices

Understanding Sensor Data Using Deep Learning Methods on Resource-Constrained Edge Devices.

Deep Model Compression for Mobile Platforms: A Survey

Joint Neural Architecture Search and Quantization

DNN Model Compression for IoT Domain-Specific Hardware Accelerators

Joint Compressing and Partitioning of CNNs for Fast Edge-Cloud Collaborative Intelligence for IoT

JMDC: A Joint Model and Data Compression System for Deep Neural Networks Collaborative Computing in Edge-Cloud Networks

Compressive Sensing Based Asymmetric Semantic Image Compression for Resource-Constrained IoT System

Collaborative DNNs Inference with Joint Model Partition and Compression in Mobile Edge-Cloud Computing Networks

Multi-Component Optimization and Efficient Deployment of Neural-Networks on Resource-Constrained IoT Hardware

Joint Channel Pruning and Quantization-Based CNN Network Learning with Mobile Computing-Based Image Recognition

Multi-Compression Scale DNN Inference Acceleration based on Cloud-Edge-End Collaboration

Joint Optimization With DNN Partitioning and Resource Allocation in Mobile Edge Computing

Deploy Large-Scale Deep Neural Networks in Resource Constrained IoT Devices with Local Quantization Region

Edge-Assisted Real-Time Instance Segmentation for Resource-Limited IoT Devices

Context-Aware Deep Model Compression for Edge Cloud Computing

EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

Energy-efficient Deployment of Deep Learning Applications on Cortex-M based Microcontrollers using Deep Compression

Deep Model Compression and Architecture Optimization for Embedded Systems: A Survey