Abstract:Model compression methods are being developed to bridge the gap between the massive scale of neural networks and the limited hardware resources on edge devices. Since most real-world applications deployed on resource-limited hardware platforms typically have multiple hardware constraints simultaneously, most existing model compression approaches that only consider optimizing one single hardware objective are ineffective. In this article, we propose an automated pruning method called multi-constrained model compression (MCMC) that allows for the optimization of multiple hardware targets, such as latency, floating point operations (FLOPs), and memory usage, while minimizing the impact on accuracy. Specifically, we propose an improved multi-objective reinforcement learning (MORL) algorithm, the one-stage envelope deep deterministic policy gradient (DDPG) algorithm, to determine the pruning strategy for neural networks. Our improved one-stage envelope DDPG algorithm reduces exploration time and offers greater flexibility in adjusting target priorities, enhancing its suitability for pruning tasks. For instance, on the visual geometry group (VGG)-16 network, our method achieved an 80% reduction in FLOPs, a 2.31× reduction in memory usage, and a 1.92× acceleration, with an accuracy improvement of 0.09% compared with the baseline. For larger datasets, such as ImageNet, we reduced FLOPs by 50% for MobileNet-V1, resulting in a 4.7× faster speed and 1.48× memory compression, while maintaining the same accuracy. When applied to edge devices, such as JETSON XAVIER NX, our method resulted in a 71% reduction in FLOPs for MobileNet-V1, leading to a 1.63× faster speed, 1.64× memory compression, and an accuracy improvement.

Multi-Objective Net Architecture Pruning for Remote Sensing Classification.

Multiobjective ResNet Pruning by Means of EMOAs for Remote Sensing Scene Classification

Pruning by Training: A Novel Deep Neural Network Compression Framework for Image Processing.

Remote Sensing Scene Image Classification Model Based on Multi-Scale Features and Attention Mechanism

Data Customization-based Multiobjective Optimization Pruning Framework for Remote Sensing Scene Classification

MCMC: Multi-Constrained Model Compression Via One-Stage Envelope Reinforcement Learning.

Multi-Objective Compression for CNNs via Evolutionary Algorithm

Network Collaborative Pruning Method for Hyperspectral Image Classification Based on Evolutionary Multi-Task Optimization

A Network Pruning Method for Remote Sensing Image Scene Classification

Pruning Convolutional Neural Networks for Remote Sensing Images

Network Pruning for Remote Sensing Images Classification Based on Interpretable CNNs

Compression of deep neural networks: bridging the gap between conventional-based pruning and evolutionary approach

Remote Sensing Image Target Recognition Based on Pruned Deep Neural Network Models

A Multi-objective Complex Network Pruning Framework Based on Divide-and-conquer and Global Performance Impairment Ranking

RemoteTrimmer: Adaptive Structural Pruning for Remote Sensing Image Classification

Energy-Based CNN Pruning for Remote Sensing Scene Classification

Co-Compression via Superior Gene for Remote Sensing Scene Classification

Evolutionary Multi-Objective One-Shot Filter Pruning for Designing Lightweight Convolutional Neural Network.

Absorption Pruning of Deep Neural Network for Object Detection in Remote Sensing Imagery

Energy-based CNNs Pruning for Remote Sensing Scene Classification

SceneNet: Remote Sensing Scene Classification Deep Learning Network Using Multi-Objective Neural Evolution Architecture Search