Abstract:Model compression methods are being developed to bridge the gap between the massive scale of neural networks and the limited hardware resources on edge devices. Since most real-world applications deployed on resource-limited hardware platforms typically have multiple hardware constraints simultaneously, most existing model compression approaches that only consider optimizing one single hardware objective are ineffective. In this article, we propose an automated pruning method called multi-constrained model compression (MCMC) that allows for the optimization of multiple hardware targets, such as latency, floating point operations (FLOPs), and memory usage, while minimizing the impact on accuracy. Specifically, we propose an improved multi-objective reinforcement learning (MORL) algorithm, the one-stage envelope deep deterministic policy gradient (DDPG) algorithm, to determine the pruning strategy for neural networks. Our improved one-stage envelope DDPG algorithm reduces exploration time and offers greater flexibility in adjusting target priorities, enhancing its suitability for pruning tasks. For instance, on the visual geometry group (VGG)-16 network, our method achieved an 80% reduction in FLOPs, a 2.31× reduction in memory usage, and a 1.92× acceleration, with an accuracy improvement of 0.09% compared with the baseline. For larger datasets, such as ImageNet, we reduced FLOPs by 50% for MobileNet-V1, resulting in a 4.7× faster speed and 1.48× memory compression, while maintaining the same accuracy. When applied to edge devices, such as JETSON XAVIER NX, our method resulted in a 71% reduction in FLOPs for MobileNet-V1, leading to a 1.63× faster speed, 1.64× memory compression, and an accuracy improvement.

DeepArc: Modularizing Neural Networks for the Model Maintenance.

Class-Aware Pruning for Efficient Neural Networks

MCMC: Multi-Constrained Model Compression Via One-Stage Envelope Reinforcement Learning.

Arch-Net: Model Distillation for Architecture Agnostic Model Deployment

ARCO:Adaptive Multi-Agent Reinforcement Learning-Based Hardware/Software Co-Optimization Compiler for Improved Performance in DNN Accelerator Design

Neural Network Module Decomposition and Recomposition

NeuSemSlice: Towards Effective DNN Model Maintenance via Neuron-level Semantic Slicing

DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks

Modularizing while Training: A New Paradigm for Modularizing DNN Models

OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators

Compressing Deep Networks by Neuron Agglomerative Clustering

Progressive Volume Distillation with Active Learning for Efficient NeRF Architecture Conversion

Efficient Micro-Structured Weight Unification and Pruning for Neural Network Compression

Magical-Decomposition: Winning Both Adversarial Robustness and Efficiency on Hardware

Structural Pruning in Deep Neural Networks: A Small-World Approach

SPARK: Scalable and Precision-Aware Acceleration of Neural Networks Via Efficient Encoding

Efficient Network Construction Through Structural Plasticity

Network Transplanting for the Functionally Modular Architecture.

Breaking Neural Network Scaling Laws with Modularity

Deep Model Compression and Architecture Optimization for Embedded Systems: A Survey

MODULARNAS: TOWARDS MODULARIZED AND REUSABLE NEURAL ARCHITECTURE SEARCH