Abstract:Convolutional Neural Networks (CNNs) have been applied in wide areas of computer vision, and edge intelligence is expected to provide instant AI service with the support of broadband mobile networks. However, the deployment of CNNs on network edge faces severe challenges. First, edge or embedded devices are usually not reliable, and hardware failures can corrupt the CNN system, which is unacceptable for critical applications, such as autonomous driving and object detection on space platforms. Second, edge or embedded devices are usually resource-limited, and therefore traditional redundancy-based protection methods are not applicable due to huge overhead. Although network pruning is effective to reduce the complexity of CNNs, we cannot have sufficient data for performance recovery in many scenarios due to privacy and security concerns. To enhance the reliability of CNNs on resource-limited devices with the few-shot constraint, we propose to construct an ensemble system with weak base CNNs pruned from the original strong CNN. To improve the ensemble performance with diverse base CNNs, we first propose a novel filter importance evaluation method by combining the amplitude and gradient information of the filter. Since the gradient part is related to the input data, different subsets of data are used for layer sensitivity analysis for different base CNNs, so that the different pruning configurations can be obtained for each base CNN. On this basis, a modified ReLU function is proposed to determine the final pruning rate of each layer in each base CNN. Extensive experiments prove that the proposed solution can effectively improve the reliability of CNNs with much less resource requirement for each edge server.

Ensemble of Pruned Networks for Reliable Classifiers

Ensemble-based Reliability Enhancement for Edge-Deployed CNNs in Few-shot Scenarios

Learning to Slim Deep Networks with Bandit Channel Pruning

Reliable Classification with Ensemble Convolutional Neural Networks.

Structured Deep Neural Network Pruning by Varying Regularization Parameters.

Reliability Evaluation of Pruned Neural Networks Against Errors on Parameters.

Reliability Evaluation of FPGA Based Pruned Neural Networks

Structured Pruning for Efficient Convolutional Neural Networks Via Incremental Regularization

Adversarial Structured Neural Network Pruning

Soft Error Tolerant Convolutional Neural Networks on FPGAs with Ensemble Learning

SNPF: Sensitiveness Based Network Pruning Framework for Efficient Edge Computing

A Pruning Method Based on the Dissimilarity of Angle among Channels and Filters

Ex uno plures: Splitting One Model into an Ensemble of Subnetworks

Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNN.

Patching Weak Convolutional Neural Network Models through Modularization and Composition

Cost-Effective Fault Tolerance for CNNs Using Parameter Vulnerability Based Hardening and Pruning

Performance Aware Convolutional Neural Network Channel Pruning for Embedded GPUs

Algorithm-Based Fault Tolerance for Convolutional Neural Networks

Automatic channel pruning via clustering and swarm intelligence optimization for CNN

Students and teachers learning together: a robust training strategy for neural network pruning

Rethinking Class-Discrimination Based CNN Channel Pruning