Abstract:Despite being widely deployed in safety-critical applications such as autonomous driving and health care, deep neural networks (DNNs) still suffer from non-negligible reliability issues. Numerous works had reported that DNNs were vulnerable to either natural environmental noises or man-made adversarial noises. How to repair DNNs in deployment with noisy samples is a crucial topic for the robustness of neural networks. While many network repairing methods based on data argumentation and weight adjustment have been proposed, they require retraining and redeploying the whole model, which causes high overhead and are infeasible for varying faulty cases on different deployment environments. In this paper, we propose a novel network repairing framework called PatchNAS from the architecture perspective, where we freeze the pretrained DNNs and introduce a small patch network to deal with failure samples at runtime. PatchNAS introduces a novel network instrumentation method to determine the faulty stage of the network structure given the collected failure samples. Then a small patch network structure is searched unsupervisedly using neural architecture search (NAS) technique with data samples from deployment environment. The patch network repairs the DNNs by correcting the output feature maps of the faulty stage, which helps to maintain network performance on normal samples and enhance robustness in noisy environments. Extensive experiments based on several DNNs across 15 types of natural noises show that the proposed PatchNAS outperforms the state-of-the-arts with significant improvement as well as much lower deployment overhead.

Patching in Order: Efficient On-Device Model Fine-Tuning for Multi-DNN Vision Applications

Condense: A Framework for Device and Frequency Adaptive Neural Network Models on the Edge.

Extendable Multi-Device Collaborative Pipeline Parallel Inference in the Edge-Cloud Scenario

AccEPT: an Acceleration Scheme for Speeding Up Edge Pipeline-parallel Training

ElasticDNN: On-device Neural Network Remodeling for Adapting Evolving Vision Domains at Edge

Context-Aware Compilation of DNN Training Pipelines across Edge and Cloud

Adaptive Precision Training for Resource Constrained Devices

MatchNAS: Optimizing Edge AI in Sparse-Label Data Contexts via Automating Deep Neural Network Porting for Mobile Deployment

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge

Inference Acceleration with Adaptive Distributed DNN Partition over Dynamic Video Stream

Model Parallelism Optimization for Distributed DNN Inference on Edge Devices.

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments

Accelerating Deep Neural Network Tasks Through Edge-Device Adaptive Inference

PASS: Patch Automatic Skip Scheme for Efficient On-device Video Perception

CamoNet: On-Device Neural Network Adaptation with Zero Interaction and Unlabeled Data for Diverse Edge Environments

FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices.

PatchNAS: Repairing DNNs in Deployment with Patched Network Architecture Search.

Edge Intelligence: On-Demand Deep Learning Model Co-Inference with Device-Edge Synergy

Enabling Deep Learning on Edge Devices

Scaling Up Deep Neural Network Optimization for Edge Inference

Distributed Fine-Tuning of CNNs for Image Retrieval on Multiple Mobile Devices