Abstract:With the great advancements of convolution neural networks(CNN), CNN accelerators are increasingly developed and deployed in the major computing <a class="link-external link-http" href="http://systems.To" rel="external noopener nofollow">this http URL</a> make use of the CNN accelerators, CNN models are trained via the off-line training systems such as Caffe, Pytorch and Tensorflow on multi-core CPUs and GPUs first and then compiled to the target accelerators. Although the two-step process seems to be natural and has been widely applied, it assumes that the accelerators' behavior can be fully modeled on CPUs and GPUs. This does not hold true and the behavior of the CNN accelerators is un-deterministic when the circuit works at 'unstable' mode when it is overclocked or is affected by the environment like fault-prone aerospace. The exact behaviors of the accelerators are determined by both the chip fabrication and the working environment or status. In this case, applying the conventional off-line training result to the accelerators directly may lead to considerable accuracy loss. To address this problem, we propose to train for the 'unstable' CNN accelerator and have the 'un-determined behavior' learned together with the data in the same framework. Basically, it starts from the off-line trained model and then integrates the uncertain circuit behaviors into the CNN models through additional accelerator-specific training. The fine-tuned training makes the CNN models less sensitive to the circuit uncertainty. We apply the design method to both an overclocked CNN accelerator and a faulty accelerator. According to our experiments on a subset of ImageNet, the accelerator-specific training can improve the top 5 accuracy up to 3.4% and 2.4% on average when the CNN accelerator is at extreme overclocking. When the accelerator is exposed to a faulty environment, the top 5 accuracy improves up to 6.8% and 4.28% on average under the most severe fault injection.

Modeling the Effect of SEUs on the Configuration Memory of SRAM-FPGA Based CNN Accelerators

Systematic Reliability Evaluation of FPGA Implemented CNN Accelerators

Soft Error Mitigation for Deep Convolution Neural Network on FPGA Accelerators.

Implementation of Highly Reliable Convolutional Neural Network with Low Overhead on Field-Programmable Gate Array

Comparative study: AutoDPR-SEM for enhancing CNN reliability in SRAM-based FPGAs through autonomous reconfiguration

Evaluation of SEU impact on convolutional neural networks based on BRAM and CRAM in FPGAs

Detect and Replace: Efficient Soft Error Protection of FPGA-Based CNN Accelerators

Analyzing the Single Event Upset Vulnerability of Binarized Neural Networks on SRAM FPGAs

New Insights into the Impact of SEUs in FPGA CRAMs

SRAM-Based FPGA SEU Fault Propagation Model

Fault modeling and characteristics of SRAM-based FPGAs (abstract only).

Study of an Automated Precise SEU Fault Injection Technique

An Accurate Fault Location Method Based on Configuration Bitstream Analysis

Soft Error Tolerant Convolutional Neural Networks on FPGAs with Ensemble Learning

FPGA Implementation of a Fault-Tolerant Fused and Branched CNN Accelerator With Reconfigurable Capabilities

Design and Verification of Multiple SEU Mitigated Circuits on SRAM-based FPGA System

Evaluation and Mitigation of Weight-Related Single Event Upsets in a Convolutional Neural Network

Training for 'Unstable' CNN Accelerator:A Case Study on FPGA

XB-SIM∗: A Simulation Framework for Modeling and Exploration of ReRAM-based CNN Acceleration Design

Single event effects evaluation on Convolution Neural Network in Xilinx 28nm System on Chip

CRC Circuit Design for SRAM-Based FPGA Configuration Bit Correction