Abstract:In this edition, we present two papers that explore complementary aspects of software reliability, both leveraging different fault injection techniques, shedding light on hardware faults' impact on deep learning neural networks (DNNs) and the enhancement of mutation-based fault localization techniques. The first paper, titled 'Investigating the impact of transient hardware faults on deep learning neural network inference' by Md Hasanur Rahman, Sabuj Laskar, and Guanpeng Li, examines the intersection of hardware faults and DNN inference, particularly in safety-critical applications like autonomous vehicles and healthcare systems. As DNNs become increasingly prevalent in such domains, understanding their susceptibility to transient hardware faults becomes crucial. The authors introduce advancements in fault injection techniques, by enhancing the fault injector, TENSORFI, for TensorFlow applications, enabling scalable fault injections in modern DNN models. Through extensive experimentation and analysis, they reveal the significant impact of transient hardware faults on safety-critical applications, surpassing the influence of intrinsic algorithmic inaccuracies. Their findings underscore the importance of prioritized protection for specific regions within DNNs to enhance reliability in safety-critical contexts. The second paper, 'Delta4Ms: Improving mutation-based fault localization by eliminating mutant bias' authored by Hengyuan Liu, Zheng Li, Baolong Han, Yangtao Liu, Xiang Chen, and Yong Liu, addresses the challenges of fault localization in software debugging. While mutation-based fault localization (MBFL) has emerged as a promising technique, it suffers from inherent biases, hindering its accuracy. The authors present Delta4Ms, a novel approach that tackles mutant bias by integrating original principles inspired from signal theory. By distinguishing between desired and false signal components, Delta4Ms effectively mitigates mutant bias, leading to more accurate fault localization. Through comprehensive evaluations on real-fault programmes, Delta4Ms demonstrates increased performance compared to existing techniques, showcasing significant improvements in fault localization effectiveness while minimizing computational costs. In conclusion, these two papers provide valuable insights into ensuring software reliability and resilience in two different contexts. As demonstrated by these works, it is of high interest for STVR to further explore and use fault injection techniques, at software and hardware levels including machine-learning models, to strengthen and validate software reliability and fault tolerance techniques.

MindFI: A Fault Injection Tool for Reliability Assessment of MindSpore Applicacions

MRFI: An Open Source Multi-Resolution Fault Injection Framework for Neural Network Processing

Large-Scale Application of Fault Injection into PyTorch Models -- an Extension to PyTorchFI for Validation Efficiency

SpikeFI: A Fault Injection Framework for Spiking Neural Networks

Evaluating Different Fault Injection Abstractions on the Assessment of DNN SW Hardening Strategies

DeepVigor+: Scalable and Accurate Semi-Analytical Fault Resilience Analysis for Deep Neural Network

A Deep Investigation on Stealthy DVFS Fault Injection Attacks at DNN Hardware Accelerators

Investigating the impact of transient hardware faults on deep learning neural network inference

Analysis of Performance and Optimization in MindSpore on Ascend NPUs

Machine Learning Data Suitability and Performance Testing Using Fault Injection Testing Framework

Investigating Fault Injection Techniques in Hardware-Based Deep Neural Networks and Mutation-Based Fault Localization

MicroFI: Non-Intrusive and Prioritized Request-Level Fault Injection for Microservice Applications

ISimDL: Importance Sampling-Driven Acceleration of Fault Injection Simulations for Evaluating the Robustness of Deep Learning

Fault Injection on Embedded Neural Networks: Impact of a Single Instruction Skip

A Survey on Failure Analysis and Fault Injection in AI Systems

DevMuT: Testing Deep Learning Framework Via Developer Expertise-Based Mutation

Neural Fault Injection: Generating Software Faults from Natural Language

DeepLaser: Practical Fault Attack on Deep Neural Networks

Failure Identification Using Model-Implemented Fault Injection with Domain Knowledge-Guided Reinforcement Learning

SpikingJET: Enhancing Fault Injection for Fully and Convolutional Spiking Neural Networks

Improving the Accuracy of IR-Level Fault Injection