Abstract:Machine learning algorithms are increasingly used for inference and decision-making in embedded systems. Data from sensors are used to train machine learning models for various smart functions of embedded and cyber-physical systems ranging from applications in healthcare, autonomous vehicles, and national security. However, recent studies have shown that machine learning models can be fooled by adding adversarial noise to their inputs. The perturbed inputs are called adversarial examples. Furthermore, adversarial examples designed to fool one machine learning system are also often effective against another system. This property of adversarial examples is called adversarial transferability and has not been explored in wearable systems to date. In this work, we take the first stride in studying adversarial transferability in wearable sensor systems from four viewpoints: (1) transferability between machine learning models; (2) transferability across users/subjects of the embedded system; (3) transferability across sensor body locations; and (4) transferability across datasets used for model training. We present a set of carefully designed experiments to investigate these transferability scenarios. We also propose a threat model describing the interactions of an adversary with the source and target sensor systems in different transferability settings. In most cases, we found high untargeted transferability, whereas targeted transferability success scores varied from to . The transferability of adversarial examples depends on many factors such as the inclusion of data from all subjects, sensor body position, number of samples in the dataset, type of learning algorithm, and the distribution of source and target system dataset. The transferability of adversarial examples decreased sharply when the data distribution of the source and target system became more distinct. We also provide guidelines and suggestions for the community for designing robust sensor systems. Code and dataset used in our analysis is publicly available here.

Transfer Adversarial Attacks Across Industrial Intelligent Systems.

Adversarial Example Attacks in Internet of Things (IoT)

Adversarial Weight Prediction Networks for Defense of Industrial FDC Systems

Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems

One-Variable Attack on the Industrial Fault Classification System and Its Defense

Attack and Defense: Adversarial Security of Data-Driven FDC Systems

Information Fingerprint for Secure Industrial Big Data Analytics.

Attacks on Data-Driven Process Monitoring Systems: Subspace Transfer Networks

Detect & Reject for Transferability of Black-box Adversarial Attacks Against Network Intrusion Detection Systems

Adversarial Attacks on Neural-Network-Based Soft Sensors: Directly Attack Output

Adversarial Attacks on Machine Learning Cybersecurity Defences in Industrial Control Systems

Generating Adversarial Examples Against Machine Learning-Based Intrusion Detector in Industrial Control Systems

Deep Fusion: Crafting Transferable Adversarial Examples and Improving Robustness of Industrial Artificial Intelligence of Things

Adversarial Transferability in Embedded Sensor Systems: An Activity Recognition Perspective

Transfer Attacks Revisited: A Large-Scale Empirical Study in Real Computer Vision Settings

Demystifying the Transferability of Adversarial Attacks in Computer Networks

Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples

A Survey on Transferability of Adversarial Examples across Deep Neural Networks

Explainable and Transferable Adversarial Attack for ML-Based Network Intrusion Detectors

Automated Federated Learning‐based Adversarial Attack and Defence in Industrial Control Systems

Understanding and Enhancing the Transferability of Adversarial Examples