Abstract:The arms race between attacks and defenses for machine learning models has come to a forefront in recent years, in both the security community and the privacy community. However, one big limitation of previous research is that the security domain and the privacy domain have typically been considered separately. It is thus unclear whether the defense methods in one domain will have any unexpected impact on the other domain. In this paper, we take a step towards resolving this limitation by combining the two domains. In particular, we measure the success of membership inference attacks against six state-of-the-art defense methods that mitigate the risk of adversarial examples (i.e., evasion attacks). Membership inference attacks determine whether or not an individual data record has been part of a model's training set. The accuracy of such attacks reflects the information leakage of training algorithms about individual members of the training set. Adversarial defense methods against adversarial examples influence the model's decision boundaries such that model predictions remain unchanged for a small area around each input. However, this objective is optimized on training data. Thus, individual data records in the training set have a significant influence on robust models. This makes the models more vulnerable to inference attacks. To perform the membership inference attacks, we leverage the existing inference methods that exploit model predictions. We also propose two new inference methods that exploit structural properties of robust models on adversarially perturbed data. Our experimental evaluation demonstrates that compared with the natural training (undefended) approach, adversarial defense methods can indeed increase the target model's risk against membership inference attacks. When using adversarial defenses to train the robust models, the membership inference advantage increases by up to 4.5 times compared to the naturally undefended models. Beyond revealing the privacy risks of adversarial defenses, we further investigate the factors, such as model capacity, that influence the membership information leakage.

EdgeLeakage: Membership Information Leakage in Distributed Edge Intelligence Systems

EI-MTD: Moving Target Defense for Edge Intelligence Against Adversarial Attacks

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Exploiting Unintended Property Leakage in Blockchain-Assisted Federated Learning for Intelligent Edge Computing

Evolutionary privacy-preserving learning strategies for edge-based IoT data sharing schemes

Keep Your Data Locally: Federated-Learning-Based Data Privacy Preservation in Edge Computing

Inductive learning and local differential privacy for privacy-preserving offloading in mobile edge intelligent systems

Survey: federated learning data security and privacy-preserving in edge-Internet of Things

Privacy Risks of Securing Machine Learning Models against Adversarial Examples

Stability-Based Analysis and Defense Against Backdoor Attacks on Edge Computing Services

Privacy-Preserving Offloading in Edge Intelligence Systems with Inductive Learning and Local Differential Privacy.

Vicious Classifiers: Assessing Inference-time Data Reconstruction Risk in Edge Computing

A Privacy-Preserving Deep Learning Scheme for Edge-enhanced Smart Homes

Machine-Learning-Assisted Security and Privacy Provisioning for Edge Computing: A Survey

Analyzing Inference Privacy Risks Through Gradients in Machine Learning

Ubiquitous Intelligent Federated Learning Privacy-Preserving Scheme under Edge Computing

Edge Learning: the Enabling Technology for Distributed B Data Analytics in the Edge

Edge enhanced deep learning system for IoT edge device security analytics

Intrusion Detection Based on Data Privacy in Cloud-Edge Collaborative Computing Using Federated Learning

Two-in-One Solution: Simultaneously Enhancing Security and Privacy for Data-Driven Models in Mobile Edge Computing

Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning