Abstract:Powered by their superior performance, deep neural networks (DNNs) have found widespread applications across various domains. Many deep learning (DL) models are now embedded in mobile apps, making them more accessible to end users through on-device DL. However, deploying on-device DL to users' smartphones simultaneously introduces several security threats. One primary threat is backdoor attacks. Extensive research has explored backdoor attacks for several years and has proposed numerous attack approaches. However, few studies have investigated backdoor attacks on DL models deployed in the real world, or they have shown obvious deficiencies in effectiveness and stealthiness. In this work, we explore more effective and stealthy backdoor attacks on real-world DL models extracted from mobile apps. Our main justification is that imperceptible and sample-specific backdoor triggers generated by DNN-based steganography can enhance the efficacy of backdoor attacks on real-world models. We first confirm the effectiveness of steganography-based backdoor attacks on four state-of-the-art DNN models. Subsequently, we systematically evaluate and analyze the stealthiness of the attacks to ensure they are difficult to perceive. Finally, we implement the backdoor attacks on real-world models and compare our approach with three baseline methods. We collect 38,387 mobile apps, extract 89 DL models from them, and analyze these models to obtain the prerequisite model information for the attacks. After identifying the target models, our approach achieves an average of 12.50% higher attack success rate than DeepPayload while better maintaining the normal performance of the models. Extensive experimental results demonstrate that our method enables more effective, robust, and stealthy backdoor attacks on real-world models.

Cheating Your Apps: Black‐box Adversarial Attacks on Deep Learning Apps

Towards Black-box Attacks on Deep Learning Apps

DeepMag+: Sniffing Mobile Apps in Magnetic Field Through Deep Learning.

Smart App Attack: Hacking Deep Learning Models in Android Apps

Robustness of on-Device Models: Adversarial Attack to Deep Learning Models on Android Apps

Beyond the Model: Data Pre-processing Attack to Deep Learning Models in Android Apps

Understanding Real-world Threats to Deep Learning Models in Android Apps

DeepPayload: Black-box Backdoor Attack on Deep Learning Models Through Neural Payload Injection

Stealthy Backdoor Attack to Real-world Models in Android Apps

ShadowDroid: Practical Black-box Attack Against ML-based Android Malware Detection

MalModel: Hiding Malicious Payload in Mobile Deep Learning Models with Black-box Backdoor Attack

Practical Black-Box Attacks against Deep Learning Systems using Adversarial Examples

DBA: an Efficient Approach to Boost Transfer-Based Adversarial Attack Performance Through Information Deletion.

A First Look at On-device Models in iOS Apps

Automation Slicing and Testing for in-App Deep Learning Models

MedAttacker: Exploring Black-Box Adversarial Attacks on Risk Prediction Models in Healthcare

DEMISTIFY: Identifying On-device Machine Learning Models Stealing and Reuse Vulnerabilities in Mobile Apps.

A First Look at Deep Learning Apps on Smartphones

A CMA-ES-Based Adversarial Attack on Black-Box Deep Neural Networks

Detecting Adversarial Samples for Deep Learning Models: A Comparative Study

OFEI: A Semi-black-box Android Adversarial Sample Attack Framework Against DLaaS