Abstract:Data-free model stealing involves replicating the functionality of a target model into a substitute model without accessing the target model's structure, parameters, or training data. The adversary can only access the target model's predictions for generated samples. Once the substitute model closely approximates the behavior of the target model, attackers can exploit its white-box characteristics for subsequent malicious activities, such as adversarial attacks. Existing methods within cooperative game frameworks often produce samples with high confidence for the prediction of the substitute model, which makes it difficult for the substitute model to replicate the behavior of the target model. This paper presents a new data-free model stealing approach called Query Efficient Data Generation (\textbf{QEDG}). We introduce two distinct loss functions to ensure the generation of sufficient samples that closely and uniformly align with the target model's decision boundary across multiple classes. Building on the limitation of current methods, which typically yield only one piece of supervised information per query, we propose the query-free sample augmentation that enables the acquisition of additional supervised information without increasing the number of queries. Motivated by theoretical analysis, we adopt the consistency rate metric, which more accurately evaluates the similarity between the substitute and target models. We conducted extensive experiments to verify the effectiveness of our proposed method, which achieved better performance with fewer queries compared to the state-of-the-art methods on the real \textbf{MLaaS} scenario and five datasets.

Efficient Data-Free Model Stealing with Label Diversity

Towards Efficient Data Free Blackbox Adversarial Attack

Enhancing Data-Free Robustness Stealing Attack Via Boundary Data Generation

Enhancing Data-Free Model Stealing Attack on Robust Models

Exploring Query Efficient Data Generation towards Data-free Model Stealing in Hard Label Setting

Data-Free Hard-Label Robustness Stealing Attack

I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defences

Model Stealing Attack against Graph Classification with Authenticity, Uncertainty and Diversity

Beyond Labeling Oracles: What does it mean to steal ML models?

Model Stealing Attack Based on Sampling and Weighting

ShrewdAttack: Low Cost High Accuracy Model Extraction.

Stealing Machine Learning Models via Prediction APIs

ML-Stealer: Stealing Prediction Functionality of Machine Learning Models with Mere Black-Box Access

LSSMSD: Defending Against Black-Box DNN Model Stealing Based on Localized Stochastic Sensitivity

ES Attack: Model Stealing against Deep Neural Networks without Data Hurdles

Capacity Abuse Attack of Deep Learning Models Without Need of Label Encodings.

Model Stealing Attack against Recommender System

Model Extraction Attacks Revisited

Data-Free Model Stealing Attack Based on Denoising Diffusion Probabilistic Model

FMSA: a Meta-Learning Framework-Based Fast Model Stealing Attack Technique Against Intelligent Network Intrusion Detection Systems

Black-Box Dissector: Towards Erasing-based Hard-Label Model Stealing Attack