Abstract:Heterogeneous federated learning, as an innovative variant of federated learning, aims to break through the constraints of vanilla federated learning on the consistency of model architectures to better accommodate the heterogeneity in mobile computing scenarios. It introduces heterogeneous and personalized local models, which effectively accommodates the heterogeneous data distributions and hardware resource constraints of individual clients, and thus improves computation and communication efficiency. However, it poses a challenge to model ownership protection, as watermarks embedded in the global model are corrupted to varying degrees when they are migrated to a user's heterogeneous model and cannot continue to provide complete ownership protection in the local models. To tackle these issues, we propose a dynamic black-box model watermarking method for heterogeneous federated learning, PWFed. Specifically, we design an innovative dynamic watermark generation method which is based on generative adversarial network technology and is capable of generating watermark samples that are virtually indistinguishable from the original carriers. This approach effectively solves the limitation of the traditional black-box watermarking technique, which only considers static watermarks, and makes the generated watermarks significantly improved in terms of stealthiness and difficult to detect by potential model thieves, thus enhancing the robustness of the watermarks. In addition, we design two watermark embedding strategies with different granularities in the heterogeneous federated learning environment. During the watermark extraction and validation phase, PWFed accesses watermark samples claiming ownership of the model through an API interface and analyzes the differences between their output and the expected labels. Our experimental results show that PWFed achieves a 99.9% watermark verification rate with only a 0.1–4.8% sacrifice of main task accuracy on the CIFAR10 dataset.

A Joint Client-Server Watermarking Framework for Federated Learning

Leveraging Unlabeled Data for Watermark Removal of Deep Neural Networks

Watermarking in Secure Federated Learning: A Verification Framework Based on Client-Side Backdooring

Secure Federated Learning Model Verification - A Client-side Backdoor Triggered Watermarking Scheme.

Dynamic Black-Box Model Watermarking for Heterogeneous Federated Learning

WFB: watermarking-based copyright protection framework for federated learning model via blockchain

Unharmful Backdoor-based Client-side Watermarking in Federated Learning

When Federated Learning meets Watermarking: A Comprehensive Overview of Techniques for Intellectual Property Protection

FedMark: Large-Capacity and Robust Watermarking in Federated Learning

FedCRMW: Federated Model Ownership Verification with Model

RobWE: Robust Watermark Embedding for Personalized Federated Learning Model Ownership Protection

FedIPR: Ownership Verification for Federated Deep Neural Network Models

Watermarking Protocol for Deep Neural Network Ownership Regulation in Federated Learning

Ensuring Federated Ownership Verification with FedBack: A Trigger-Based Watermarking Approach

Protecting the Ownership of Deep Learning Models with an End-to-End Watermarking Framework.

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model.

VPFL: A Verifiable Property Federated Learning Framework Against Invisible Attacks in Distributed IoT

Privacy-Preserving Federated Learning Against Label-Flipping Attacks on Non-IID Data

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model

Shared DNN Model Ownership Verification in Cross-Silo Federated Learning: A GAN-Based Watermark Approach

FedGMark: Certifiably Robust Watermarking for Federated Graph Learning