Abstract:Heterogeneous federated learning, as an innovative variant of federated learning, aims to break through the constraints of vanilla federated learning on the consistency of model architectures to better accommodate the heterogeneity in mobile computing scenarios. It introduces heterogeneous and personalized local models, which effectively accommodates the heterogeneous data distributions and hardware resource constraints of individual clients, and thus improves computation and communication efficiency. However, it poses a challenge to model ownership protection, as watermarks embedded in the global model are corrupted to varying degrees when they are migrated to a user's heterogeneous model and cannot continue to provide complete ownership protection in the local models. To tackle these issues, we propose a dynamic black-box model watermarking method for heterogeneous federated learning, PWFed. Specifically, we design an innovative dynamic watermark generation method which is based on generative adversarial network technology and is capable of generating watermark samples that are virtually indistinguishable from the original carriers. This approach effectively solves the limitation of the traditional black-box watermarking technique, which only considers static watermarks, and makes the generated watermarks significantly improved in terms of stealthiness and difficult to detect by potential model thieves, thus enhancing the robustness of the watermarks. In addition, we design two watermark embedding strategies with different granularities in the heterogeneous federated learning environment. During the watermark extraction and validation phase, PWFed accesses watermark samples claiming ownership of the model through an API interface and analyzes the differences between their output and the expected labels. Our experimental results show that PWFed achieves a 99.9% watermark verification rate with only a 0.1–4.8% sacrifice of main task accuracy on the CIFAR10 dataset.

FedMark: Large-Capacity and Robust Watermarking in Federated Learning

When Federated Learning meets Watermarking: A Comprehensive Overview of Techniques for Intellectual Property Protection

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model.

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model

WFB: watermarking-based copyright protection framework for federated learning model via blockchain

FedCRMW: Federated Model Ownership Verification with Model

FedGMark: Certifiably Robust Watermarking for Federated Graph Learning

Dynamic Black-Box Model Watermarking for Heterogeneous Federated Learning

RobWE: Robust Watermark Embedding for Personalized Federated Learning Model Ownership Protection

Secure Federated Learning Model Verification - A Client-side Backdoor Triggered Watermarking Scheme.

Ensuring Federated Ownership Verification with FedBack: A Trigger-Based Watermarking Approach

Watermarking in Secure Federated Learning: A Verification Framework Based on Client-Side Backdooring

FedIPR: Ownership Verification for Federated Deep Neural Network Models

Watermarking Protocol for Deep Neural Network Ownership Regulation in Federated Learning

FedRight: An Effective Model Copyright Protection for Federated Learning

A Joint Client-Server Watermarking Framework for Federated Learning

PersistVerify: Federated Model Ownership Verification with Spatial Attention and Boundary Sampling

Shared DNN Model Ownership Verification in Cross-Silo Federated Learning: A GAN-Based Watermark Approach

Who Leaked the Model? Tracking IP Infringers in Accountable Federated Learning

Unharmful Backdoor-based Client-side Watermarking in Federated Learning

Protecting the Ownership of Deep Learning Models with an End-to-End Watermarking Framework.