Abstract:In the past decades, artificial intelligence (AI) has achieved unprecedented success, where statistical models become the central entity in AI. However, the centralized training and inference paradigm for building and using these models is facing more and more privacy and legal challenges. To bridge the gap between data privacy and the need for data fusion, an emerging AI paradigm federated learning (FL) has emerged as an approach for solving data silos and data privacy problems. Based on secure distributed AI, federated learning emphasizes data security throughout the lifecycle, which includes the following steps: data preprocessing, training, evaluation, and deployments. FL keeps data security by using methods, such as secure multi-party computation (MPC), differential privacy, and hardware solutions, to build and use distributed multiple-party machine-learning systems and statistical models over different data sources. Besides data privacy concerns, we argue that the concept of "model" matters, when developing and deploying federated models, they are easy to expose to various kinds of risks including plagiarism, illegal copy, and misuse. To address these issues, we introduce FedIPR, a novel ownership verification scheme, by embedding watermarks into FL models to verify the ownership of FL models and protect model intellectual property rights (IPR or IP-right for short). While security is at the core of FL, there are still many articles referred to distributed machine learning with no security guarantee as "federated learning", which are not satisfied with the FL definition supposed to be. To this end, in this paper, we reiterate the concept of federated learning and propose secure federated learning (SFL), where the ultimate goal is to build trustworthy and safe AI with strong privacy-preserving and IP-right-preserving. We provide a comprehensive overview of existing works, including threats, attacks, and defenses in each phase of SFL from the lifecycle perspective.

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model.

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model

FedMark: Large-Capacity and Robust Watermarking in Federated Learning

FedRight: An Effective Model Copyright Protection for Federated Learning

WFB: watermarking-based copyright protection framework for federated learning model via blockchain

Secure Federated Learning Model Verification - A Client-side Backdoor Triggered Watermarking Scheme.

FedCRMW: Federated Model Ownership Verification with Model

PersistVerify: Federated Model Ownership Verification with Spatial Attention and Boundary Sampling

FedIPR: Ownership Verification for Federated Deep Neural Network Models

When Federated Learning meets Watermarking: A Comprehensive Overview of Techniques for Intellectual Property Protection

RobWE: Robust Watermark Embedding for Personalized Federated Learning Model Ownership Protection

Who Leaked the Model? Tracking IP Infringers in Accountable Federated Learning

FedGMark: Certifiably Robust Watermarking for Federated Graph Learning

Watermarking in Secure Federated Learning: A Verification Framework Based on Client-Side Backdooring

FedCIP: Federated Client Intellectual Property Protection with Traitor Tracking

Federated Learning with Privacy-preserving and Model IP-right-protection

Privacy-Preserving Federated Learning Against Label-Flipping Attacks on Non-IID Data

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Watermarking Protocol for Deep Neural Network Ownership Regulation in Federated Learning

Dynamic Black-Box Model Watermarking for Heterogeneous Federated Learning

A Joint Client-Server Watermarking Framework for Federated Learning