Abstract:Federated learning, in contrast to traditional learning paradigms, has demonstrated its unique advantages in providing intelligence at the edge. However, existing federated learning approaches focus on the end-to-end classification tasks requiring a simple collaboration procedure where each participant can perform its local training independently. Unfortunately, there are still many tasks relying on learning the distinguishable feature metrics with respect to all the data, which is a different collaboration procedure across training participants. For example, the model for people identification has to ensure the feature representing a person is dissimilar to those representing others. To enable such federated learning for deep metrics (a.k.a federated deep metric learning) is challenging due to the data privacy and procedure robustness issues. With the consideration of these two challenges, this work proposes a novel computing framework for federated deep metric learning. This framework leverages the system-algorithm co-design to address privacy concerns via the Trusted Execution Environment (SGX enclave) and Differential Privacy mechanism. It also introduces a large-scale federated protocol which can robustly and efficiently deal with practical factors like the network fluctuation. We implement and evaluate our computing framework with two settings. One is a real-world implementation with a large number of mobile devices, while the other one is in our controllable environment for conducting experiments in various tasks. Our evaluation results show that our computing framework is able to train federated deep metric learning models with excellent scalability, data privacy preserving, and considerable accuracy even in exception conditions.

A Survey on Federated Learning: a Perspective from Multi-Party Computation

Recent Advances on Federated Learning: A Systematic Survey

From distributed machine learning to federated learning: In the view of data privacy and security

A Generalized Look at Federated Learning: Survey and Perspectives

A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection

Towards Efficient Communications in Federated Learning: A Contemporary Survey

Two-Phase Multi-Party Computation Enabled Privacy-Preserving Federated Learning

An overview of implementing security and privacy in federated learning

Federated Learning Privacy: Attacks, Defenses, Applications, and Policy Landscape - A Survey

Challenges and future directions of secure federated learning: a survey

A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiency

Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning

Privacy-Preserving and Robust Federated Deep Metric Learning

A Survey on Blockchain-Based Federated Learning and Data Privacy

Federated Learning in Practice: Reflections and Projections

Advancements in Federated Learning: Models, Methods, and Privacy

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

When Federated Learning Meets Privacy-Preserving Computation

EPFed: Achieving Optimal Balance between Privacy and Efficiency in Federated Learning