Abstract:As a decentralized training paradigm, Federated learning (FL) promises data privacy by exchanging model parameters instead of raw local data. However, it is still impeded by the resource limitations of end devices and privacy risks from the ‘curious’ cloud. Yet, existing work predominately ignores that these two issues are non-orthogonal in nature. In this article, we propose a joint design (i.e., AHFL) that accommodates both the efficiency expectation and privacy protection of clients towards high inference accuracy. Based on a cloud-edge-end hierarchical FL framework, we carefully offload the training burden of devices to one proximate edge for enhanced efficiency and apply a two-level differential privacy mechanism for privacy protection. To resolve the conflicts of dynamical resource consumption and privacy risk accumulation, we formulate an optimization problem for choosing configurations under correlated learning parameters (e.g., iterations) and privacy control factors (e.g., noise intensity). An adaptive algorithmic solution is presented based on performance-oriented resource scheduling, budget-aware device selection, and adaptive local noise injection. Extensive evaluations are performed on three different data distribution cases of two real-world datasets, using both a networked prototype and large-scale simulations. Experimental results show that AHFL relieves the end's resource burden (w.r.t. computation time 8.58% $\downarrow$↓, communication time 59.35%$\downarrow$↓ and memory consumption 43.61%$\downarrow$↓) and has better accuracy (6.34%$\uparrow$↑) than 3 typical baselines under the limited resource and privacy budgets. The code for our implementation is available at https://github.com/Guoyeting/AHFL.

Adaptive differential privacy in vertical federated learning for mobility forecasting

Flexible Differentially Private Vertical Federated Learning with Adaptive Feature Embeddings

Utility Aware Optimal Data Selection for Differentially Private Federated Learning in IoV

Enhancing Federated Learning with Adaptive Differential Privacy and Priority-Based Aggregation

Privacy Vs. Efficiency: Achieving Both Through Adaptive Hierarchical Federated Learning

Efficient and Privacy-Preserving Feature Importance-based Vertical Federated Learning

An Adaptive Differential Privacy Method Based on Federated Learning

Adaptive Differential Privacy in Federated Learning: A Priority-Based Approach

Utility Optimization of Federated Learning with Differential Privacy

Efficient federated learning privacy preservation method with heterogeneous differential privacy

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data

Achieving Model Fairness in Vertical Federated Learning

Hybrid Differentially Private Federated Learning on Vertically Partitioned Data

GFL-ALDPA: a gradient compression federated learning framework based on adaptive local differential privacy budget allocation

Privacy-preserving Data Selection for Horizontal and Vertical Federated Learning

Multi-Stage Asynchronous Federated Learning with Adaptive Differential Privacy.

Using Decentralized Aggregation for Federated Learning with Differential Privacy

Hierarchical federated learning with global differential privacy

AWDP-FL: An Adaptive Differential Privacy Federated Learning Framework

Privacy As a Resource in Differentially Private Federated Learning.

Adaptive and Efficient Participant Selection in Vertical Federated Learning