Private Federated Learning with Dynamic Power Control via Non-Coherent Over-the-Air Computation

Anbang Zhang,Shuaishuai Guo,Shuai Liu
2023-08-05
Abstract:To further preserve model weight privacy and improve model performance in Federated Learning (FL), FL via Over-the-Air Computation (AirComp) scheme based on dynamic power control is proposed. The edge devices (EDs) transmit the signs of local stochastic gradients by activating two adjacent orthogonal frequency division multi-plexing (OFDM) subcarriers, and majority votes (MVs) at the edge server (ES) are obtained by exploiting the energy accumulation on the subcarriers. Then, we propose a dynamic power control algorithm to further offset the biased aggregation of the MV aggregation values. We show that the whole scheme can mitigate the impact of the time synchronization error, channel fading and noise. The theoretical convergence proof of the scheme is re-derived.
Machine Learning
What problem does this paper attempt to address?
The paper attempts to address issues primarily focused on model weight privacy protection and performance enhancement in Federated Learning (FL). Specifically, the paper proposes an FL scheme based on Over-the-Air Computation (AirComp) and dynamic power control, aiming to: 1. **Further protect the privacy of model weights**: By transmitting the signs of local stochastic gradients (instead of the full gradient values) from Edge Devices (EDs) and using energy accumulation for Majority Voting (MV) at the Edge Server (ES), thereby reducing the exposure of sensitive information. 2. **Improve model performance**: A dynamic power control algorithm is proposed to offset the bias of MV aggregation values, thereby improving the training effect of the global model. 3. **Mitigate the impact of time synchronization errors, channel fading, and noise**: Through theoretical analysis and experimental validation, it is demonstrated that the proposed scheme can effectively address these common issues, ensuring model convergence and accuracy. ### Main Contributions 1. **AirComp scheme based on SignSGD and MV**: Utilizing OFDM symbols to transmit the direction of stochastic gradients and obtaining MV at the ES through energy detection, without requiring channel state information (CSI) at the EDs and ES. 2. **Dynamic power control scheme**: A dynamic power control algorithm is designed to adjust the transmission power of each ED, offsetting the reverse impact of user parameters on the entire model, thereby improving model accuracy. 3. **Theoretical convergence proof**: The theoretical convergence proof of the proposed scheme is re-derived when MV is obtained through the FL scheme. Experimental results show that the scheme is robust to time synchronization errors, as the signs of local stochastic gradients are not encoded into the phase of transmission symbols. ### Experimental Validation Experiments were conducted on the MNIST dataset, comparing the proposed scheme with baseline algorithms (such as SignSGD, FedAvg, and FSK-MV). The experimental results show that the proposed scheme exhibits higher test accuracy under both iid and non-iid data settings, especially in the presence of time synchronization errors, outperforming other methods. Additionally, the use of dynamic power control and non-coherent energy detection further improves test accuracy without requiring CSI at the EDs. ### Conclusion The paper proposes an FL scheme combining AirComp and dynamic power control, which can protect model weight privacy while improving model performance and effectively addressing practical issues such as time synchronization errors, channel fading, and noise.