Abstract:The emergence of Industry 4.0 has revolutionized the industrial sector, enabling the development of compact, precise, and interconnected assets. This transformation has not only generated vast amounts of data but also facilitated the migration of learning and optimization processes to edge devices. Consequently, modern industries can effectively leverage this paradigm through distributed learning to define product quality and implement predictive maintenance (PM) strategies. While computing speeds continue to advance rapidly, the latency in communication has emerged as a bottleneck for fast edge learning, particularly in time-sensitive applications such as PM. To address this issue, we explore Federated Learning (FL), a privacy-preserving framework. FL entails updating a global AI model on a parameter server (PS) through aggregation of locally trained models from edge devices. We propose an innovative approach: analog aggregation over-the-air of updates transmitted concurrently over wireless channels. This leverages the waveform-superposition property in multi-access channels, significantly reducing communication latency compared to conventional methods. However, it is vulnerable to performance degradation due to channel properties like noise and fading. In this study, we introduce a method to mitigate the impact of channel noise in FL over-the-air communication and computation (FLOACC). We integrate a novel tracking-based stochastic approximation scheme into a standard federated stochastic variance reduced gradient (FSVRG). This effectively averages out channel noise's influence, ensuring robust FLOACC performance without increasing transmission power gain. Numerical results confirm our approach's superior communication efficiency and scalability in various FL scenarios, especially when dealing with noisy channels. Simulation experiments also highlight significant enhancements in prediction accuracy and loss function reduction for analog aggregation in over-the-air FL scenarios.

Federated Learning from Heterogeneous Data via Controlled Air Aggregation with Bayesian Estimation

Federated Learning from Heterogeneous Data via Controlled Bayesian Air Aggregation

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

Message Passing Based Wireless Federated Learning Via Analog Message Aggregation

Over-the-Air Federated Learning and Optimization

Federated Learning via Over-the-Air Computation

Over-The-Air Federated Learning under Byzantine Attacks

Over-the-Air Federated Edge Learning with Hierarchical Clustering

Federated Bayesian Deep Learning: The Application of Statistical Aggregation Methods to Bayesian Models

Over-the-Air Federated Learning with Joint Adaptive Computation and Power Control

Bayesian Federated Learning over Wireless Networks

Over-the-Air Federated Learning via Weighted Aggregation

Hierarchical Over-the-Air Federated Edge Learning

Private Federated Learning with Dynamic Power Control via Non-Coherent Over-the-Air Computation

Low-Latency Collaborative Predictive Maintenance: Over-the-Air Federated Learning in Noisy Industrial Environments

Over-The-Air Clustered Wireless Federated Learning

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection

Over-The-Air Federated Learning: Status Quo, Open Challenges, and Future Directions

Communication-Efficient Federated Learning in Channel Constrained Internet of Things

IRS Assisted Federated Learning: A Broadband Over-the-Air Aggregation Approach

IRS Assisted Federated Learning A Broadband Over-the-Air Aggregation Approach