Abstract:With the rapid growth of the number of devices generating and collecting data, dispersion becomes an important feature of data in Internet of Things. Federated learning (FL) provides a feasible way to mine information in such distributed data. It involves training machine learning models over multiple distributed participants without raw data transmission. However, due to the data heterogeneity among participants, the performance of the FL model degrades dramatically. Currently, improved methods mainly reduce data heterogeneity from the perspective of modifying the process of model training, which usually have problems such as high resource consumption or the need for auxiliary data. In this paper, we enhance FL model from another perspective, focusing on data rather than model training. We reduce data heterogeneity by enhancing the trained local data to improve FL performance. Specifically, we propose an FL method based on data augmentation (abbr. FedM-UNE), implementing the classic data augmentation method MixUp in federated scenarios without transferring raw data. Furthermore, in order to adapt this method to regression tasks, we first modify MixUp by bilateral neighborhood expansion (MixUp-BNE), and then propose a federated data augmentation method named FedM-BNE based on it. Compared with the conventional FL method, both FedM-UNE and FedM-BNE increase negligible overhead. To demonstrate the effectiveness, we conduct exhaustive experiments on six datasets employing a variety of loss functions. The results indicate that FedM-UNE and FedM-BNE consistently improve the performance of the FL model. Moreover, our methods are compatible with existing FL enhancements, which yield further improvements in performance.

Federated Learning Based on Feature Decoupling and Domain Adaptation

FedDGP: Disentangling Global and Personal Models for Federated Learning

FediOS: Decoupling Orthogonal Subspaces for Personalization in Feature-skew Federated Learning

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction

Federated Learning with Additional Mechanisms on Clients to Reduce Communication Costs

FedADMM: A Robust Federated Deep Learning Framework with Adaptivity to System Heterogeneity

Federated learning on non-IID and long-tailed data via dual-decoupling

Federated Learning for Non-IID Data Via Unified Feature Learning and Optimization Objective Alignment

FedDA: Resource-adaptive Federated Learning with Dual-Alignment Aggregation Optimization for Heterogeneous Edge Devices

Multi-Source to Multi-Target Decentralized Federated Domain Adaptation

Data Augmentation Based Federated Learning

FMDADA: Federated multi-discriminative adversarial domain adaptation

Client Selection for Federated Learning With Non-IID Data in Mobile Edge Computing

Communicational and Computational Efficient Federated Domain Adaptation

Completely Heterogeneous Federated Learning

FedIN: Federated Intermediate Layers Learning for Model Heterogeneity

A Survey of Federated Learning on Non-IID Data

AdaFed: Fair Federated Learning via Adaptive Common Descent Direction