Abstract:Federated learning (FL) enables collaborative model training across multiple clients while preserving privacy. In practical situations, the heterogeneous and unbalanced distribution of the data has a significant impact on the performance of the model. Although some work has been carried out to address this issue, such as adding regularization terms, employing specific server aggregation strategies, and utilizing deep generative models to augment the training data, there is still a lack of efficient approaches to derive intrinsic representation of the local data to improve the global model without compromising client privacy. Through our careful observations and analysis, we found that incorporating pre-training and calibrating of the global model using virtual data and virtual features that are generated based on the client data distribution can improve model generalization. In this work, we propose Virtual Data Augmented Federated Learning (FedVDA) to resolve this problem. Specifically, FedVDA combines unsupervised pre-training with Augmented Fractal (AF) virtual images and Gaussian Mixture Model (GMM) virtual feature calibration. By integrating color tone transformations into the virtual data generated by fractals, we bridge the gap between virtual and client data distributions. Multi-modal feature modeling using variances on each client allows the server to efficiently calibrate the classifier with balanced sampled virtual features, reducing both computational and communication overhead. Compared to other data augmentation methods, our method directly calibrates model features, significantly improving model performance in scenarios with data heterogeneity and imbalance, while minimizing additional computational and communication costs. Our experiments demonstrate that FedVDA outperforms existing federated learning methods and can seamlessly integrate with other algorithms.

Distributed Fire Detection and Localization Model Using Federated Learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Federated learning-powered visual object detection for safety monitoring

FedVision: An Online Visual Object Detection Platform Powered by Federated Learning

Federated Learning Model Training Method Based on Data Features Perception Aggregation

Distributed and Deep Vertical Federated Learning with Big Data

FedVisual: Heterogeneity-Aware Model Aggregation for Federated Learning in Visual-Based Vehicular Crowdsensing

Federated Knowledge Transfer for Heterogeneous Visual Models.

A Communication-efficient Federated Learning Assisted by Central Data: Implementation of Vertical Training into Horizontal Federated Learning

Visual Object Detection for Privacy-Preserving Federated Learning

Fractal Augmented Pre-training and Gaussian Virtual Feature Calibration for Tackling Data Heterogeneity in Federated Learning

A novel federated learning aggregation algorithm for AIoT intrusion detection

Federated Virtual Learning on Heterogeneous Data with Local-global Distillation

FedDiff: Diffusion Model Driven Federated Learning for Multi-Modal and Multi-Clients

FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation

Research on Federated Learning Algorithms in Non-Independent Identically Distributed Scenarios

Communication-Efficient Federated Distillation with Active Data Sampling

Distributed Malicious Traffic Detection

User-Distribution-Aware Federated Learning for Efficient Communication and Fast Inference