Abstract:With the advancement of technology, clients have a large amount of personal data. Human beings are paying more and more attention to the privacy and security of this part of data. Clients do not want to share private data, which directly leads to the existence of data islands. Especially in few-shot scenarios, due to the insufficient amount of personal data, constructing an effective few-shot model is difficult. To solve the above problems, we propose Federated Few-shot Learning (FedFSL) in this paper. We utilize Federated Learning (FedL) to ensure the privacy and security issues of joint training. Moreover, the global model obtained by FedL has the characteristics of universally applicable to all clients. That universality satisfies the scenario of universally applicable to all meta tasks in the few-shot meta-learning stage. What is more, to obtain a more effective global federated universal few-shot model, we respectively proposed Weighted FedL (WFedL) and Client Selection based FedL (CSFedL) strategies. WFedL takes into account the difference between clients performance when building the global model and assigns different weights to different clients. CSFedL considers the malicious participation of clients, and we propose an adaptive client selection strategy to mitigate the impact caused by malicious participation. Extensive federated experiments on CIFAR-10 and CIFAR-100 show the advantage of proposed WFedL, CSFedL and combined Client Selection based WFedL (CSWFedL). We further verify the performance improvement of FedFSL on miniImagenet and propose our overall framework Client Selection based WFedFSL (CSWFedFSL). The best performance of CSWFedFSL is higher than both the few-shot baseline and FedFSL, and CSWFedFSL protects clients data privacy in the few-shot scenario.

LDA-Enhanced Federated Learning for Image Classification with Missing Modality

Research on Image Classification Algorithm Based on Horizontal Federated Learning

Face Recognition Using Novel LDA-Based Algorithms.

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

FedSLD: Federated Learning with Shared Label Distribution for Medical Image Classification

Federated Zero-Shot Learning for Visual Recognition

Multimodal Federated Learning

LDS2AE: Local Diffusion Shared-Specific Autoencoder for Multimodal Remote Sensing Image Classification with Arbitrary Missing Modalities

Directly Handling Missing Data in Linear Discriminant Analysis for Enhancing Classification Accuracy and Interpretability

FedAA: Using Non-sensitive Modalities to Improve Federated Learning while Preserving Image Privacy

Towards Fair Federated Learning with Zero-Shot Data Augmentation

Exploring Semantic Attributes from A Foundation Model for Federated Learning of Disjoint Label Spaces

DiVerFed: Distribution-Aware Vertical Federated Learning for Missing Information

Multimodal Federated Learning with Missing Modality via Prototype Mask and Contrast

FedMAC: Tackling Partial-Modality Missing in Federated Learning with Cross-Modal Aggregation and Contrastive Regularization

Federated Few-Shot Learning with Adversarial Learning

Federated Deep Learning With Prototype Matching for Object Extraction From Very-High-Resolution Remote Sensing Images

FedLF: Adaptive Logit Adjustment and Feature Optimization in Federated Long-Tailed Learning

Client selection based weighted federated few-shot learning

Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection

Improved Algorithm for Image Classification Datasets Using Federated Transfer Learning.