Abstract:With the advancement of technology, clients have a large amount of personal data. Human beings are paying more and more attention to the privacy and security of this part of data. Clients do not want to share private data, which directly leads to the existence of data islands. Especially in few-shot scenarios, due to the insufficient amount of personal data, constructing an effective few-shot model is difficult. To solve the above problems, we propose Federated Few-shot Learning (FedFSL) in this paper. We utilize Federated Learning (FedL) to ensure the privacy and security issues of joint training. Moreover, the global model obtained by FedL has the characteristics of universally applicable to all clients. That universality satisfies the scenario of universally applicable to all meta tasks in the few-shot meta-learning stage. What is more, to obtain a more effective global federated universal few-shot model, we respectively proposed Weighted FedL (WFedL) and Client Selection based FedL (CSFedL) strategies. WFedL takes into account the difference between clients performance when building the global model and assigns different weights to different clients. CSFedL considers the malicious participation of clients, and we propose an adaptive client selection strategy to mitigate the impact caused by malicious participation. Extensive federated experiments on CIFAR-10 and CIFAR-100 show the advantage of proposed WFedL, CSFedL and combined Client Selection based WFedL (CSWFedL). We further verify the performance improvement of FedFSL on miniImagenet and propose our overall framework Client Selection based WFedFSL (CSWFedFSL). The best performance of CSWFedFSL is higher than both the few-shot baseline and FedFSL, and CSWFedFSL protects clients data privacy in the few-shot scenario.

Joint Client-and-Sample Selection for Federated Learning Via Bi-level Optimization

Sample-level Data Selection for Federated Learning.

FedSW: Federated learning with adaptive sample weights

Data Quality-Aware Client Selection in Heterogeneous Federated Learning

Client selection based weighted federated few-shot learning

FedSampling: A Better Sampling Strategy for Federated Learning

Collaboratively Learning Federated Models from Noisy Decentralized Data

Learning Cautiously in Federated Learning with Noisy and Heterogeneous Clients

Sample Selection with Deadline Control for Efficient Federated Learning on Heterogeneous Clients

Federated Learning Optimization Algorithm for Automatic Weight Optimal

FED-SDS: Adaptive Structured Dynamic Sparsity for Federated Learning under Heterogeneous Clients

Clients Help Clients: Alternating Collaboration for Semi-Supervised Federated Learning

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

FedBalancer: Data and Pace Control for Efficient Federated Learning on Heterogeneous Clients

Non-IID always Bad? Semi-Supervised Heterogeneous Federated Learning with Local Knowledge Enhancement

Overhead-free Noise-tolerant Federated Learning: A New Baseline

FedSSA: Semantic Similarity-based Aggregation for Efficient Model-Heterogeneous Personalized Federated Learning

FLAS: Computation and Communication Efficient Federated Learning via Adaptive Sampling

Bilateral Improvement in Local Personalization and Global Generalization in Federated Learning.

Enhancing Federated Learning with In-Cloud Unlabeled Data

Privacy-preserving Data Selection for Horizontal and Vertical Federated Learning