Abstract:Enhancing deep learning performance requires extensive datasets. Centralized training raises concerns about data ownership and security. Additionally, large models are often unsuitable for hospitals due to their limited resource capacities. Federated learning (FL) has been introduced to address these issues. However, FL faces challenges such as vulnerability to attacks, non-IID data, reliance on a central server, high communication overhead, and suboptimal model aggregation. Furthermore, FL is not optimized for realistic hospital database environments, where data are dynamically accumulated. To overcome these limitations, we propose federated influencer learning (FIL) as a secure and efficient collaborative learning paradigm. Unlike the server-client model of FL, FIL features an equal-status structure among participants, with an administrator overseeing the overall process. FIL comprises four stages: local training, qualification, screening, and influencing. Local training is similar to vanilla FL, except for the optional use of a shared dataset. In the qualification stage, participants are classified as influencers or followers. During the screening stage, the integrity of the logits from the influencer is examined. If the integrity is confirmed, the influencer shares their knowledge with the others. FIL is more secure than FL because it eliminates the need for model-parameter transactions, central servers, and generative models. Additionally, FIL supports model-agnostic training. These features make FIL particularly promising for fields such as healthcare, where maintaining confidentiality is crucial. Our experiments demonstrated the effectiveness of FIL, which outperformed several FL methods on large medical (X-ray, MRI, and PET) and natural (CIFAR-10) image dataset in a dynamically accumulating database environment, with consistently higher precision, recall, Dice score, and lower standard deviation between participants. In particular, in the PET dataset, FIL achieved about a 40% improvement in Dice score and recall.

Efficient Ring-Topology Decentralized Federated Learning with Deep Generative Models for Medical Data in Ehealthcare Systems

Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial Intelligent

FedDGP: Disentangling Global and Personal Models for Federated Learning

A Federated Learning Framework Via Decentralized Data Valuation for Chronic Disease Healthcare

Robust and Privacy-Preserving Decentralized Deep Federated Learning Training: Focusing on Digital Healthcare Applications

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

GFL: A Decentralized Federated Learning Framework Based On Blockchain.

AccDFL: Accelerated Decentralized Federated Learning for Healthcare IoT Networks

Personalized Retrogress-Resilient Framework for Real-World Medical Federated Learning

DEEP-FEL: Decentralized, Efficient and Privacy-Enhanced Federated Edge Learning for Healthcare Cyber Physical Systems

DeceFL:a Principled Fully Decentralized Federated Learning Framework

EPDR: an Efficient and Privacy-Preserving Disease Research System with Horizontal Federated Learning in the Internet of Medical Things

Intelligent Fault Diagnosis Via Ring-Based Decentralized Federated Transfer Learning

Practical and Robust Federated Learning With Highly Scalable Regression Training

MetaFed: Federated Learning Among Federations With Cyclic Knowledge Distillation for Personalized Healthcare

Federated Edge Learning for Medical Image Augmentation

Personalized Retrogress-Resilient Federated Learning Toward Imbalanced Medical Data

PVD-FL: A Privacy-Preserving and Verifiable Decentralized Federated Learning Framework

Federated learning based futuristic biomedical big-data analysis and standardization

Distributed and Deep Vertical Federated Learning with Big Data

Federated influencer learning for secure and efficient collaborative learning in realistic medical database environment