Abstract:Federated learning has gained significant attention because of its potential for privacy-preserving distributed learning. However, statistical heterogeneity and label scarcity remain major issues in multi-client scenarios. Furthermore, existing federated learning algorithms do not consider the unique data distribution of each client, which is essential for enhancing the overall performance of a model. In this study, a new federated learning algorithm called federated fusion learning (FFL) is proposed to address the challenges of statistical heterogeneity and label scarcity in multiclient data fusion. In FFL, each device calculates its data distribution parameters and sends them to the server in a single communication round. The server then uses the received distribution parameters to generate synthetic data for each client and combines them to create a larger dataset. FFL comprises three modules that identify the latent space of each client, intelligently fuse various modalities at the server, and construct global weights. The study also introduces a novel refinement mechanism that embeds training images into the W space, thereby fusing the latent spaces of different clients using a custom multiclient latent space fusion (MCLSF) module. The attention mechanism used in FFL enables effective multiclient fusion by leveraging the inherent correlations between various data modalities. Ten datasets sourced from MedMNIST encompassing diverse imaging modalities such as X-rays, computed tomography (CT), and optical coherence tomography (OCT) were considered. In addition, detailed ablation studies were conducted on multiple client configurations and non-independent and identical (non-IID) setups to ensure the generalizability of the proposed approach. The results demonstrate the enhanced generalizability and overall performance of the global model compared to existing state-of-the-art methods, confirming its broader applicability and effectiveness.

Investigation of Federated Learning Algorithms for Retinal Optical Coherence Tomography Image Classification with Statistical Heterogeneity

Research on Image Classification Algorithm Based on Horizontal Federated Learning

Federated Ophthalmic Disease Diagnosis Based on Weighted Averaging and Local Optimization

Comparative Evaluation of Clustered Federated Learning Methods

An Experimental Study of Data Heterogeneity in Federated Learning Methods for Medical Imaging

Data analysis algorithm for internet of things based on federated learning with optical technology

Fundus-Enhanced Disease-Aware Distillation Model for Retinal Disease Classification from OCT Images

Federated Fusion Learning with Attention Mechanism for Multi-Client Medical Image Analysis

Federated Learning Across Decentralized and Unshared Archives for Remote Sensing Image Classification

Tackling heterogeneity in medical federated learning via aligning vision transformers

FedSLD: Federated Learning with Shared Label Distribution for Medical Image Classification

Federated Impression for Learning with Distributed Heterogeneous Data

Handling Data Heterogeneity via Architectural Design for Federated Visual Recognition

Benchmarking FedAvg and FedCurv for Image Classification Tasks

Study of the performance and scalability of federated learning for medical imaging with intermittent clients

Edge Selection and Clustering for Federated Learning in Optical Inter-LEO Satellite Constellation

Towards Addressing Heterogeneity Of Data In Federated Learning

Federated learning with incremental clustering for heterogeneous data

Resource-constrained Federated Learning with Heterogeneous Data: Formulation and Analysis

Towards Satellite Non-IID Imagery: A Spectral Clustering-Assisted Federated Learning Approach

Federated Learning in Ocular Imaging: Current Progress and Future Direction