Abstract:Federated learning (FL) is an efficient decentralized machine learning methodology for processing nonindependent and identically distributed (non-IID) data due to geographical and temporal distribution differences. Non-IID data generally indicates substantial disparities in data distribution and features among clients. This assumption is completely different from the conventional assumption of independent and identically distributed (IID) data in which all clients' data originates from the same distribution. There are many factors that affect the features of non-IID data, such as user preferences, data collection methods, and client characteristics. The factors of data distribution, category proportions, and feature representation also affect the statistical properties of non-IID data. This article conducts an in-depth exploration of FL with the consideration of diverse features and statistical properties of non-IID data. Specifically, we first discuss the impact of non-IID data on communication efficiency, model convergence, and FL accuracy. The presence of non-IID data leads to increased communication overhead, imbalanced class distribution, and uneven local model updates. All of these affect FL convergence and performance. Then, we present the latest advanced techniques, such as data partitioning/sharing, client selection, differential privacy, and secure aggregation, which are used to address the challenges posed by non-IID data in terms of communication efficiency and privacy protection. Furthermore, we show the emerging applications and use cases of FL with non-IID data in various domains, such as healthcare, Internet of Things, and edge computing. Overall, this survey provides a comprehensive understanding of FL with non-IID data, including the challenges, advancements, and practical applications in different areas.

Non-IID federated learning via random exchange of local feature maps for textile IIoT secure computing

Privacy-Preserving Federated Learning Against Label-Flipping Attacks on Non-IID Data

Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial Intelligent

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

An Efficient Industrial Federated Learning Framework for AIoT: A Face Recognition Application

Decentralized Communication-assisted Sensing Based on Federated Learning Framework for IIoT.

Federated Learning with Non-IID Data: A Survey

Information-Exchangeable Hierarchical Clustering for Federated Learning with Non-IID Data

Deep Reinforcement Learning Assisted Federated Learning Algorithm for Data Management of IIoT

A Survey of Federated Learning on Non-IID Data

A Novel Buffered Federated Learning Framework for Privacy-Driven Anomaly Detection in IIoT

Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing

Intrusion Detection based on Privacy-preserving Federated Learning for the Industrial IoT

Data analysis algorithm for internet of things based on federated learning with optical technology

Fed-FSNet: Mitigating Non-I.I.D. Federated Learning via Fuzzy Synthesizing Network

Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence

Enhancing IoT Security: A Novel Approach with Federated Learning and Differential Privacy Integration

Feature Matching Data Synthesis for Non-IID Federated Learning

Federated Deep Learning for Intrusion Detection in IoT Networks