Abstract:In the realm of federated learning (FL), the conventional dual-layered architecture, comprising a central parameter server and peripheral devices, often encounters challenges due to its significant reliance on the central server for communication and security. This dependence becomes particularly problematic in scenarios involving potential malfunctions of devices and servers. While existing device-edge-cloud hierarchical FL (HFL) models alleviate some dependence on central servers and reduce communication overheads, they primarily focus on load balancing within edge computing networks and fall short of achieving complete decentralization and edge-centric model aggregation. Addressing these limitations, we introduce the multicenter HFL (MCHFL) framework. This innovative framework replaces the traditional single central server architecture with a distributed network of robust global aggregation centers located at the edge, inherently enhancing fault tolerance crucial for maintaining operational integrity amidst edge network disruptions. Our comprehensive experiments with the MNIST, FashionMNIST, and CIFAR-10 datasets demonstrate the MCHFL’s superior performance. Notably, even under high paralysis ratios of up to 50%, the MCHFL maintains high accuracy levels, with maximum accuracy reductions of only 2.60%, 5.12%, and 16.73% on these datasets, respectively. This performance significantly surpasses the notable accuracy declines observed in traditional single-center models under similar conditions. To the best of our knowledge, the MCHFL is the first edge multicenter FL framework with theoretical underpinnings. Our extensive experimental results across various datasets validate the MCHFL’s effectiveness, showcasing its higher accuracy, faster convergence speed, and stronger robustness compared to single-center models, thereby establishing it as a pioneering paradigm in edge multicenter FL.

Fault Tolerance Based on Neural Networks for the Intelligent Distributed Framework

Towards Enhancing Fault Tolerance in Neural Networks

NV-DNN: Towards Fault-Tolerant DNN Systems with N-Version Programming

Failure-tolerant Distributed Learning for Anomaly Detection in Wireless Networks

Neural Network-Based Optimal Fault-Tolerant Control for Interconnected Nonlinear Systems with Actuator Failures.

A New Small-World Neural Network with its Performance on Fault Tolerance

The superior fault tolerance of artificial neural network training with a fault/noise injection-based genetic algorithm

The Fault-Tolerant Algorithm for Neural Networks on Chip

Nature inspired fault tolerant task allocation in cloud computing using neural network model

An Innovative Approach for Enhancing Relay Coordination in Distribution Systems Through Online Adaptive Strategies Utilizing DNN Machine Learning and a Hybrid GA-SQP Framework

Evolving Fault-Tolerant Neural Networks.

A regenerating spiking neural network

Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clients

Dynamic fault tolerance in distributed simulation system

Integrating Distributed Generation and Advanced Deep Learning for Efficient Distribution System Management and Fault Detection

Structure of fault-tolerant control system based on neural networks

A Redundant Fault-tolerant Aviation Control System Based on Deep Neural Network

Multicenter Hierarchical Federated Learning with Fault-Tolerance Mechanisms for Resilient Edge Computing Networks

An Adaptive Fault Isolation and Tolerant Control Method Based on Consistency Error for Multi-agent Systems

Improving Tolerance of Neural Networks Against Multi-Node Open Fault

A Modified Learning Algorithm for Improving the Fault Tolerance of BP Networks