Abstract:Thanks to the advantages of cloud and edge computing, federated learning (FL)–based speech emotion recognition (SER) tasks can be well-scaled to cloud-edge-terminal ecosystems. It aims to characterize emotions while protecting data privacy. However, catastrophic forgetting caused by data heterogeneity, potential system attacks, and possible privacy leakage and communication overhead from parameter sharing have constrained its breakthrough. Some schemes that attempt to tackle the FL bottleneck do not consider these issues comprehensively. We propose a federated distillation-based multiple defense approach (FedMud), which simultaneously considers how to balance system performance, privacy security, and communication overhead. First, It employs a server-side lightweight generator to learn global view knowledge and guides client-side updates through distillation, further mitigating catastrophic forgetting and improving system performance. In addition, we design a multi-path integrated defense paradigm to counter potential system attacks, with a data perturbation technique based on gradient modification, a dynamically weighted selection method, and a privacy-enhanced strategy by capturing discriminative features. Moreover, to minimize parameter leakage, the parameter-decoupled hierarchical sharing mechanism is utilized, which also significantly reduces the communication overhead. The experimental results show that our approach is effective, with gender predictions down to chance levels while maintaining SER performance enhancements.

A distillation-based approach integrating continual learning and federated learning for pervasive services

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Federated Learning and catastrophic forgetting in pervasive computing: demonstration in HAR domain

Continual Federated Learning Based on Knowledge Distillation

Federated Continual Learning via Knowledge Fusion: A Survey

Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edges

FedINC: an Exemplar-Free Continual Federated Learning Framework with Small Labeled Data

Efficient knowledge management for heterogenous federated continual learning on resource-constrained edge devices

A Generalized Look at Federated Learning: Survey and Perspectives

Evaluation and comparison of federated learning algorithms for Human Activity Recognition on smartphones

Discriminative Feature Learning-Based Federated Lightweight Distillation Against Multiple Attacks

Towards Personalized Federated Learning via Comprehensive Knowledge Distillation

Towards Long-Term Remembering in Federated Continual Learning

Personalized Edge Intelligence via Federated Self-Knowledge Distillation

Online Distillation with Continual Learning for Cyclic Domain Shifts

Addressing Client Drift in Federated Continual Learning with Adaptive Optimization

Federated Continual Learning Goes Online: Uncertainty-Aware Memory Management for Vision Tasks and Beyond

Federated Learning in Practice: Reflections and Projections

Parameterizing Federated Continual Learning for Reproducible Research

Accurate Forgetting for Heterogeneous Federated Continual Learning

Federated Self-Supervised Learning in Heterogeneous Settings: Limits of a Baseline Approach on HAR