Abstract:In recent years, multi-objective optimization (MOO) emerges as a foundational problem underpinning many multi-agent multi-task learning applications. However, existing algorithms in MOO literature remain limited to centralized learning settings, which do not satisfy the distributed nature and data privacy needs of such multi-agent multi-task learning applications. This motivates us to propose a new federated multi-objective learning (FMOL) framework with multiple clients distributively and collaboratively solving an MOO problem while keeping their training data private. Notably, our FMOL framework allows a different set of objective functions across different clients to support a wide range of applications, which advances and generalizes the MOO formulation to the federated learning paradigm for the first time. For this FMOL framework, we propose two new federated multi-objective optimization (FMOO) algorithms called federated multi-gradient descent averaging (FMGDA) and federated stochastic multi-gradient descent averaging (FSMGDA). Both algorithms allow local updates to significantly reduce communication costs, while achieving the {\em same} convergence rates as those of their algorithmic counterparts in the single-objective federated learning. Our extensive experiments also corroborate the efficacy of our proposed FMOO algorithms.

What problem does this paper attempt to address?

### Problems Addressed by the Paper This paper aims to address the application of Multi-Objective Optimization (MOO) in Federated Learning (FL) environments. Specifically, existing multi-objective optimization algorithms are primarily focused on centralized learning settings, which fail to meet the needs for data distribution and privacy protection in distributed multi-agent multi-task learning applications. Therefore, the paper proposes a new Federated Multi-Objective Learning (FMOL) framework, enabling multiple clients to collaboratively solve multi-objective optimization problems in a distributed manner while keeping their training data private. ### Main Contributions 1. **Proposing the FMOL Framework**: - This framework supports different clients having different sets of objective functions, thereby extending the traditional MOO formulation to the federated learning paradigm. - This framework becomes a general model, encompassing existing MOO models and various application scenarios. 2. **Developing Two New Algorithms**: - **Federated Multi-Gradient Descent Averaging (FMGDA)**: Based on local full gradient evaluations of each client, FMGDA achieves linear \(O(\exp(-\mu T))\) and sublinear \(O(1/T)\) Pareto stable convergence rates under strongly convex and non-convex settings, respectively. - **Federated Stochastic Multi-Gradient Descent Averaging (FSMGDA)**: Based on stochastic gradient evaluations of each client, FSMGDA achieves \(O(1/\sqrt{T})\) and \(O(1/T)\) Pareto stable convergence rates under strongly convex and non-convex settings, respectively. 3. **Theoretical Analysis and Experimental Validation**: - Through rigorous theoretical analysis, the effectiveness and efficiency of FMGDA and FSMGDA in handling objective and data heterogeneity are demonstrated. - Extensive experimental results further validate the effectiveness of the proposed FMOO algorithms. ### Technical Challenges 1. **Objective Heterogeneity**: Due to the distributed nature of the FMOL problem, it is necessary to consider and model the different sets of objective functions that different clients may have. 2. **Data Heterogeneity**: Local and private datasets are non-independent and identically distributed (non-i.i.d.), which needs to be mitigated in the design of FMOL algorithms. 3. **Sensitivity to Common Descent Direction**: Under the combined influence of objective and data heterogeneity, FMOL algorithms are highly sensitive to small perturbations in determining the common descent direction, making algorithm design and convergence analysis more complex. ### Summary By proposing the FMOL framework and developing corresponding FMOO algorithms, the paper fills the gap between federated learning and multi-objective optimization, providing new solutions for distributed multi-agent multi-task learning applications. These algorithms not only have strict convergence guarantees in theory but also exhibit good performance in practical applications.

Federated Multi-Objective Learning

Federated Communication-Efficient Multi-Objective Optimization

Federated Learning Meets Multi-objective Optimization

Multi-Objective Federated Learning: Balancing Global Performance and Individual Fairness

Optimizing Privacy, Utility and Efficiency in Constrained Multi-Objective Federated Learning

Fair Federated Learning with Multi-Objective Hyperparameter Optimization

A First-Order Multi-Gradient Algorithm for Multi-Objective Bi-Level Optimization

Multi-Dimensional Fair Federated Learning

Federated Mutual Learning: a Collaborative Machine Learning Method for Heterogeneous Data, Models, and Objectives

Multi‐Objective Federated Averaging Algorithm

Communication efficiency optimization in federated learning based on multi-objective evolutionary algorithm

Efficient Federated Learning in 6G-Satellite Systems: Deep Reinforcement Learning Based Multi-Objective Optimization

Federated Conditional Stochastic Optimization

Federated Multi-Objective Reinforcement Learning

A Communication-efficient Algorithm with Linear Convergence for Federated Minimax Learning

Multi-Objective Optimization via Wasserstein-Fisher-Rao Gradient Flow

Optimizing Multimodal Federated Learning: Novel Approaches for Efficient Model Aggregation and Client Sampling

PSMGD: Periodic Stochastic Multi-Gradient Descent for Fast Multi-Objective Optimization

FedMM: A Communication Efficient Solver for Federated Adversarial Domain Adaptation

Learning to optimize by multi-gradient for multi-objective optimization

A Q-learning Evolutionary Multiobjective Framework for Multiobjective Optimization with Separable and Interacting Variables.