Abstract:Multi-objective learning (MOL) problems often arise in emerging machine learning problems when there are multiple learning criteria, data modalities, or learning tasks. Different from single-objective learning, one of the critical challenges in MOL is the potential conflict among different objectives during the iterative optimization process. Recent works have developed various dynamic weighting algorithms for MOL such as MGDA and its variants, where the central idea is to find an update direction that avoids conflicts among objectives. Albeit its appealing intuition, empirical studies show that dynamic weighting methods may not always outperform static ones. To understand this theory-practical gap, we focus on a new stochastic variant of MGDA - the Multi-objective gradient with Double sampling (MoDo) algorithm, and study the generalization performance of the dynamic weighting-based MoDo and its interplay with optimization through the lens of algorithm stability. Perhaps surprisingly, we find that the key rationale behind MGDA -- updating along conflict-avoidant direction - may hinder dynamic weighting algorithms from achieving the optimal ${\cal O}(1/\sqrt{n})$ population risk, where $n$ is the number of training samples. We further demonstrate the impact of the variability of dynamic weights on the three-way trade-off among optimization, generalization, and conflict avoidance that is unique in MOL. We showcase the generality of our theoretical framework by analyzing other existing stochastic MOL algorithms under the framework. Experiments on various multi-task learning benchmarks are performed to demonstrate the practical applicability. Code is available at <a class="link-external link-https" href="https://github.com/heshandevaka/Trade-Off-MOL" rel="external noopener nofollow">this https URL</a>.

On the Convergence of Stochastic Multi-Objective Gradient Manipulation and Beyond

PSMGD: Periodic Stochastic Multi-Gradient Descent for Fast Multi-Objective Optimization

Proactive Gradient Conflict Mitigation in Multi-Task Learning: A Sparse Training Perspective

Asynchronous Proximal Stochastic Gradient Algorithm for Composition Optimization Problems

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Conflict-Averse Gradient Descent for Multi-task Learning

Scaled Proximal Gradient Methods for Multiobjective Optimization: Improved Linear Convergence and Nesterov's Acceleration

MGDA Converges under Generalized Smoothness, Provably

Consensus-based Distributed Optimisation of Multi-Agent Networks Via a Two Level Subgradient-Proximal Algorithm

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Barzilai-Borwein Proximal Gradient Methods for Multiobjective Composite Optimization Problems with Improved Linear Convergence

Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidance

Combining Conjugate Gradient and Momentum for Unconstrained Stochastic Optimization With Applications to Machine Learning

Convergence Analysis of a Projected Gradient Method for Multiobjective Optimization Problems

On the convergence of conditional gradient method for unbounded multiobjective optimization problems

Multi-consensus decentralized accelerated gradient descent

Unified Convergence Analysis of Stochastic Momentum Methods for Convex and Non-convex Optimization

Mirror descent method for stochastic multi-objective optimization

Conjugate gradient methods without line search for multiobjective optimization

A Smoothing Stochastic Gradient Method for Composite Optimization

On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization