Abstract:Multi-objective learning (MOL) problems often arise in emerging machine learning problems when there are multiple learning criteria, data modalities, or learning tasks. Different from single-objective learning, one of the critical challenges in MOL is the potential conflict among different objectives during the iterative optimization process. Recent works have developed various dynamic weighting algorithms for MOL such as MGDA and its variants, where the central idea is to find an update direction that avoids conflicts among objectives. Albeit its appealing intuition, empirical studies show that dynamic weighting methods may not always outperform static ones. To understand this theory-practical gap, we focus on a new stochastic variant of MGDA - the Multi-objective gradient with Double sampling (MoDo) algorithm, and study the generalization performance of the dynamic weighting-based MoDo and its interplay with optimization through the lens of algorithm stability. Perhaps surprisingly, we find that the key rationale behind MGDA -- updating along conflict-avoidant direction - may hinder dynamic weighting algorithms from achieving the optimal ${\cal O}(1/\sqrt{n})$ population risk, where $n$ is the number of training samples. We further demonstrate the impact of the variability of dynamic weights on the three-way trade-off among optimization, generalization, and conflict avoidance that is unique in MOL. We showcase the generality of our theoretical framework by analyzing other existing stochastic MOL algorithms under the framework. Experiments on various multi-task learning benchmarks are performed to demonstrate the practical applicability. Code is available at <a class="link-external link-https" href="https://github.com/heshandevaka/Trade-Off-MOL" rel="external noopener nofollow">this https URL</a>.

Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidance

Direction-oriented Multi-objective Learning: Simple and Provable Stochastic Algorithms

Learning to Expand/Contract Pareto Sets in Dynamic Multi-Objective Optimization With a Changing Number of Objectives

On the Convergence of Stochastic Multi-Objective Gradient Manipulation and Beyond

Transfer Learning based Dynamic Multiobjective Optimization Algorithms

Multi-objective grasshopper optimization algorithm based on multi-group and co-evolution

Multi-Objective Individualized-Instruction Teaching-Learning-Based Optimization Algorithm.

A Mahalanobis Distance-based Approach for Dynamic Multi-objective Optimization with Stochastic Changes

Interactive Evolutionary Multi-Objective Optimization via Learning-to-Rank

A reinforcement learning-based multi-objective optimization in an interval and dynamic environment

Multi-strategy ensemble evolutionary algorithm for dynamic multi-objective optimization

Multi-Task Learning with Multi-Task Optimization

Learning to optimize by multi-gradient for multi-objective optimization

A Tradeoff-Based Interactive Multi-Objective Optimization Method Driven by Evolutionary Algorithms.

Elitism-based transfer learning and diversity maintenance for dynamic multi-objective optimization

Federated Multi-Objective Learning

Conflict-Averse Gradient Descent for Multi-task Learning

Multi-Objective Optimization for Sparse Deep Multi-Task Learning

Gradient-based algorithms for multi-objective bi-level optimization

Multi-Task Learning as Multi-Objective Optimization

Conflict-Averse Gradient Aggregation for Constrained Multi-Objective Reinforcement Learning