Abstract:Given the ubiquity of multi-task in practical systems, Multi-Task Learning (MTL) has found widespread application across diverse domains. In real-world scenarios, these tasks often have different priorities. For instance, In web search, relevance is often prioritized over other metrics, such as click-through rates or user engagement. Existing frameworks pay insufficient attention to the prioritization among different tasks, which typically adjust task-specific loss function weights to differentiate task priorities. However, this approach encounters challenges as the number of tasks grows, leading to exponential increases in hyper-parameter tuning complexity. Furthermore, the simultaneous optimization of multiple objectives can negatively impact the performance of high-priority tasks due to interference from lower-priority tasks. In this paper, we introduce a novel multi-task learning framework employing Lagrangian Differential Multiplier Methods for step-wise multi-task optimization. It is designed to boost the performance of high-priority tasks without interference from other tasks. Its primary advantage lies in its ability to automatically optimize multiple objectives without requiring balancing hyper-parameters for different tasks, thereby eliminating the need for manual tuning. Additionally, we provide theoretical analysis demonstrating that our method ensures optimization guarantees, enhancing the reliability of the process. We demonstrate its effectiveness through experiments on multiple public datasets and its application in Taobao search, a large-scale industrial search ranking system, resulting in significant improvements across various business metrics.

The Multi-Task Learning with an Application of Pareto Improvement.

Multi-Task Learning with Multi-Task Optimization

Multi-Task Learning as Multi-Objective Optimization

Pareto Multi-Task Learning

A Multi-task Learning Approach by Combining Derivative-Free and Gradient Methods.

Multi-Adaptive Optimization for multi-task learning with deep neural networks

A Multiple Gradient Descent Design for Multi-Task Learning on Edge Computing: Multi-Objective Machine Learning Approach

No More Tuning: Prioritized Multi-Task Learning with Lagrangian Differential Multiplier Methods

Multi-Objective Optimization for Sparse Deep Multi-Task Learning

Adaptive Multi-Task Learning Using Lagrange Multiplier for Automatic Art Analysis

Do Current Multi-Task Optimization Methods in Deep Learning Even Help?

Controllable Pareto Multi-Task Learning

Learning with Privileged Tasks.

A New Multitask Joint Learning Framework for Expensive Multi-Objective Optimization Problems

Towards Impartial Multi-task Learning.

Quantifying Task Priority for Multi-Task Optimization

Multi-objective multifactorial evolutionary algorithm enhanced with the weighting helper-task

GDOD: Effective Gradient Descent using Orthogonal Decomposition for Multi-Task Learning

Conflict-Averse Gradient Descent for Multi-task Learning

Equitable Multi-task Learning

Efficient and effective multi-task grouping via meta learning on task combinations