Abstract:Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized yet well-distributed models that collectively embody different trade-offs in one algorithmic pass, this paper proposes to view Pareto multi-task learning through the lens of multi-task optimization. Multi-task learning is first cast as a multi-objective optimization problem, which is then decomposed into a diverse set of unconstrained scalar-valued subproblems. These subproblems are solved jointly using a novel multi-task gradient descent method, whose uniqueness lies in the iterative transfer of model parameters among the subproblems during the course of optimization. A theorem proving faster convergence through the inclusion of such transfers is presented. We investigate the proposed multi-task learning with multi-task optimization for solving various problem settings including image classification, scene understanding, and multi-target regression. Comprehensive experiments confirm that the proposed method significantly advances the state-of-the-art in discovering sets of Pareto-optimized models. Notably, on the large image dataset we tested on, namely NYUv2, the hypervolume convergence achieved by our method was found to be nearly two times faster than the next-best among the state-of-the-art.
What problem does this paper attempt to address?
This paper mainly discusses the problem of task conflict in Multi-Task Learning (MTL). Traditional MTL methods try to find a globally optimal solution to optimize all relevant tasks, but in practical applications, different tasks may have conflicting interests, making it impossible to find a single solution that performs well on all tasks simultaneously. To address this problem, the paper proposes to view multi-task learning as a Multi-Objective Optimization (MOO) problem and decompose it into multiple unconstrained scalar sub-problems. Through a novel multi-task gradient descent method, these sub-problems can be solved jointly, and the parameters are iteratively transferred between different sub-problems to accelerate the optimization process. This method can find a set of representative Pareto optimal models in one algorithm run, which collectively embody multiple user demands, rather than just capturing what a single model can.
The main contributions of the paper include:
1. Proposing a new multi-task gradient descent method that can converge to a set of Pareto optimal models in one optimization process.
2. The uniqueness of the method lies in the iterative transfer of model parameters between sub-problems during the joint optimization process, and theoretical analysis has shown that this transfer can accelerate convergence speed.
3. Experimental results demonstrate that the proposed MT2O method significantly improves the state-of-the-art standards in various problem settings such as image classification, scene understanding, and multi-object regression, especially achieving nearly twice the convergence speed on the large-scale image dataset NYUv2.
The paper first introduces the conflicts in multi-task learning and the basic concepts of multi-objective optimization, such as Pareto optimal solutions and Pareto frontiers. Then, it converts multi-task learning into a multi-objective optimization problem and transforms it into a series of sub-problems through decomposition methods. Next, it proposes a new multi-task gradient descent method to solve these sub-problems through parameter transfer, thereby finding a set of Pareto optimal models in one iteration. Finally, the paper validates the effectiveness and efficiency of the method through experiments.