Abstract:Learning two tasks in a single shared function has some benefits. Firstly by acquiring information from the second task, the shared function leverages useful information that could have been neglected or underestimated in the first task. Secondly, it helps to generalize the function that can be learned using generally applicable information for both tasks. To fully enjoy these benefits, Multi-task Learning (MTL) has long been researched in various domains such as computer vision, language understanding, and speech synthesis. While MTL benefits from the positive transfer of information from multiple tasks, in a real environment, tasks inevitably have a conflict between them during the learning phase, called negative transfer. The negative transfer hampers function from achieving the optimality and degrades the performance. To solve the problem of the task conflict, previous works only suggested partial solutions that are not fundamental, but ad-hoc. A common approach is using a weighted sum of losses. The weights are adjusted to induce positive transfer. Paradoxically, this kind of solution acknowledges the problem of negative transfer and cannot remove it unless the weight of the task is set to zero. Therefore, these previous methods had limited success. In this paper, we introduce a novel approach that can drive positive transfer and suppress negative transfer by leveraging class-wise weights in the learning process. The weights act as an arbitrator of the fundamental unit of information to determine its positive or negative status to the main task.

What problem does this paper attempt to address?

This paper attempts to solve the task - conflict problem in multi - task learning (MTL), especially the negative impact of negative transfer on the performance of the main task. Specifically: 1. **Advantages and Challenges of Multi - task Learning**: - Multi - task learning can improve the generalization ability and performance of the model by sharing functions to obtain information from multiple tasks. - However, in the actual environment, there may be conflicts between different tasks, resulting in negative transfer, which hinders the model from achieving the optimal performance. 2. **Limitations of Existing Methods**: - Traditional methods usually use the weighted sum of losses to balance the weights between different tasks in order to reduce task conflicts. - Although these methods can alleviate negative transfer to a certain extent, they cannot eliminate it fundamentally, because some information is beneficial to one task but may be harmful to another task. 3. **The New Method Proposed in the Paper**: - This paper introduces a new method. By introducing class - wise weights in the auxiliary tasks, it enhances positive transfer and suppresses negative transfer. - Class - wise weights, as arbitrators of information units, can dynamically adjust the influence of each class on the main task, ensuring that only beneficial information is utilized and harmful information is suppressed. 4. **Experimental Verification**: - The paper verifies the effectiveness of the new method through experiments, especially in visual tasks such as semantic segmentation and depth regression, showing better performance than existing methods. In summary, this paper aims to solve the problem of negative transfer in multi - task learning by introducing the class - wise weight mechanism, thereby improving the performance of the main task.

Learning Boost by Exploiting the Auxiliary Task in Multi-task Domain

Towards Impartial Multi-task Learning.

Multi-Task Distillation: Towards Mitigating the Negative Transfer in Multi-Task Learning

HydaLearn: Highly Dynamic Task Weighting for Multi-task Learning with Auxiliary Tasks

Enabling Asymmetric Knowledge Transfer in Multi-Task Learning with Self-Auxiliaries

Dual-Balancing for Multi-Task Learning

Equitable Multi-task Learning

Multi-task Gradient Descent for Multi-Task Learning

FairBranch: Mitigating Bias Transfer in Fair Multi-task Learning

Improving Multi-task Learning via Seeking Task-based Flat Regions

Adaptive Hard Parameter Sharing Method Based on Multi-Task Deep Learning

Generalized Block-Diagonal Structure Pursuit: Learning Soft Latent Task Assignment Against Negative Transfer.

Improving Gradient Trade-offs between Tasks in Multi-task Text Classification

AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning

Learning Functions to Study the Benefit of Multitask Learning

ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning

Multiple Task Learning Using Iteratively Reweighted Least Square.

A Model-Agnostic Approach to Mitigate Gradient Interference for Multi-Task Learning

ESSR: Evolving Sparse Sharing Representation for Multi-task Learning

Multi-Task Learning with Group-Specific Feature Space Sharing

Robust Multi-Task Learning with Excess Risks