Pareto-Based Multiobjective Machine Learning

JinYaochu,SendhoffB.

2008-01-01

Abstract:Machine learning is inherently a multiobjective task. Traditionally, however, either only one of the objectives is adopted as the cost function or multiple objectives are aggregated to a scalar cos...

What problem does this paper attempt to address?

Pareto Multi-Task Learning

Xi Lin,Hui-Ling Zhen,Zhenhua Li,Qingfu Zhang,Sam Kwong

DOI: https://doi.org/10.48550/arXiv.1912.12854

2019-12-30

Abstract:Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously. However, it is often impossible to find one single solution to optimize all the tasks, since different tasks might conflict with each other. Recently, a novel method is proposed to find one single Pareto optimal solution with good trade-off among different tasks by casting multi-task learning as multiobjective optimization. In this paper, we generalize this idea and propose a novel Pareto multi-task learning algorithm (Pareto MTL) to find a set of well-distributed Pareto solutions which can represent different trade-offs among different tasks. The proposed algorithm first formulates a multi-task learning problem as a multiobjective optimization problem, and then decomposes the multiobjective optimization problem into a set of constrained subproblems with different trade-off preferences. By solving these subproblems in parallel, Pareto MTL can find a set of well-representative Pareto optimal solutions with different trade-off among all tasks. Practitioners can easily select their preferred solution from these Pareto solutions, or use different trade-off solutions for different situations. Experimental results confirm that the proposed algorithm can generate well-representative solutions and outperform some state-of-the-art algorithms on many multi-task learning applications.

Machine Learning
Multi-Task Learning as Multi-Objective Optimization

V. Koltun,Ozan Sener

2018-10-10

Abstract:In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise is to optimize a proxy objective that minimizes a weighted linear combination of per-task losses. However, this workaround is only valid when the tasks do not compete, which is rarely the case. In this paper, we explicitly cast multi-task learning as multi-objective optimization, with the overall objective of finding a Pareto optimal solution. To this end, we use algorithms developed in the gradient-based multi-objective optimization literature. These algorithms are not directly applicable to large-scale learning problems since they scale poorly with the dimensionality of the gradients and the number of tasks. We therefore propose an upper bound for the multi-objective loss and show that it can be optimized efficiently. We further prove that optimizing this upper bound yields a Pareto optimal solution under realistic assumptions. We apply our method to a variety of multi-task deep learning problems including digit classification, scene understanding (joint semantic segmentation, instance segmentation, and depth estimation), and multi-label classification. Our method produces higher-performing models than recent multi-task learning formulations or per-task training.

Mathematics,Computer Science
Optimizing fairness tradeoffs in machine learning with multiobjective meta-models

William G. La Cava

DOI: https://doi.org/10.1145/3583131.3590487

2023-04-21

Abstract:Improving the fairness of machine learning models is a nuanced task that requires decision makers to reason about multiple, conflicting criteria. The majority of fair machine learning methods transform the error-fairness trade-off into a single objective problem with a parameter controlling the relative importance of error versus fairness. We propose instead to directly optimize the error-fairness tradeoff by using multi-objective optimization. We present a flexible framework for defining the fair machine learning task as a weighted classification problem with multiple cost functions. This framework is agnostic to the underlying prediction model as well as the metrics. We use multiobjective optimization to define the sample weights used in model training for a given machine learner, and adapt the weights to optimize multiple metrics of fairness and accuracy across a set of tasks. To reduce the number of optimized parameters, and to constrain their complexity with respect to population subgroups, we propose a novel meta-model approach that learns to map protected attributes to sample weights, rather than optimizing those weights directly. On a set of real-world problems, this approach outperforms current state-of-the-art methods by finding solution sets with preferable error/fairness trade-offs.

Neural and Evolutionary Computing,Computers and Society,Machine Learning
Collaborative Pareto Set Learning in Multiple Multi-Objective Optimization Problems

Chikai Shang,Rongguang Ye,Jiaqi Jiang,Fangqing Gu

2024-04-28

Abstract:Pareto Set Learning (PSL) is an emerging research area in multi-objective optimization, focusing on training neural networks to learn the mapping from preference vectors to Pareto optimal solutions. However, existing PSL methods are limited to addressing a single Multi-objective Optimization Problem (MOP) at a time. When faced with multiple MOPs, this limitation results in significant inefficiencies and hinders the ability to exploit potential synergies across varying MOPs. In this paper, we propose a Collaborative Pareto Set Learning (CoPSL) framework, which learns the Pareto sets of multiple MOPs simultaneously in a collaborative manner. CoPSL particularly employs an architecture consisting of shared and MOP-specific layers. The shared layers are designed to capture commonalities among MOPs collaboratively, while the MOP-specific layers tailor these general insights to generate solution sets for individual MOPs. This collaborative approach enables CoPSL to efficiently learn the Pareto sets of multiple MOPs in a single execution while leveraging the potential relationships among various MOPs. To further understand these relationships, we experimentally demonstrate that shareable representations exist among MOPs. Leveraging these shared representations effectively improves the capability to approximate Pareto sets. Extensive experiments underscore the superior efficiency and robustness of CoPSL in approximating Pareto sets compared to state-of-the-art approaches on a variety of synthetic and real-world MOPs. Code is available at

Machine Learning,Optimization and Control
Achieving Universal Fairness in Machine Learning: A Multi-objective Optimization Perspective

Zirui Hu,Zheng Zhang,Wenjun Feng,Qi Liu

DOI: https://doi.org/10.1007/978-981-97-5495-3_12

2024-01-01

Abstract:As automatic decision-making systems advance rapidly, ensuring fairness has become an indispensable requirement in machine learning. While numerous fairness-aware learning algorithms have emerged in recent years, most primarily emphasize promoting a single fairness definition centered around a single sensitive attribute. These approaches fail to meet the real-world demand to satisfy multiple fairness definitions across various sensitive attributes simultaneously. To this end, we introduce the concept of Universal Fairness, which involves achieving multiple definitions of fairness for multiple sensitive attributes simultaneously. Due to conflicting objectives in the optimization process, we propose a multi-objective optimization framework, UFair, designed to attain Pareto optimality among different fairness and utility objectives. Theoretically, we demonstrate that UFair can converge to the optimal weights at rate O(1/root T). Empirically, extensive experiments conducted on three real-world datasets validate that our UFair efficiently optimizes different fairness constraints alongside utility goals simultaneously.
Enhancing Fairness and Performance in Machine Learning Models: A Multi-Task Learning Approach with Monte-Carlo Dropout and Pareto Optimality

Khadija Zanna,Akane Sano

2024-10-06

Abstract:Bias originates from both data and algorithmic design, often exacerbated by traditional fairness methods that fail to address the subtle impacts of protected attributes. This study introduces an approach to mitigate bias in machine learning by leveraging model uncertainty. Our approach utilizes a multi-task learning (MTL) framework combined with Monte Carlo (MC) Dropout to assess and mitigate uncertainty in predictions related to protected labels. By incorporating MC Dropout, our framework quantifies prediction uncertainty, which is crucial in areas with vague decision boundaries, thereby enhancing model fairness. Our methodology integrates multi-objective learning through pareto-optimality to balance fairness and performance across various applications. We demonstrate the effectiveness and transferability of our approach across multiple datasets and enhance model explainability through saliency maps to interpret how input features influence predictions, thereby enhancing the interpretability of machine learning models in practical applications.

Machine Learning,Computers and Society
Multi-modal Multi-objective Optimization: Problem Analysis and Case Studies

Yiming Peng,Hisao Ishibuchi,Ke Shang

DOI: https://doi.org/10.1109/ssci44817.2019.9002937

2019-12-01

Abstract:In many real-world applications, multi-objective optimization problems may have more than one Pareto sets. The goal of multi-modal multi-objective optimization is to find all Pareto sets in the decision space. As a relatively new research area, difficulties in solving multi-modal multi-objective optimization problems have not been carefully analyzed in the literature. In this paper, first we point out that standard evolutionary multi-objective algorithms show difficulties when solving multimodal multi-objective optimization problems. Next, using the concept of genetic drift, we clearly explain the decrease of diversity in the decision space during the evolutionary process. Then, we report performance evaluation results of state-of-the- art evolutionary multi-modal multi-objective algorithms using scalable test problems.
A Particle Swarm Optimization-Based Method For Multiobjective Design Optimizations

S. L. Ho,Shiyou Yang,Guangzheng Ni,E. W. C. Lo,H. C. Wong

DOI: https://doi.org/10.1109/TMAG.2005.846033

IF: 1.848

2005-01-01

IEEE Transactions on Magnetics

Abstract:A particle swarm optimization (PSO) based algorithm for finding the Pareto solutions of multiobjective design problems is proposed. To enhance the global searching ability of the available PSOs, a novel formula for updating the particles' velocity and position, as well as the introduction of craziness, are reported. To handle a multiobjective design problem using the improved PSO, a new fitness assignment mechanism is proposed. Moreover, two repositories, together with the age variables for their members, are introduced for storing and selecting the previous best positions of the particle as well as that of its companions. Besides, the use of age variables to enhance the diversity of the solutions is also described. The proposed method is tested on two numerical examples with promising results.
Common pitfalls to avoid while using multiobjective optimization in machine learning

Junaid Akhter,Paul David Fährmann,Konstantin Sonntag,Sebastian Peitz

2024-05-03

Abstract:Recently, there has been an increasing interest in exploring the application of multiobjective optimization (MOO) in machine learning (ML). The interest is driven by the numerous situations in real-life applications where multiple objectives need to be optimized simultaneously. A key aspect of MOO is the existence of a Pareto set, rather than a single optimal solution, which illustrates the inherent trade-offs between objectives. Despite its potential, there is a noticeable lack of satisfactory literature that could serve as an entry-level guide for ML practitioners who want to use MOO. Hence, our goal in this paper is to produce such a resource. We critically review previous studies, particularly those involving MOO in deep learning (using Physics-Informed Neural Networks (PINNs) as a guiding example), and identify misconceptions that highlight the need for a better grasp of MOO principles in ML. Using MOO of PINNs as a case study, we demonstrate the interplay between the data loss and the physics loss terms. We highlight the most common pitfalls one should avoid while using MOO techniques in ML. We begin by establishing the groundwork for MOO, focusing on well-known approaches such as the weighted sum (WS) method, alongside more complex techniques like the multiobjective gradient descent algorithm (MGDA). Additionally, we compare the results obtained from the WS and MGDA with one of the most common evolutionary algorithms, NSGA-II. We emphasize the importance of understanding the specific problem, the objective space, and the selected MOO method, while also noting that neglecting factors such as convergence can result in inaccurate outcomes and, consequently, a non-optimal solution. Our goal is to offer a clear and practical guide for ML practitioners to effectively apply MOO, particularly in the context of DL.

Machine Learning,Optimization and Control
Many-Objective Multi-Solution Transport

Ziyue Li,Tian Li,Virginia Smith,Jeff Bilmes,Tianyi Zhou

2024-03-07

Abstract:Optimizing the performance of many objectives (instantiated by tasks or clients) jointly with a few Pareto stationary solutions (models) is critical in machine learning. However, previous multi-objective optimization methods often focus on a few number of objectives and cannot scale to many objectives that outnumber the solutions, leading to either subpar performance or ignored objectives. We introduce Many-objective multi-solution Transport (MosT), a framework that finds multiple diverse solutions in the Pareto front of many objectives. Our insight is to seek multiple solutions, each performing as a domain expert and focusing on a specific subset of objectives while collectively covering all of them. MosT formulates the problem as a bi-level optimization of weighted objectives for each solution, where the weights are defined by an optimal transport between the objectives and solutions. Our algorithm ensures convergence to Pareto stationary solutions for complementary subsets of objectives. On a range of applications in federated learning, multi-task learning, and mixture-of-prompt learning for LLMs, MosT distinctly outperforms strong baselines, delivering high-quality, diverse solutions that profile the entire Pareto frontier, thus ensuring balanced trade-offs across many objectives.

Machine Learning
The Multi-Objective Polynomial Optimization

Jiawang Nie,Zi Yang

DOI: https://doi.org/10.1287/moor.2023.0200

IF: 2.215

2024-01-06

Mathematics of Operations Research

Abstract:The multi-objective optimization is to optimize several objective functions over a common feasible set. Because the objectives usually do not share a common optimizer, people often consider (weakly) Pareto points. This paper studies multi-objective optimization problems that are given by polynomial functions. First, we study the geometry for (weakly) Pareto values and represent Pareto front as the boundary of a convex set. Linear scalarization problems (LSPs) and Chebyshev scalarization problems (CSPs) are typical approaches for getting (weakly) Pareto points. For LSPs, we show how to use tight relaxations to solve them and how to detect existence or nonexistence of proper weights. For CSPs, we show how to solve them by moment relaxations. Moreover, we show how to check whether a given point is a (weakly) Pareto point or not and how to detect existence or nonexistence of (weakly) Pareto points. We also study how to detect unboundedness of polynomial optimization, which is used to detect nonexistence of proper weights or (weakly) Pareto points. Funding: J. Nie is partially supported by the National Science Foundation [Grant DMS-2110780].

mathematics, applied,operations research & management science
Multi-objective Deep Learning: Taxonomy and Survey of the State of the Art

Sebastian Peitz,Sedjro Salomon Hotegni

2024-12-02

Abstract:Simultaneously considering multiple objectives in machine learning has been a popular approach for several decades, with various benefits for multi-task learning, the consideration of secondary goals such as sparsity, or multicriteria hyperparameter tuning. However - as multi-objective optimization is significantly more costly than single-objective optimization - the recent focus on deep learning architectures poses considerable additional challenges due to the very large number of parameters, strong nonlinearities and stochasticity. This survey covers recent advancements in the area of multi-objective deep learning. We introduce a taxonomy of existing methods - based on the type of training algorithm as well as the decision maker's needs - before listing recent advancements, and also successful applications. All three main learning paradigms supervised learning, reinforcement learning and unsupervised learning are covered, and we also address the recently very popular area of generative modeling.

Machine Learning,Optimization and Control
Multi-Task Learning with Multi-Task Optimization

Lu Bai,Abhishek Gupta,Yew-Soon Ong

2024-03-24

Abstract:Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized yet well-distributed models that collectively embody different trade-offs in one algorithmic pass, this paper proposes to view Pareto multi-task learning through the lens of multi-task optimization. Multi-task learning is first cast as a multi-objective optimization problem, which is then decomposed into a diverse set of unconstrained scalar-valued subproblems. These subproblems are solved jointly using a novel multi-task gradient descent method, whose uniqueness lies in the iterative transfer of model parameters among the subproblems during the course of optimization. A theorem proving faster convergence through the inclusion of such transfers is presented. We investigate the proposed multi-task learning with multi-task optimization for solving various problem settings including image classification, scene understanding, and multi-target regression. Comprehensive experiments confirm that the proposed method significantly advances the state-of-the-art in discovering sets of Pareto-optimized models. Notably, on the large image dataset we tested on, namely NYUv2, the hypervolume convergence achieved by our method was found to be nearly two times faster than the next-best among the state-of-the-art.

Computer Science
An Algorithm for Multi-Objective Multi-Agent Optimization

Maude J. Blondin,Matthew Hale

DOI: https://doi.org/10.23919/acc45564.2020.9148017

2020-07-01

Abstract:Multi-agent optimization problems with many objective functions have drawn much interest over the past two decades. Many works on the subject minimize the sum of objective functions, which implicitly carries a decision about the problem formulation. Indeed, it represents a special case of a multi-objective problem, in which all objectives are prioritized equally. To the best of our knowledge, multi-objective optimization applied to multi-agent systems remains largely unexplored. Therefore, we propose a distributed algorithm that allows the exploration of Pareto optimal solutions for the non-homogeneously weighted sum of objective functions. In the problems we consider, each agent has one objective function to minimize based on a gradient method. Agents update their decision variables by exchanging information with other agents in the network. Information exchanges are weighted by each agent's individual weights that encode the extent to which they prioritize other agents' objectives. This paper provides a proof of convergence, performance bounds, and explicit limits for the results of their computations. Simulation results with different sizes of networks demonstrate the efficiency of the proposed approach and how the choice of weights impacts the agents' final result.
Efficient Pareto Manifold Learning with Low-Rank Structure

Weiyu Chen,James T. Kwok

2024-07-30

Abstract:Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous Pareto front approximations using a linear combination of base networks have emerged as a compelling strategy. However, it suffers from scalability issues when the number of tasks is large. To address this issue, we propose a novel approach that integrates a main network with several low-rank matrices to efficiently learn the Pareto manifold. It significantly reduces the number of parameters and facilitates the extraction of shared features. We also introduce orthogonal regularization to further bolster performance. Extensive experimental results demonstrate that the proposed approach outperforms state-of-the-art baselines, especially on datasets with a large number of tasks.

Machine Learning
Towards Fairness-Aware Multi-Objective Optimization

Guo Yu,Lianbo Ma,Wei Du,Wenli Du,Yaochu Jin

DOI: https://doi.org/10.48550/arXiv.2207.12138

2022-07-22

Optimization and Control

Abstract:Recent years have seen the rapid development of fairness-aware machine learning in mitigating unfairness or discrimination in decision-making in a wide range of applications. However, much less attention has been paid to the fairness-aware multi-objective optimization, which is indeed commonly seen in real life, such as fair resource allocation problems and data driven multi-objective optimization problems. This paper aims to illuminate and broaden our understanding of multi-objective optimization from the perspective of fairness. To this end, we start with a discussion of user preferences in multi-objective optimization and then explore its relationship to fairness in machine learning and multi-objective optimization. Following the above discussions, representative cases of fairness-aware multiobjective optimization are presented, further elaborating the importance of fairness in traditional multi-objective optimization, data-driven optimization and federated optimization. Finally, challenges and opportunities in fairness-aware multi-objective optimization are addressed. We hope that this article makes a small step forward towards understanding fairness in the context of optimization and promote research interest in fairness-aware multi-objective optimization.
Inverse Multiobjective Optimization Through Online Learning

Chaosheng Dong,Yijia Wang,Bo Zeng

DOI: https://doi.org/10.48550/arXiv.2010.06140

2022-12-25

Abstract:We study the problem of learning the objective functions or constraints of a multiobjective decision making model, based on a set of sequentially arrived decisions. In particular, these decisions might not be exact and possibly carry measurement noise or are generated with the bounded rationality of decision makers. In this paper, we propose a general online learning framework to deal with this learning problem using inverse multiobjective optimization. More precisely, we develop two online learning algorithms with implicit update rules which can handle noisy data. Numerical results show that both algorithms can learn the parameters with great accuracy and are robust to noise.

Machine Learning,Optimization and Control
Multi-Objective Learning Model Predictive Control

Siddharth H. Nair,Charlott Vallon,Francesco Borrelli

2024-10-18

Abstract:Multi-Objective Learning Model Predictive Control is a novel data-driven control scheme which improves a linear system's closed-loop performance with respect to several convex control objectives over iterations of a repeated task. At each task iteration, collected system data is used to construct terminal components of a Model Predictive Controller. The formulation presented in this paper ensures that closed-loop control performance improves between successive iterations with respect to each objective. We provide proofs of recursive feasibility and performance improvement, and show that the converged policy is Pareto optimal. Simulation results demonstrate the applicability of the proposed approach.

Systems and Control
Interactive Evolutionary Multi-Objective Optimization via Learning-to-Rank

Ke Li,Guiyu Lai,Xin Yao

DOI: https://doi.org/10.48550/arXiv.2204.02604

2022-04-06

Abstract:In practical multi-criterion decision-making, it is cumbersome if a decision maker (DM) is asked to choose among a set of trade-off alternatives covering the whole Pareto-optimal front. This is a paradox in conventional evolutionary multi-objective optimization (EMO) that always aim to achieve a well balance between convergence and diversity. In essence, the ultimate goal of multi-objective optimization is to help a decision maker (DM) identify solution(s) of interest (SOI) achieving satisfactory trade-offs among multiple conflicting criteria. Bearing this in mind, this paper develops a framework for designing preference-based EMO algorithms to find SOI in an interactive manner. Its core idea is to involve human in the loop of EMO. After every several iterations, the DM is invited to elicit her feedback with regard to a couple of incumbent candidates. By collecting such information, her preference is progressively learned by a learning-to-rank neural network and then applied to guide the baseline EMO algorithm. Note that this framework is so general that any existing EMO algorithm can be applied in a plug-in manner. Experiments on $48$ benchmark test problems with up to 10 objectives fully demonstrate the effectiveness of our proposed algorithms for finding SOI.

Neural and Evolutionary Computing

Pareto-Based Multiobjective Machine Learning

Pareto Multi-Task Learning

Multi-Task Learning as Multi-Objective Optimization

Optimizing fairness tradeoffs in machine learning with multiobjective meta-models

Collaborative Pareto Set Learning in Multiple Multi-Objective Optimization Problems

Achieving Universal Fairness in Machine Learning: A Multi-objective Optimization Perspective

Enhancing Fairness and Performance in Machine Learning Models: A Multi-Task Learning Approach with Monte-Carlo Dropout and Pareto Optimality

Multi-modal Multi-objective Optimization: Problem Analysis and Case Studies

A Particle Swarm Optimization-Based Method For Multiobjective Design Optimizations

Common pitfalls to avoid while using multiobjective optimization in machine learning

Many-Objective Multi-Solution Transport

The Multi-Objective Polynomial Optimization

Multi-objective Deep Learning: Taxonomy and Survey of the State of the Art

Multi-Task Learning with Multi-Task Optimization

An Algorithm for Multi-Objective Multi-Agent Optimization

Efficient Pareto Manifold Learning with Low-Rank Structure

Towards Fairness-Aware Multi-Objective Optimization

Inverse Multiobjective Optimization Through Online Learning

Multi-Objective Learning Model Predictive Control

Interactive Evolutionary Multi-Objective Optimization via Learning-to-Rank