Abstract:Countless science and engineering applications in multi-objective optimization (MOO) necessitate that decision-makers (DMs) select a Pareto-optimal solution which aligns with their preferences. Evaluating individual solutions is often expensive, necessitating cost-sensitive optimization techniques. Due to competing objectives, the space of trade-offs is also expansive -- thus, examining the full Pareto frontier may prove overwhelming to a DM. Such real-world settings generally have loosely-defined and context-specific desirable regions for each objective function that can aid in constraining the search over the Pareto frontier. We introduce a novel conceptual framework that operationalizes these priors using soft-hard functions, SHFs, which allow for the DM to intuitively impose soft and hard bounds on each objective -- which has been lacking in previous MOO frameworks. Leveraging a novel minimax formulation for Pareto frontier sampling, we propose a two-step process for obtaining a compact set of Pareto-optimal points which respect the user-defined soft and hard bounds: (1) densely sample the Pareto frontier using Bayesian optimization, and (2) sparsify the selected set to surface to the user, using robust submodular function optimization. We prove that (2) obtains the optimal compact Pareto-optimal set of points from (1). We further show that many practical problems fit within the SHF framework and provide extensive empirical validation on diverse domains, including brachytherapy, engineering design, and large language model personalization. Specifically, for brachytherapy, our approach returns a compact set of points with over 3% greater SHF-defined utility than the next best approach. Among the other diverse experiments, our approach consistently leads in utility, allowing the DM to reach >99% of their maximum possible desired utility within validation of 5 points.

Pareto suboptimal solutions to large-scale multiobjective multidimensional knapsack problems with assessments of Pareto suboptimality gaps

Probing the Pareto front of a large-scale multiobjective problem with a MIP solver

Solving efficiently the 0–1 multi-objective knapsack problem

A General Framework for Providing Interval Representations of Pareto Optimal Outcomes for Large-Scale Bi- and Tri-Criteria MIP Problems

Surrogate Dual Method for Multi-Dimensional Nonlinear Knapsack Problems

A penalty decomposition approach for multi-objective cardinality-constrained optimization problems

Adaptive Improvements of Multi-Objective Branch and Bound

Optimization on Pareto sets: On a theory of multi-objective optimization

A Re-solving Heuristic for Dynamic Assortment Optimization with Knapsack Constraints

Advanced greedy algorithms and surrogate constraint methods for linear and quadratic knapsack and covering problems

Obtaining properly Pareto optimal solutions of multiobjective optimization problems via the branch and bound method

Approximate solutions to the multiple-choice knapsack problem by multiobjectivization and Chebyshev scalarization

A LP relaxation based matheuristic for multi-objective integer programming

Multiple stage stochastic linear programming with multiple objectives: flexible decision making

Methods for multi-objective optimization: An analysis

MoSH: Modeling Multi-Objective Tradeoffs with Soft and Hard Bounds

Pareto Sums of Pareto Sets: Lower Bounds and Algorithms

Multiobjective Optimization of Non-Smooth PDE-Constrained Problems

The Multi-Objective Polynomial Optimization

Pareto Optimal Solutions for Smoothed Analysts