Abstract:In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed either the absence of constraints or fixed constraints. This work considers a more general setting where the constraints can also dynamically adjust in response to changes in the decision variables. Specifically, we consider linear constraints and analyze the effect of decision-dependent distributions in both the objective function and constraints. Firstly, we establish a sufficient condition for the existence of a constrained equilibrium point, at which the distributions remain invariant under retraining. Morevoer, we propose and analyze two algorithms: repeated constrained optimization and repeated dual ascent. For each algorithm, we provide sufficient conditions for convergence to the constrained equilibrium point. Furthermore, we explore the relationship between the equilibrium point and the optimal point for the constrained decision-dependent optimization problem. Notably, our results encompass previous findings as special cases when the constraints remain fixed. To show the effectiveness of our theoretical analysis, we provide numerical experiments on both a market problem and a dynamic pricing problem for parking based on real-world data.

What problem does this paper attempt to address?

The paper primarily focuses on constrained optimization problems under decision-dependent distributions. Specifically, the issues studied in the research involve the following characteristics: - **Problem Background**: In many real-world applications, decisions made by machine learning algorithms can influence the future behavior of the system, thereby altering the data distribution. For example, in the dynamic parking pricing management problem, users may adjust their parking time and decide whether to park based on the price, leading to changes in the data distribution. - **Research Objective**: The paper aims to address a more general situation where not only the data distribution in the objective function depends on changes in the decision variables, but the constraints can also dynamically respond to changes in the decision variables. - **Core Contributions**: - Defined the "constrained equilibrium point," a state where the distribution remains unchanged before and after the decision changes. - Proposed two algorithms: Repeated Constrained Minimization (RCM) and Repeated Dual Ascent (RDA), to find the aforementioned equilibrium point, and analyzed the sufficient conditions for these algorithms to converge to the equilibrium point. - Explored the relationship between the constrained equilibrium point and the optimal solution, and proved that under certain conditions, the distance between the two can be bounded. - **Theoretical Analysis**: - Introduced the concept of ϵ-sensitivity to quantify the rate at which the distribution changes with the decision. - Established a series of assumptions, including the strong convexity and smoothness of the loss function, and the sensitivity of the distribution mapping, to ensure the validity of the theoretical analysis. - Provided theorems on the convergence of the algorithms, revealing the conditions under which the algorithms converge to the equilibrium point. - **Experimental Validation**: To validate the effectiveness of the theoretical analysis, the paper provides numerical experimental results on market problems and a dynamic parking pricing problem based on real-world data. In summary, this paper addresses a class of constrained optimization problems under decision-dependent distributions and proposes new methods and theoretical foundations to solve such problems.

Constrained Optimization with Decision-Dependent Distributions

Stochastic Optimization with Decision-Dependent Distributions

Distributionally robust optimization with decision dependent ambiguity sets

Convergence Analysis for Distributionally Robust Optimization and Equilibrium Problems

From Data to Decisions: Distributionally Robust Optimization Is Optimal

Differential-Equation Constrained Optimization With Stochasticity

A Distributionally Robust Optimization Approach for Chance-Constrained Stochastic Multi-Attribute Decision-Making with Unknown Probability Density Function

Differential Equation–Constrained Optimization with Stochasticity

Stability Analysis of Optimization Problems with $k$th Order Stochastic and Distributionally Robust Dominance Constraints Induced by Full Random Recourse

Distributionally Robust Optimization with Markovian Data

Tractable Distributionally Robust Optimization with Data

A Pareto Dominance Principle for Data-Driven Optimization

Distributionally Robust Optimization Under a Decision-Dependent Ambiguity Set with Applications to Machine Scheduling and Humanitarian Logistics

On Distributionally Robust Optimization Problems with K-Th Order Stochastic Dominance Constraints Induced by Full Random Quadratic Recourse

Distributionally Robust Optimization with Confidence Bands for Probability Density Functions

Globally-Constrained Decentralized Optimization with Variable Coupling

Zeroth-Order Methods for Nonconvex Stochastic Problems with Decision-Dependent Distributions

A Unified Distributed Method for Constrained Networked Optimization via Saddle-Point Dynamics

Stochastic First-Order Algorithms for Constrained Distributionally Robust Optimization

Distributionally Favorable Optimization: A Framework for Data-Driven Decision-Making with Endogenous Outliers

Convergence Analysis for Mathematical Programs with Distributionally Robust Chance Constraint