Discussion: The NoMax Strategy and Correlated Outputs

Warren Hare,Jason Loeppky,Brian Williams

DOI: https://doi.org/10.48550/arXiv.1507.08241

2015-07-30

Abstract:This is a discussion of the paper "Modeling an Augmented Lagrangian for Improved Blackbox Constrained Optimization," (Gramacy, R.~B., Gray, G.~A., Digabel, S.~L., Lee, H.~K.~H., Ranjan, P., Wells, G., and Wild, S.~M., Technometrics, 61, 1--38, 2015).

Optimization and Control

What problem does this paper attempt to address?

A Monotonous Method Based on Maximal Entropy Function in Nonlinear Programming

李会荣,高岳林,林洪伟

DOI: https://doi.org/10.3969/j.issn.1000-2367.2009.01.050

2009-01-01

Abstract:This paper gives a monotonic transformation of objective function's product form deal with some non-monotonic programming problems with monotonic constraints.Firstly,a nonlinear programming problem with multiple constraints is converted into nonlinear programming problem with single constraints by maximum entropy function.Secondly,nonlinear programming problem with single constraint is converted into a monotonic programming problem and the equivalence between converted monotonic programming problem and the programming problem with single constraint is proved.
MinMax Networks

Winfried Lohmiller,Philipp Gassert,Jean-Jacques Slotine

2023-06-16

Abstract:While much progress has been achieved over the last decades in neuro-inspired machine learning, there are still fundamental theoretical problems in gradient-based learning using combinations of neurons. These problems, such as saddle points and suboptimal plateaus of the cost function, can lead in theory and practice to failures of learning. In addition, the discrete step size selection of the gradient is problematic since too large steps can lead to instability and too small steps slow down the learning. This paper describes an alternative discrete MinMax learning approach for continuous piece-wise linear functions. Global exponential convergence of the algorithm is established using Contraction Theory with Inequality Constraints, which is extended from the continuous to the discrete case in this paper: The parametrization of each linear function piece is, in contrast to deep learning, linear in the proposed MinMax network. This allows a linear regression stability proof as long as measurements do not transit from one linear region to its neighbouring linear region. The step size of the discrete gradient descent is Lagrangian limited orthogonal to the edge of two neighbouring linear functions. It will be shown that this Lagrangian step limitation does not decrease the convergence of the unconstrained system dynamics in contrast to a step size limitation in the direction of the gradient. We show that the convergence rate of a constrained piece-wise linear function learning is equivalent to the exponential convergence rates of the individual local linear regions.

Machine Learning,Dynamical Systems
Max-Plus Synchronization in Decentralized Trading Systems

Hans Riess,Michael Munger,Michael M. Zavlanos

2023-09-14

Abstract:We introduce a decentralized mechanism for pricing and exchanging alternatives constrained by transaction costs. We characterize the time-invariant solutions of a heat equation involving a (weighted) Tarski Laplacian operator, defined for max-plus matrix-weighted graphs, as approximate equilibria of the trading system. We study algebraic properties of the solution sets as well as convergence behavior of the dynamical system. We apply these tools to the "economic problem" of allocating scarce resources among competing uses. Our theory suggests differences in competitive equilibrium, bargaining, or cost-benefit analysis, depending on the context, are largely due to differences in the way that transaction costs are incorporated into the decision-making process. We present numerical simulations of the synchronization algorithm (RRAggU), demonstrating our theoretical findings.

Computer Science and Game Theory,Discrete Mathematics,Theoretical Economics,Systems and Control
Max-Linear Regression by Convex Programming

Seonho Kim,Sohail Bahmani,Kiryung Lee

DOI: https://doi.org/10.1109/tit.2024.3350518

IF: 2.5

2024-02-20

IEEE Transactions on Information Theory

Abstract:We consider the multivariate max-linear regression problem where the model parameters need to be estimated from independent samples of the (noisy) observations . The max-linear model vastly generalizes the conventional linear model, and it can approximate any convex function to an arbitrary accuracy when the number of linear models is large enough. However, the inherent nonlinearity of the max-linear model renders the estimation of the regression parameters computationally challenging. Particularly, no estimator based on convex programming is known in the literature. We formulate and analyze a scalable convex program given by anchored regression (AR) as the estimator for the max-linear regression problem. Under the standard Gaussian observation setting, we present a non-asymptotic performance guarantee showing that the convex program recovers the parameters with high probability. When the linear components are equally likely to achieve the maximum, our result shows a sufficient number of noise-free observations for exact recovery scales as up to a logarithmic factor. This sample complexity coincides with that by alternating minimization (Ghosh et al., 2021). Moreover, the same sample complexity applies when the observations are corrupted with arbitrary deterministic noise. We provide empirical results that show that our method performs as our theoretical result predicts, and is competitive with the alternating minimization algorithm particularly in presence of multiplicative Bernoulli noise. Furthermore, we also show empirically that a recursive application of AR can significantly improve the estimation accuracy.

computer science, information systems,engineering, electrical & electronic
The Max-Min Formulation of Multi-Objective Reinforcement Learning: From Theory to a Model-Free Algorithm

Giseung Park,Woohyeon Byeon,Seongmin Kim,Elad Havakuk,Amir Leshem,Youngchul Sung

2024-06-12

Abstract:In this paper, we consider multi-objective reinforcement learning, which arises in many real-world problems with multiple optimization goals. We approach the problem with a max-min framework focusing on fairness among the multiple goals and develop a relevant theory and a practical model-free algorithm under the max-min framework. The developed theory provides a theoretical advance in multi-objective reinforcement learning, and the proposed algorithm demonstrates a notable performance improvement over existing baseline methods.

Machine Learning,Artificial Intelligence
Nonparametric Inference for Max-Stable Dependence

Johan Segers

DOI: https://doi.org/10.1214/12-STS376C

2012-08-17

Abstract:Discussion of "Statistical Modeling of Spatial Extremes" by A. C. Davison, S. A. Padoan and M. Ribatet [<a class="link-https" data-arxiv-id="1208.3378" href="https://arxiv.org/abs/1208.3378">arXiv:1208.3378</a>].

Methodology
Robust No-Regret Learning in Min-Max Stackelberg Games

Denizalp Goktas,Jiayi Zhao,Amy Greenwald

DOI: https://doi.org/10.48550/arXiv.2203.14126

2022-04-14

Abstract:The behavior of no-regret learning algorithms is well understood in two-player min-max (i.e, zero-sum) games. In this paper, we investigate the behavior of no-regret learning in min-max games with dependent strategy sets, where the strategy of the first player constrains the behavior of the second. Such games are best understood as sequential, i.e., min-max Stackelberg, games. We consider two settings, one in which only the first player chooses their actions using a no-regret algorithm while the second player best responds, and one in which both players use no-regret algorithms. For the former case, we show that no-regret dynamics converge to a Stackelberg equilibrium. For the latter case, we introduce a new type of regret, which we call Lagrangian regret, and show that if both players minimize their Lagrangian regrets, then play converges to a Stackelberg equilibrium. We then observe that online mirror descent (OMD) dynamics in these two settings correspond respectively to a known nested (i.e., sequential) gradient descent-ascent (GDA) algorithm and a new simultaneous GDA-like algorithm, thereby establishing convergence of these algorithms to Stackelberg equilibrium. Finally, we analyze the robustness of OMD dynamics to perturbations by investigating online min-max Stackelberg games. We prove that OMD dynamics are robust for a large class of online min-max games with independent strategy sets. In the dependent case, we demonstrate the robustness of OMD dynamics experimentally by simulating them in online Fisher markets, a canonical example of a min-max Stackelberg game with dependent strategy sets.

Computer Science and Game Theory,Machine Learning,Theoretical Economics
Correlation Robust Stochastic Optimization

Shipra Agrawal,Yichuan Ding,Amin Saberi,Yinyu Ye

DOI: https://doi.org/10.48550/arXiv.0902.1792

2009-10-11

Abstract:We consider a robust model proposed by Scarf, 1958, for stochastic optimization when only the marginal probabilities of (binary) random variables are given, and the correlation between the random variables is unknown. In the robust model, the objective is to minimize expected cost against worst possible joint distribution with those marginals. We introduce the concept of correlation gap to compare this model to the stochastic optimization model that ignores correlations and minimizes expected cost under independent Bernoulli distribution. We identify a class of functions, using concepts of summable cost sharing schemes from game theory, for which the correlation gap is well-bounded and the robust model can be approximated closely by the independent distribution model. As a result, we derive efficient approximation factors for many popular cost functions, like submodular functions, facility location, and Steiner tree. As a byproduct, our analysis also yields some new results in the areas of social welfare maximization and existence of Walrasian equilibria, which may be of independent interest.

Data Structures and Algorithms
Min-Max Optimization under Delays

Arman Adibi,Aritra Mitra,Hamed Hassani

2023-08-25

Abstract:Delays and asynchrony are inevitable in large-scale machine-learning problems where communication plays a key role. As such, several works have extensively analyzed stochastic optimization with delayed gradients. However, as far as we are aware, no analogous theory is available for min-max optimization, a topic that has gained recent popularity due to applications in adversarial robustness, game theory, and reinforcement learning. Motivated by this gap, we examine the performance of standard min-max optimization algorithms with delayed gradient updates. First, we show (empirically) that even small delays can cause prominent algorithms like Extra-gradient (\texttt{EG}) to diverge on simple instances for which \texttt{EG} guarantees convergence in the absence of delays. Our empirical study thus suggests the need for a careful analysis of delayed versions of min-max optimization algorithms. Accordingly, under suitable technical assumptions, we prove that Gradient Descent-Ascent (\texttt{GDA}) and \texttt{EG} with delayed updates continue to guarantee convergence to saddle points for convex-concave and strongly convex-strongly concave settings. Our complexity bounds reveal, in a transparent manner, the slow-down in convergence caused by delays.

Machine Learning,Systems and Control,Optimization and Control
Team-Maxmin Equilibrium: Efficiency Bounds and Algorithms

Nicola Basilico,Andrea Celli,Giuseppe De Nittis,Nicola Gatti

DOI: https://doi.org/10.1609/aaai.v31i1.10560

2017-02-10

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:The Team-maxmin equilibrium prescribes the optimal strategies for a team of rational players sharing the same goal and without the capability of correlating their strategies in strategic games against an adversary. This solution concept can capture situations in which an agent controls multiple resources - corresponding to the team members - that cannot communicate. It is known that such equilibrium always exists and it is unique (except degenerate cases) and these properties make it a credible solution concept to be used in real-world applications, especially in security scenarios. Nevertheless, to the best of our knowledge, the Team-maxmin equilibrium is almost completely unexplored in the literature. In this paper, we investigate bounds of (in)efficiency of the Team-maxmin equilibrium w.r.t. the Nash equilibria and w.r.t. the Maxmin equilibrium when the team members can play correlated strategies. Furthermore, we study a number of algorithms to find and/or approximate an equilibrium, discussing their theoretical guarantees and evaluating their performance by using a standard testbed of game instances.
Average Submodularity of Maximizing Anticoordination in Network Games

Soham Das,Ceyhun Eksin

DOI: https://doi.org/10.1137/22m1506614

IF: 2.2

2024-09-22

SIAM Journal on Control and Optimization

Abstract:SIAM Journal on Control and Optimization, Volume 62, Issue 5, Page 2639-2663, October 2024. We consider the control of decentralized learning dynamics for agents in an anticoordination network game. In the anticoordination network game, there is a preferred action in the absence of neighbors' actions, and the utility an agent receives from the preferred action decreases as more of its neighbors select the preferred action, potentially causing the agent to select a less desirable action. The decentralized dynamics that are based on the synchronous best-response dynamics converge for the considered payoffs. Given a convergent action profile, we measure anticoordination by the number of edges in the underlying graph that have at least one agent in either end of the edge not taking the preferred action. A designer wants to find an optimal set of agents to control under a finite budget in order to achieve maximum anticoordination (MAC) on game convergence as a result of the dynamics. We show that the MAC is submodular in expectation over all realizations of the payoff interaction constants in bipartite networks. The proof relies on characterizing well-behavedness of MAC instances for bipartite networks, and designing a coupling between the dynamics and another distribution preserving selection protocol, for which we can show the diminishing returns property. Utilizing this result, we obtain a performance guarantee for the greedy optimization of MAC. Finally, we provide a computational study to show the effectiveness of greedy node selection strategies to solve MAC on general bipartite networks.

mathematics, applied,automation & control systems
Maximum Optimality Margin: A Unified Approach for Contextual Linear Programming and Inverse Linear Programming

Chunlin Sun,Shang Liu,Xiaocheng Li

DOI: https://doi.org/10.48550/arXiv.2301.11260

2023-05-29

Abstract:In this paper, we study the predict-then-optimize problem where the output of a machine learning prediction task is used as the input of some downstream optimization problem, say, the objective coefficient vector of a linear program. The problem is also known as predictive analytics or contextual linear programming. The existing approaches largely suffer from either (i) optimization intractability (a non-convex objective function)/statistical inefficiency (a suboptimal generalization bound) or (ii) requiring strong condition(s) such as no constraint or loss calibration. We develop a new approach to the problem called \textit{maximum optimality margin} which designs the machine learning loss function by the optimality condition of the downstream optimization. The max-margin formulation enjoys both computational efficiency and good theoretical properties for the learning procedure. More importantly, our new approach only needs the observations of the optimal solution in the training data rather than the objective function, which makes it a new and natural approach to the inverse linear programming problem under both contextual and context-free settings; we also analyze the proposed method under both offline and online settings, and demonstrate its performance using numerical experiments.

Machine Learning,Optimization and Control
New Analyses of Duopoly Game with Output Lower Limiters

Zhaohan Sheng,Jianguo Du,Qiang Mei,Tingwen Huang

DOI: https://doi.org/10.1155/2013/406743

2013-01-01

Abstract and Applied Analysis

Abstract:In the real business world, player sometimes would offer a limiter to their output due to capacity constraints, financial constraints, or cautious response to uncertainty in the world. In this paper, we modify a duopoly game with bounded rationality by imposing lower limiters on output. Within our model, we analyze how lower limiters have an effect on dynamics of output and give proof in theory why adding lower limiters can suppress chaos. We also explore the numbers of the equilibrium points and the distribution of conditioned equilibrium points. Stable region of the conditioned equilibrium is discussed. Numerical experiments show that the output evolution system having lower limiters becomes more robust than without them, and chaos disappears if the lower limiters are big enough. The local or global stability of the conditional equilibrium points provides a theoretical basis for the limiter control method of chaos in economic systems.
Limited-budget output consensus for descriptor multiagent systems with energy constraints

Jianxiang Xi,Cheng Wang,Xiaojun Yang,Bailong Yang

DOI: https://doi.org/10.1109/TCYB.2019.2963172

2019-09-18

Abstract:The current paper deals with limited-budget output consensus for descriptor multiagent systems with two types of switching communication topologies; that is, switching connected ones and jointly connected ones. Firstly, a singular dynamic output feedback control protocol with switching communication topologies is proposed on the basis of the observable decomposition, where an energy constraint is involved and protocol states of neighboring agents are utilized to derive a new two-step design approach of gain matrices. Then, limited-budget output consensus problems are transformed into asymptotic stability ones and a valid candidate of the output consensus function is determined. Furthermore, sufficient conditions for limited-budget output consensus design for two types of switching communication topologies are proposed, respectively. Finally, two numerical simulations are shown to demonstrate theoretical conclusions.

Multiagent Systems,Systems and Control
On Sinkhorn's Algorithm and Choice Modeling

Zhaonan Qu,Alfred Galichon,Johan Ugander

2023-09-30

Abstract:For a broad class of choice and ranking models based on Luce's choice axiom, including the Bradley--Terry--Luce and Plackett--Luce models, we show that the associated maximum likelihood estimation problems are equivalent to a classic matrix balancing problem with target row and column sums. This perspective opens doors between two seemingly unrelated research areas, and allows us to unify existing algorithms in the choice modeling literature as special instances or analogs of Sinkhorn's celebrated algorithm for matrix balancing. We draw inspirations from these connections and resolve important open problems on the study of Sinkhorn's algorithm. We first prove the global linear convergence of Sinkhorn's algorithm for non-negative matrices whenever finite solutions to the matrix balancing problem exist. We characterize this global rate of convergence in terms of the algebraic connectivity of the bipartite graph constructed from data. Next, we also derive the sharp asymptotic rate of linear convergence, which generalizes a classic result of Knight (2008), but with a more explicit analysis that exploits an intrinsic orthogonality structure. To our knowledge, these are the first quantitative linear convergence results for Sinkhorn's algorithm for general non-negative matrices and positive marginals. The connections we establish in this paper between matrix balancing and choice modeling could help motivate further transmission of ideas and interesting results in both directions.

Optimization and Control,Machine Learning,Econometrics
Minimax Option Pricing Meets Black-Scholes in the Limit

Jacob Abernethy,Rafael M. Frongillo,Andre Wibisono

DOI: https://doi.org/10.48550/arXiv.1202.2585

2012-02-13

Abstract:Option contracts are a type of financial derivative that allow investors to hedge risk and speculate on the variation of an asset's future market price. In short, an option has a particular payout that is based on the market price for an asset on a given date in the future. In 1973, Black and Scholes proposed a valuation model for options that essentially estimates the tail risk of the asset price under the assumption that the price will fluctuate according to geometric Brownian motion. More recently, DeMarzo et al., among others, have proposed more robust valuation schemes, where we can even assume an adversary chooses the price fluctuations. This framework can be considered as a sequential two-player zero-sum game between the investor and Nature. We analyze the value of this game in the limit, where the investor can trade at smaller and smaller time intervals. Under weak assumptions on the actions of Nature (an adversary), we show that the minimax option price asymptotically approaches exactly the Black-Scholes valuation. The key piece of our analysis is showing that Nature's minimax optimal dual strategy converges to geometric Brownian motion in the limit.

Computational Finance,Computer Science and Game Theory,Pricing of Securities
On the minimax robustness against correlation and heteroscedasticity of ordinary least squares among generalized least squares estimators of regression

Douglas P. Wiens

2024-04-02

Abstract:We present a result according to which certain functions of covariance matrices are maximized at scalar multiples of the identity matrix. In a statistical context in which such functions measure loss, this says that the least favourable form of dependence is in fact independence, so that a procedure optimal for i.i.d.\ data can be minimax. In particular, the ordinary least squares (\textsc{ols}) estimate of a correctly specified regression response is minimax among generalized least squares (\textsc{gls}) estimates, when the maximum is taken over certain classes of error covariance structures and the loss function possesses a natural monotonicity property. An implication is that it can be not only safe, but optimal to ignore such departures from the usual assumption of i.i.d.\ errors. We then consider regression models in which the response function is possibly misspecified, and show that \textsc{ols} is minimax if the design is uniform on its support, but that this often fails otherwise. We go on to investigate the interplay between minimax \textsc{gls} procedures and minimax designs, leading us to extend, to robustness against dependencies, an existing observation -- that robustness against model misspecifications is increased by splitting replicates into clusters of observations at nearby locations.

Statistics Theory
Maximal Gaussian Affine Models for Multiple Commodities:: A Note

Jaime Casassus,Peng Liu,Ke Tang

2014-01-01

Abstract:This paper extends the maximal affine models of single assets to a multi-commodity setup. We show that the correlated version of maximal affine models for a single commodity is no longer maximal for multiple commodities. In the maximal model, the convenience yield of a certain commodity could depend on the prices of other commodities, which is consistent with the structural model in our companion paper Casassus, Liu, and Tang (2013). This cross-commodity relationship is a feedback effect that may generate substantial comovement among long-run commodity prices, a fact that is consistent with many empirical studies.
Maximal Correlation Regression

Xiangxiang Xu,Shao-Lun Huang

DOI: https://doi.org/10.1109/access.2020.2971386

IF: 3.9

2020-01-01

IEEE Access

Abstract:In this paper, we propose a novel regression analysis approach, called maximal correlation regression, by exploiting the ideas from the Hirschfeld-Gebelein-Rényi (HGR) maximal correlation. We show that in supervised learning problems, the optimal weights in maximal correlation regression can be expressed analytically with the relationships to the HGR maximal correlation functions, which reveals theoretical insights for our approach. In addition, we apply the maximal correlation regression to deep learning, in which efficient training algorithms are proposed for learning the weights in hidden layers. Furthermore, we illustrate that the maximal correlation regression is deeply connected to several existing approaches in information theory and machine learning, including the universal feature selection problem, linear discriminant analysis, and the softmax regression. Finally, experiments on real datasets demonstrate that our approach can obtain performance comparable to the widely used softmax regression based-method.
Event-Triggered Consensus Control Based on Maximum Correntropy Criterion for Discrete-Time Multi-Agent Systems

Jun Liu,Guobin Yang,Nan Zhou,Kaiyu Qin,Badong Chen,Yonghong Wu,Kup-Sze Choi

DOI: https://doi.org/10.1016/j.neucom.2023.126323

IF: 6

2023-05-13

Neurocomputing

Abstract:An event-triggered consensus problem of discrete-time multi-agent systems with impulsive noise under directed switching topology is investigated in this paper, where the control input of each agent is determined by its own state information and the state information of its neighbors that may be corrupted by impulsive noise. Firstly, to reduce the adverse effect of impulsive noise on consensus performance of the discrete-time multi-agent systems, maximum correntropy criterion(MCC) derived from information theoretic learning is introduced to calculate the communication weights among the agents, and an event-triggered strategy is adopted to drive the state variables of each agent to eventually converge to a same value. Secondly, the condition to guarantee consensus of the discrete-time multi-agent systems is derived by graph theory and Lyapunov stability theorem. Finally, the effectiveness of the theory is verified by several numerical simulations.

computer science, artificial intelligence

Discussion: The NoMax Strategy and Correlated Outputs

A Monotonous Method Based on Maximal Entropy Function in Nonlinear Programming

MinMax Networks

Max-Plus Synchronization in Decentralized Trading Systems

Max-Linear Regression by Convex Programming

The Max-Min Formulation of Multi-Objective Reinforcement Learning: From Theory to a Model-Free Algorithm

Nonparametric Inference for Max-Stable Dependence

Robust No-Regret Learning in Min-Max Stackelberg Games

Correlation Robust Stochastic Optimization

Min-Max Optimization under Delays

Team-Maxmin Equilibrium: Efficiency Bounds and Algorithms

Average Submodularity of Maximizing Anticoordination in Network Games

Maximum Optimality Margin: A Unified Approach for Contextual Linear Programming and Inverse Linear Programming

New Analyses of Duopoly Game with Output Lower Limiters

Limited-budget output consensus for descriptor multiagent systems with energy constraints

On Sinkhorn's Algorithm and Choice Modeling

Minimax Option Pricing Meets Black-Scholes in the Limit

On the minimax robustness against correlation and heteroscedasticity of ordinary least squares among generalized least squares estimators of regression

Maximal Gaussian Affine Models for Multiple Commodities:: A Note

Maximal Correlation Regression

Event-Triggered Consensus Control Based on Maximum Correntropy Criterion for Discrete-Time Multi-Agent Systems