Convex Optimization and Online Learning: Their Applications in Discrete Choice Modeling and Pricing

Xiaobo Li

2018-01-01

Abstract:University of Minnesota Ph.D. dissertation. May 2018. Major: Industrial and Systems Engineering. Advisors: Shuzhong Zhang, Zizhuo Wang. 1 computer file (PDF); ix, 129 pages.

What problem does this paper attempt to address?

Introduction to Online Convex Optimization

Elad Hazan

2023-08-06

Abstract:This manuscript portrays optimization as a process. In many practical applications the environment is so complex that it is infeasible to lay out a comprehensive theoretical model and use classical algorithmic theory and mathematical optimization. It is necessary as well as beneficial to take a robust approach, by applying an optimization method that learns as one goes along, learning from experience as more aspects of the problem are observed. This view of optimization as a process has become prominent in varied fields and has led to some spectacular success in modeling and systems that are now part of our daily lives.

Machine Learning,Optimization and Control
Learning From An Optimization Viewpoint

Karthik Sridharan

DOI: https://doi.org/10.48550/arXiv.1204.4145

2012-04-19

Abstract:In this dissertation we study statistical and online learning problems from an optimization <a class="link-external link-http" href="http://viewpoint.The" rel="external noopener nofollow">this http URL</a> dissertation is divided into two parts : I. We first consider the question of learnability for statistical learning problems in the general learning setting. The question of learnability is well studied and fully characterized for binary classification and for real valued supervised learning problems using the theory of uniform convergence. However we show that for the general learning setting uniform convergence theory fails to characterize learnability. To fill this void we use stability of learning algorithms to fully characterize statistical learnability in the general setting. Next we consider the problem of online learning. Unlike the statistical learning framework there is a dearth of generic tools that can be used to establish learnability and rates for online learning problems in general. We provide online analogs to classical tools from statistical learning theory like Rademacher complexity, covering numbers, etc. We further use these tools to fully characterize learnability for online supervised learning problems. II. In the second part, for general classes of convex learning problems, we provide appropriate mirror descent (MD) updates for online and statistical learning of these problems. Further, we show that the the MD is near optimal for online convex learning and for most cases, is also near optimal for statistical convex learning. We next consider the problem of convex optimization and show that oracle complexity can be lower bounded by the so called fat-shattering dimension of the associated linear class. Thus we establish a strong connection between offline convex optimization problems and statistical learning problems. We also show that for a large class of high dimensional optimization problems, MD is in fact near optimal even for convex optimization.

Machine Learning,Computer Science and Game Theory
Lectures on Convex Optimization

Yurii Nesterov

DOI: https://doi.org/10.1007/978-3-319-91578-4

2018-01-01

Abstract:This book provides a comprehensive, modern introduction to convex optimization, a field that is becoming increasingly important in applied mathematics, economics and finance, engineering, and computer science, notably in data science and machine learning. Written by a leading expert in the field, this book includes recent advances in the algorithmic theory of convex optimization, naturally complementing the existing literature. It contains a unified and rigorous presentation of the acceleration techniques for minimization schemes of first- and second-order. It provides readers with a full treatment of the smoothing technique, which has tremendously extended the abilities of gradient-type methods. Several powerful approaches in structural optimization, including optimization in relative scale and polynomial-time interior-point methods, are also discussed in detail. Researchers in theoretical optimization as well as professionals working on optimization problems will find this book very useful. It presents many successful examples of how to develop very fast specialized minimization algorithms. Based on the author’s lectures, it can naturally serve as the basis for introductory and advanced courses in convex optimization for students in engineering, economics, computer science and mathematics.
Implementing Convex Optimization in R: Two Econometric Examples

Zhan Gao,Zhentao Shi

DOI: https://doi.org/10.48550/arXiv.1806.10423

2019-08-04

Abstract:Economists specify high-dimensional models to address heterogeneity in empirical studies with complex big data. Estimation of these models calls for optimization techniques to handle a large number of parameters. Convex problems can be effectively executed in modern statistical programming languages. We complement Koenker and Mizera (2014)'s work on numerical implementation of convex optimization, with focus on high-dimensional econometric estimators. Combining R and the convex solver MOSEK achieves faster speed and equivalent accuracy, demonstrated by examples from Su, Shi, and Phillips (2016) and Shi (2016). Robust performance of convex optimization is witnessed cross platforms. The convenience and reliability of convex optimization in R make it easy to turn new ideas into prototypes.

Computation,Econometrics
Stochastic Calculus for Option Pricing with Convex Duality, Logistic Model, and Numerical Examination

Zheng Cao

2024-08-11

Abstract:This thesis explores the historical progression and theoretical constructs of financial mathematics, with an in-depth exploration of Stochastic Calculus as showcased in the Binomial Asset Pricing Model and the Continuous-Time Models. A comprehensive survey of stochastic calculus principles applied to option pricing is offered, highlighting insights from Peter Carr and Lorenzo Torricelli's ``Convex Duality in Continuous Option Pricing Models". This manuscript adopts techniques such as Monte-Carlo Simulation and machine learning algorithms to examine the propositions of Carr and Torricelli, drawing comparisons between the Logistic and Bachelier models. Additionally, it suggests directions for potential future research on option pricing methods.

Computational Finance,Probability
Convex Discrete Optimization

Shmuel Onn

DOI: https://doi.org/10.48550/arXiv.math/0703575

2007-03-20

Abstract:We develop an algorithmic theory of convex optimization over discrete sets. Using a combination of algebraic and geometric tools we are able to provide polynomial time algorithms for solving broad classes of convex combinatorial optimization problems and convex integer programming problems in variable dimension. We discuss some of the many applications of this theory including to quadratic programming, matroids, bin packing and cutting-stock problems, vector partitioning and clustering, multiway transportation problems, and privacy and confidential statistical data disclosure. Highlights of our work include a strongly polynomial time algorithm for convex and linear combinatorial optimization over any family presented by a membership oracle when the underlying polytope has few edge-directions; a new theory of so-termed n-fold integer programming, yielding polynomial time solution of important and natural classes of convex and linear integer programming problems in variable dimension; and a complete complexity classification of high dimensional transportation problems, with practical applications to fundamental problems in privacy and confidential statistical data disclosure.

Optimization and Control,Computational Complexity,Discrete Mathematics,Combinatorics
Research on The Theoretical Basis and Evolution of Discrete Choice Models

聂冲,贾生华

DOI: https://doi.org/10.3969/j.issn.1000-3894.2005.11.016

2005-01-01

Abstract:The boom of discrete choice models , which belong to the area of microeconometrics,were really beginning from the end of 1950s.The models can be used to analyse the behaviors of private and family experientially, and they are widely applied to economics and other social sciences. This paper begins with the theoretical basis and utility maximization, then demonstrates that there are three limitations of logit: it can not represent random taste variation; it implies proportional substitution across alternatives and cannot handle situations where unobserved factors are correlated over time, though logit is by far the easiest and most widely used discrete choice model. Other models, such as GEV (including nested logit), probit and mixed logit, have arisen largely to avoid these limitations.
Modeling Discrete Choice: Categorical Dependent Variables, Logistic Regression, and Maximum Likelihood Estimation

Anton Ovchinnikov

DOI: https://doi.org/10.2139/ssrn.2975146

2017-01-01

SSRN Electronic Journal

Abstract:This technical note introduces business students to the concepts of modeling discrete choice (e.g., a consumer purchasing brand A versus brand B) using logistic regression and maximum-likelihood estimation. It draws the analogy between modeling discrete choice and building a regression model with a dummy dependent variable and on an example illustrates the need for estimating the probability of a choice rather than the choice itself, which leads to a special kind of regression – logistic regression. The note presents the concepts of utility and a random utility choice model, of which the logistic regression model is the most commonly used. It shows how choice probabilities can be constructed from utilities leading to the logit model. It then presents the maximum-likelihood estimation (MLE) method of fitting the logit model to the choice data. Working through a detailed example using Solver and accompanying spreadsheet model, the note gives students deep understanding for how MLE works and how it is similar and different to the standard least-squared estimation in linear regression. The note concludes by presenting the results of estimation using StatTools, a commercial statistical software. The note avoids the use of heavy mathematical machinery but still requires rudimentary knowledge of exponent and logarithmic functions, probability, and optimization with Solver, as well as familiarity with the “standard” linear regression. Applications include building of models for consumer choice, estimating price elasticity, price optimization, product versioning, product line design, and conjoint analysis. Excerpt UVA-QA-0779 Nov. 7, 2011 MODELING DISCRETE CHOICE: CATEGORICAL DEPENDENT VARIABLES, LOGISTIC REGRESSION, AND MAXIMUM LIKELIHOOD ESTIMATION Consider an individual choosing between two or more discrete alternatives: a shopper in a grocery store deciding between apple or orange juice, or a prospective student determining which of several university offers he ought to accept. For the juice manufacturer and the university, the ability to predict the outcome of such choices is of vital importance. In this note, we will discuss how this might be done. The process we will follow bears some similarity to a regular linear regression but also has substantial differences, primarily due to the fact that the choices are discrete; that is, they correspond to a categorical dependent variable in regression. The Concept of Utility . . .
Discrete Convex Analysis: A Tool for Economics and Game Theory

Kazuo Murota

DOI: https://doi.org/10.48550/arXiv.2212.03598

2022-12-07

Combinatorics

Abstract:This paper presents discrete convex analysis as a tool for economics and game theory. Discrete convex analysis is a new framework of discrete mathematics and optimization, developed during the last two decades. Recently, it is being recognized as a powerful tool for analyzing economic or game models with indivisibilities. The main feature of discrete convex analysis is the distinction of two convexity concepts, M-convexity and L-convexity, for functions in integer or binary variables, together with their conjugacy relationship. The crucial fact is that M-concavity, or its variant called M-natural-concavity, is equivalent to the (gross) substitutes property in economics. Fundamental theorems in discrete convex analysis such as the M-L conjugacy theorems, discrete separation theorems and discrete fixed point theorems yield structural results in economics such as the existence of equilibria and the lattice structure of equilibrium price vectors. Algorithms in discrete convex analysis give iterative auction algorithms as well as computational methods for equilibria.
Learning Convex Optimization Models

Akshay Agrawal,Shane Barratt,Stephen Boyd

DOI: https://doi.org/10.1109/jas.2021.1004075

2021-08-01

IEEE/CAA Journal of Automatica Sinica

Abstract:A convex optimization model predicts an output from an input by solving a convex optimization problem. The class of convex optimization models is large, and includes as special cases many well-known models like linear and logistic regression. We propose a heuristic for learning the parameters in a convex optimization model given a dataset of input-output pairs, using recently developed methods for differentiating the solution of a convex optimization problem with respect to its parameters. We describe three general classes of convex optimization models, maximum a posteriori (MAP) models, utility maximization models, and agent models, and present a numerical experiment for each.
Discrete Choice Analysis: Theory and Application to Travel Demand

M. Ben-Akiva,S. Lerman

1985-12-18

Abstract:This book, which is intended as a graduate level text and a general professional reference, presents the methods of discrete choice analysis and their applications in the modeling of transportation systems. The first seven chapters provide a basic introduction to discrete choice analysis that covers the material needed to apply basic binary and multiple choice models. The chapters are as follows: introduction; review of the statistics of model estimation; theories of individual choice behavior; binary choice models; multinomial choice; aggregate forecasting techniques; and tests and practical issues in developing discrete choice models. The rest of the chapters cover more advanced material and culminate in the development of a complete travel demand model system presented in chapter 11. The advanced chapters are as follows: theory of sampling; aggregation and sampling of alternatives; models of multidimensional choice and the nested logit model; and systems of models. The last chapter (12) presents an overview of current research frontiers.

Economics,Computer Science,Business,Engineering
Online Convex Optimization in Changing Environments and its Application to Resource Allocation

Jianjun Yuan

DOI: https://doi.org/10.48550/arXiv.2009.14436

IF: 5.414

2020-09-30

Machine Learning

Abstract:In the era of the big data, we create and collect lots of data from all different kinds of sources: the Internet, the sensors, the consumer market, and so on. Many of the data are coming sequentially, and would like to be processed and understood quickly. One classic way of analyzing data is based on batch processing, in which the data is stored and analyzed in an offline fashion. However, when the volume of the data is too large, it is much more difficult and time-consuming to do batch processing than sequential processing. What's more, sequential data is usually changing dynamically, and needs to be understood on-the-fly in order to capture the changes. Online Convex Optimization (OCO) is a popular framework that matches the above sequential data processing requirement. Applications using OCO include online routing, online auctions, online classification and regression, as well as online resource allocation. Due to the general applicability of OCO to the sequential data and the rigorous theoretical guarantee, it has attracted lots of researchers to develop useful algorithms to fulfill different needs. In this thesis, we show our contributions to OCO's development by designing algorithms to adapt to changing environments.
Online Mixed Discrete and Continuous Optimization: Algorithms, Regret Analysis and Applications

Lintao Ye,Ming Chi,Zhi-Wei Liu,Xiaoling Wang,Vijay Gupta

2024-08-26

Abstract:We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a continuous actions and then receives a reward associated with the chosen actions. The goal for the decision maker is to maximize the accumulative reward after $T$ rounds. We propose algorithms to solve the online mixed discrete and continuous optimization problem and prove that the algorithms yield sublinear regret in $T$. We show that a wide range of applications in practice fit into the framework of the online mixed discrete and continuous optimization problem, and apply the proposed algorithms to solve these applications with regret guarantees. We validate our theoretical results with numerical experiments.

Optimization and Control
Non-Convex Optimizations for Machine Learning with Theoretical Guarantee: Robust Matrix Completion and Neural Network Learning

Shuai Zhang

2023-06-29

Abstract:Despite the recent development in machine learning, most learning systems are still under the concept of "black box", where the performance cannot be understood and derived. With the rise of safety and privacy concerns in public, designing an explainable learning system has become a new trend in machine learning. In general, many machine learning problems are formulated as minimizing (or maximizing) some loss function. Since real data are most likely generated from non-linear models, the loss function is non-convex in general. Unlike the convex optimization problem, gradient descent algorithms will be trapped in spurious local minima in solving non-convex optimization. Therefore, it is challenging to provide explainable algorithms when studying non-convex optimization problems. In this thesis, two popular non-convex problems are studied: (1) low-rank matrix completion and (2) neural network learning.

Machine Learning,Signal Processing
A survey of assortment optimization problems under logit-based discrete choice models

Rui CHEN,Hai JIANG

DOI: https://doi.org/10.15960/j.cnki.issn.1007-6093.2017.04.008

2017-01-01

Abstract:The assortment optimization problem is a classical problem in revenue management.In this problem,the retailer has to determine the subset of products to of fer from a much larger set,so as to maximize the expected revenue subject to operational constraints.The core of this problem is how to characterize customers' choice behavior among differentiated products,develop optimization models,and design efficient solution algorithms.In this paper,we review existing studies on assortment optimization problems under logit-based discrete choice models.We first introduce assortment optimization problem based on the multinomial logit model.Next,we cover two advanced variants:(1) The first variant is based on the two-level or multi-level nested logit models,which are able to take into consideration the substitution effects among differentiated products;and (2) The second variant is based on the mixtures of multinomial logits model,which can capture the heterogeneity among customers.Then,we cover the data-driven assortment optimization problem under rank-based non-parametric model.Finally,we outline possible directions for future research.
Online Personalized Assortment Optimization with High-Dimensional Customer Contextual Data

Sentao Miao,Xiuli Chao

DOI: https://doi.org/10.1287/msom.2022.1128

2022-01-01

Manufacturing & Service Operations Management

Abstract:Problem definition: Consider an online personalized assortment optimization problem in which customers arrive sequentially and make their decisions (e.g., click an ad, purchase a product) following the multinomial logit choice model with unknown parameters. Utilizing a customer's personal information that is high-dimensional, the firm selects an assortment tailored for each individual customer's preference. Academic/practical relevance: High dimensionality of a customer's contextual information is prevalent in real applications, and it creates tremendous computational challenge in online personalized optimization. Methodology: In this paper, an efficient learning algorithm is developed to tackle the computational complexity issue while maintaining satisfactory performance. The algorithm first applies a random projection for dimension reduction and incorporates an online convex optimization procedure for parameter estimation, thus overcoming the issue of linearly increasing computational requirement as data accumulates. Then, it integrates the upper confidence bound method to balance the exploration and revenue exploitation. Results: The theoretical performance of the algorithm in terms of regret is derived under some plausible sparsity assumption on personal information that is observed in real data, and numerical experiments using both synthetic data and a real data set from Yahoo! show that the algorithm performs very well, having scalability and significant advantage in computational time compared with benchmark methods. Managerial implications: Our findings suggest that practitioners should process high-dimensional sparse customer data with an appropriate feature engineering technique, such as random projection (instead of abandoning the sparse portion) to maximize the effectiveness of online optimization algorithms.
Senior Thesis for Haverford College Convex Optimization, Newton's Method and Interior Point Method

Haoqian Li

DOI: https://doi.org/10.48550/arXiv.2009.12195

2020-09-24

Abstract:This paper consists of four general parts: convex sets; convex functions; convex optimization; and the interior-point algorithm. I will start by introducing the definition of convex sets and give three common convex set examples which will be used later in this paper, then prove the significant separating and supporting hyperplane theorems. Stepping into convex functions, in addition to offering definitions, I will also prove the first order and second-order conditions for convexity of a function, and then introduce a couple of examples that will be used in a convex optimization problem later. Next, I will provide the official definition of convex optimization problems and prove some characteristics they have, including the existence (through optimality criterion) and the uniqueness of a solution. I will also generate two convex optimization problems, one of which cannot be simply solved and requires additional skills. Afterward, I will introduce duality, for the sake of constructing the interior-point method. In the last section, I will first present the descent method and Newton's method, which serve as the foundation of the interior-point method. Then, I will show how to use the logarithmic barrier function and the central path to build up the interior-point method.

Optimization and Control
PRIMA++: A Probabilistic Framework for User Choice Modelling with Small Data.

Qingming Li,Zhanjiang Chen,H. Vicky Zhao

DOI: https://doi.org/10.1109/tsp.2021.3054986

IF: 4.875

2021-01-01

IEEE Transactions on Signal Processing

Abstract:We face choice problems every day, where we have to choose from options with multiple conflicting attributes, and learning a user's personal preference in choice problems is particularly important. For example, in E-commerce applications, this study may help make personal recommendations and sales prediction, and may offer important guidelines on sellers' pricing and discount strategies. Prior works either do not consider the competition among different options, or cannot handle the convex hull problem where a user selects an option that is regarded as unlikely to be the user's best choice by the models. Those supervised learning methods assume that a huge amount of data is available for training, while in reality, we may only have just a few records. In this work, we propose PRIMA++, a probabilistic framework that jointly considers the inter-attribute tradeoff and the inter-item competition, and a novel method to learn the user's personal preference from just a few past records. It can effectively address the convex hull problem and significantly improves the performance. We also borrow the concept of indifference curve from microeconomics and theoretically analyze a user's decision-making process and the competition among different available options. Real user test results show that our proposed framework can learn the user's preference from just a few records and achieves better performance than state-of-the-art works, especially when the data available for training are limited.
Price Discounts and Personalized Product Assortments under Multinomial Logit Choice Model: A Robust Approach.

Qingwei Jin,Jen-Yen Lin,Sean X. Zhou

DOI: https://doi.org/10.1080/24725854.2020.1798036

2020-01-01

IISE Transactions

Abstract:With increasing availability of consumer data and rapid advancement and application of technologies, online retailers are gaining better knowledge of customers' shopping behavior and preferences. Thus more and more retailers are providing personalized product assortment to better match the needs of customers and generate more sales. In this article, we study a two-stage revenue management model. In the first stage, the retailer decides non-personalized price discounts for each product. In the second stage (upon the arrival of customers), the retailer offers a personalized assortment to each type of customer. Based on this assortment, the customer then makes a purchase decision according to the Multinomial logit choice model. We employ a robust approach for the joint discounts and personalized assortment optimization problem in order to handle data uncertainty from estimating customer preferences and distribution of different customer segments. We analyze the structural properties of the problems and propose efficient computational methods to solve the problems with/without a cardinality constraint on the assortment. In certain cases, our algorithm converges at a superlinear rate. When there is a cardinality constraint on the assortment, we find that the retailer should offer greater discounts as the constraint becomes more restrictive. We also discuss the value of our robust solution and the extension of when the customer discount sensitivity function is also uncertain. Finally, our extensive numerical study shows that the solutions under the robust approach perform very well when compared to the one assuming accurate information, and are robust when there is uncertainty.
Online Learning via Offline Greedy Algorithms: Applications in Market Design and Optimization

Rad Niazadeh,Negin Golrezaei,Joshua Wang,Fransisca Susan,Ashwinkumar Badanidiyuru

DOI: https://doi.org/10.1287/mnsc.2022.4558

IF: 5.4

2022-10-29

Management Science

Abstract:Motivated by online decision making in time-varying combinatorial environments, we study the problem of transforming offline algorithms to their online counterparts. We focus on offline combinatorial problems that are amenable to a constant factor approximation using a greedy algorithm that is robust to local errors. For such problems, we provide a general framework that efficiently transforms offline robust greedy algorithms to online ones using Blackwell approachability. We show that the resulting online algorithms have [Formula: see text] (approximate) regret under the full information setting. We further introduce a bandit extension of Blackwell approachability that we call Bandit Blackwell approachability. We leverage this notion to transform greedy robust offline algorithms into a [Formula: see text] (approximate) regret in the bandit setting. Demonstrating the flexibility of our framework, we apply our offline-to-online transformation to several problems at the intersection of revenue management, market design, and online optimization, including product ranking optimization in online platforms, reserve price optimization in auctions, and submodular maximization. We also extend our reduction to greedy-like first-order methods used in continuous optimization, such as those used for maximizing continuous strong DR monotone submodular functions subject to convex constraints. We show that our transformation, when applied to these applications, leads to new regret bounds or improves the current known bounds. We complement our theoretical studies by conducting numerical simulations for two of our applications, in both of which we observe that the numerical performance of our transformations outperforms the theoretical guarantees in practical instances. This paper was accepted by George Shanthikumar, data science.

management,operations research & management science

Convex Optimization and Online Learning: Their Applications in Discrete Choice Modeling and Pricing

Introduction to Online Convex Optimization

Learning From An Optimization Viewpoint

Lectures on Convex Optimization

Implementing Convex Optimization in R: Two Econometric Examples

Stochastic Calculus for Option Pricing with Convex Duality, Logistic Model, and Numerical Examination

Convex Discrete Optimization

Research on The Theoretical Basis and Evolution of Discrete Choice Models

Modeling Discrete Choice: Categorical Dependent Variables, Logistic Regression, and Maximum Likelihood Estimation

Discrete Convex Analysis: A Tool for Economics and Game Theory

Learning Convex Optimization Models

Discrete Choice Analysis: Theory and Application to Travel Demand

Online Convex Optimization in Changing Environments and its Application to Resource Allocation

Online Mixed Discrete and Continuous Optimization: Algorithms, Regret Analysis and Applications

Non-Convex Optimizations for Machine Learning with Theoretical Guarantee: Robust Matrix Completion and Neural Network Learning

A survey of assortment optimization problems under logit-based discrete choice models

Online Personalized Assortment Optimization with High-Dimensional Customer Contextual Data

Senior Thesis for Haverford College Convex Optimization, Newton's Method and Interior Point Method

PRIMA++: A Probabilistic Framework for User Choice Modelling with Small Data.

Price Discounts and Personalized Product Assortments under Multinomial Logit Choice Model: A Robust Approach.

Online Learning via Offline Greedy Algorithms: Applications in Market Design and Optimization