Abstract:Multinomial logistic regression is a classical technique for modeling how individuals choose an item from a finite set of alternatives. This methodology is a workhorse in both discrete choice theory and machine learning. However, it is unclear how to generalize multinomial logistic regression to subset selection, allowing the choice of more than one item at a time. We present a new model for subset selection derived from the perspective of random utility maximization in discrete choice theory. In our model, the quality of a subset is determined by the quality of its elements, plus an optional correction. Given a budget on the number of subsets that may receive correction, we develop a framework for learning the quality scores for each item, the choice of subsets, and the correction for each subset. We show that, given the subsets to receive correction, we can efficiently and optimally learn the remaining model parameters jointly. We show further that learning the optimal subsets is both NP-hard and non-submodular, but there are efficient heuristics that perform well in practice. We combine these pieces to provide an overall learning solution and apply it to subset prediction tasks. We find that with reasonably-sized budgets, there are significant gains in average per-choice likelihood ranging from 7% to 8x depending on the dataset and also substantial improvements over a determinantal point process model.

Semiparametric maximum likelihood estimation of polychotomous and sequential choice models

Maximum Score Estimation of Preference Parameters for a Binary Choice Model under Uncertainty

Semiparametric Estimation of Dynamic Discrete Choice Models

Simulated Maximum Likelihood Estimation of Dynamic Discrete Choice Statistical Models Some Monte Carlo Results

Mode choice behavior analysis by using a semi-compensatory discrete choice model

Asymptotic Bias in Simulated Maximum Likelihood Estimation of Discrete Choice Models

Semiparametric Estimation of Simultaneous-Equation Microeconometric Models with Index Restrictions

Semiparametric Estimation Of Dynamic Binary Choice Panel Data Models

Estimation of Multinomial Probit-Kernel Integrated Choice and Latent Variable Model: Comparison on One Sequential and Two Simultaneous Approaches

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Estimation of Dynamic Discrete Choice Models by Maximum Likelihood and the Simulated Method of Moments

Endogeneity in Semiparametric Panel Binary Choice Model

Estimation of Discrete Choice Models: A Machine Learning Approach

Maximum likelihood estimation for semiparametric regression models with interval-censored multistate data

Maximum Likelihood Estimation for Semiparametric Regression Models with Interval-Censored Multi-State Data

Semiparametric least squares estimation of binary choice panel data models with endogeneity

Semiparametric instrumental variable estimation of simultaneous equation sample selection models

Revisiting Panel Data Discrete Choice Models with Lagged Dependent Variables

Maximum Marginal Likelihood Estimation of a Monotonic Polynomial Generalized Partial Credit Model with Applications to Multiple Group Analysis

High Dimensional Binary Choice Model with Unknown Heteroskedasticity or Instrumental Variables

A Discrete Choice Model for Subset Selection