Abstract:The random utility maximization model is by far the most adopted framework to estimate consumer choice behavior. However, behavioral economics has provided strong empirical evidence of irrational choice behaviors, such as halo effects, that are incompatible with this framework. Models belonging to the random utility maximization family may therefore not accurately capture such irrational behavior. Hence, more general choice models, overcoming such limitations, have been proposed. However, the flexibility of such models comes at the price of increased risk of overfitting. As such, estimating such models remains a challenge. In this work, we propose an estimation method for the recently proposed generalized stochastic preference choice model, which subsumes the family of random utility maximization models and is capable of capturing halo effects. In particular, we propose a column-generation method to gradually refine the discrete choice model based on partially ranked preference sequences. Extensive computational experiments indicate that our model, explicitly accounting for irrational preferences, can significantly boost the predictive accuracy on both synthetic and real-world data instances. Summary of Contribution: In this work, we propose an estimation method for the recently proposed generalized stochastic preference choice model, which subsumes the family of random utility maximization models and is capable of capturing halo effects. Specifically, we show how to use partially ranked preferences to efficiently model rational and irrational customer types from transaction data. Our estimation procedure is based on column generation, where relevant customer types are efficiently extracted by expanding a treelike data structure containing the customer behaviors. Furthermore, we propose a new dominance rule among customer types whose effect is to prioritize low orders of interactions among products. An extensive set of experiments assesses the predictive accuracy of the proposed approach by comparing it against rank-based methods with only rational preferences and with more general benchmarks from the literature. Our results show that accounting for irrational preferences can boost predictive accuracy by 12.5% on average when tested on a real-world data set from a large chain of grocery and drug stores.

Random Forest estimation of the ordered choice model

The Use of Binary Choice Forests to Model and Estimate Discrete Choices

Random Planted Forest: a directly interpretable tree ensemble

Decision Forest: A Nonparametric Approach to Modeling Irrational Choice

Stock Price Prediction Based on Optimized Random Forest Model.

ROSE Random Forests for Robust Semiparametric Efficient Estimation

The random forest algorithm for statistical learning

Consistent Estimation of Residual Variance with Random Forest Out-Of-Bag Errors

Estimation of Discrete Choice Models: A Machine Learning Approach

Oblique Random Forest Ensemble Via Least Square Estimation for Time Series Forecasting.

Random Forests with Economic Roots: Explaining Machine Learning in Hedonic Imputation

On the Estimation of Discrete Choice Models to Capture Irrational Customer Behaviors

Automatic Doubly Robust Forests

Extremal Random Forests

Confidence and Uncertainty Assessment for Distributional Random Forests

Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem

Very fast, approximate counterfactual explanations for decision forests

Riemann-Lebesgue Forest for Regression

Random Forests for time-fixed and time-dependent predictors: The DynForest R package

A comparison of random forest variable selection methods for classification prediction modeling

Estimation and Inference of Heterogeneous Treatment Effects using Random Forests