Abstract:We propose a preference-learning algorithm for uncovering Decision Makers’ (DMs’) contingent evaluation strategies in the context of multiple criteria sorting. We assume the preference information in the form of holistic assignment examples derived from the analysis of alternatives’ performance vectors and textual descriptions. We characterize the decision policies using a mixture of threshold-based, value-driven preference models and associated latent topics. The latter serve as the stimuli underlying the contingency in decision behavior. Such a probabilistic model is constructed by using a flexible and nonparametric Bayesian framework. The proposed method adopts a hierarchical Dirichlet process as the prior so that a group of DMs can share a countably infinite number of contingent models and topics. For all DMs, it automatically identifies the components representing their evaluation strategies adequately. The posterior is summarized by using the Hamiltonian Monte Carlo sampling method. We demonstrate the method’s practical usefulness in a real-world recruitment problem considered by a Chinese IT company. We also compare the approach with counterparts that use a single preference model, implement the parametric framework, or consider each DM’s preferences individually. The results indicate that our approach performs favorably in both interpreting DMs’ contingent decision behavior and recommending decisions on new alternatives. Furthermore, the approach’s performance and robustness are investigated through a computational experiment involving real-world data sets. History: Accepted by Ram Ramesh, Area Editor for Data Science and Machine Learning. Funding: J. Liu received financial support from the National Natural Science Foundation of China [Grants 72071155 and 71701160]. M. Kadziński received financial support from the Polish National Science Center under the SONATA BIS project [Grant DEC-2019/34/E/HS4/00045]. X. Liao received financial support from the National Natural Science Foundation of China [Grant 71872144]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2023.1292 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2021.0328 ) at ( http://dx.doi.org/10.5281/zenodo.7608750 ).

Experimental Study of Discrete Degree of Sampled Alternatives to Dynamic Decision

The biased information sampling in group decision making

Dynamic Sampling Allocation for Selecting a Good Enough Alternative.

Dynamic Sampling Allocation and Design Selection.

Sequential Processing of Observations in Human Decision-Making Systems

A new look at the “Asian disease” problem: A choice between the best possible outcomes or between the worst possible outcomes?

A New Framework of Designing Sequential Ranking-and-selection Procedures.

Consciously stochastic in preference reversals

Subjective optimality in finite sequential decision-making

Modeling Contingent Decision Behavior: A Bayesian Nonparametric Preference-Learning Approach

How the Risky Features of Previous Selection Affect Subsequent Decision-Making: Evidence from Behavioral and Fmri Measures

A simple model of decision-making in the application process

An experimental study on strategic preference formation in two-sided matching markets

Accounting for attention in sequential sampling models of decision making

Prostate specific antigen - useful screening tool or potential liability?

Comparing Stochastic Optimization Methods for Variable Selection in Binary Outcome Prediction, With Application to Health Policy

Dynamic Decisions Under Subjective Expectations: A Structural Analysis

Efficient Sampling Policy for Selecting a Subset with the Best

Mood and judgments based on sequential sampling

Efficient Sampling Policy for Selecting a Good Enough Subset

An Indifference-Zone Selection Procedure with Minimum Switching and Sequential Sampling