Ranking and Selection with Two-Stage Decision

Tianxiang Wang,Jie Xu,Juergen Branke,Jian-Qiang Hu,Chun-Hung Chen

DOI: https://doi.org/10.2139/ssrn.4786970

IF: 6.4

2024-01-01

European Journal of Operational Research

Abstract:Download This Paper Open PDF in Browser Add Paper to My Library Share: Permalink Using these links will ensure access to this page indefinitely Copy URL Copy DOI

What problem does this paper attempt to address?

Ranking and Selection with Two-Stage Decision

Tianxiang Wang,Jie Xu,Juergen Branke,Jian-Qiang Hu,Chun-Hung Chen

DOI: https://doi.org/10.1016/j.ejor.2024.11.005

IF: 6.4

2024-01-01

European Journal of Operational Research

Abstract:Ranking & selection (R&S) is concerned with the selection of the best decision from a finite set of alternative decisions when the outcome of the decision has to be estimated using stochastic simulation. In this paper, we extend the R&S problem to a two-stage setting where after a first-stage decision has been made, some information may be observed and a second-stage decision then needs to be made based on the observed information to achieve the best outcome. We then extend two popular single-stage R&S algorithms, expected value of information (EVI) and optimal computing budget allocation (OCBA), to efficiently solve the new two-stage R&S problem. We prove the consistency of the new two-stage EVI (2S-EVI) and OCBA (2S-OCBA) algorithms. Experiment results on benchmark test problems and a two-stage multi-product assortment problem show that both algorithms outperform applying single-stage EVI and OCBA in the two-stage setting. Between 2S-EVI and 2S-OCBA, numerical results suggest that 2S-EVI tends to perform better with smaller number of decisions at first and second stage while 2S-OCBA has better performance for larger problems.
A New Framework of Designing Sequential Ranking-and-selection Procedures.

Ying Zhong,L. Jeff Hong

DOI: https://doi.org/10.1109/wsc.2017.8247955

2017-01-01

Abstract:Many classical sequential procedures model the partial sum difference process between two competing alternatives as a Brownian motion process. In this paper, the marginal probability of eliminating the best alternative is considered while modeling the partial sum difference process. We adaptively allocate the total amount of the probability of incorrect selection α to every time point where the comparisons between alternatives are conducted and set the continuation regions to ensure the marginal probability of eliminating the best alternative does not exceed the probability assigned to each time point t. We show by examples that under our framework, the procedure can be easily developed for both indifference-zone (IZ) and IZ free formulations.
Review on ranking and selection: A new perspective

L. Jeff Hong,Weiwei Fan,Jun Luo

DOI: https://doi.org/10.1007/s42524-021-0152-6

2021-03-29

Frontiers of Engineering Management

Abstract:Abstract In this paper, we briefly review the development of ranking and selection (R&S) in the past 70 years, especially the theoretical achievements and practical applications in the past 20 years. Different from the frequentist and Bayesian classifications adopted by Kim and Nelson (2006b) and Chick (2006) in their review articles, we categorize existing R&S procedures into fixed-precision and fixed-budget procedures, as in Hunter and Nelson (2017). We show that these two categories of procedures essentially differ in the underlying methodological formulations, i.e., they are built on hypothesis testing and dynamic programming, respectively. In light of this variation, we review in detail some well-known procedures in the literature and show how they fit into these two formulations. In addition, we discuss the use of R&S procedures in solving various practical problems and propose what we think are the important research questions in the field.

engineering, industrial
AlphaRank: An Artificial Intelligence Approach for Ranking and Selection Problems

Ruihan Zhou,L. Jeff Hong,Yijie Peng

2024-02-01

Abstract:We introduce AlphaRank, an artificial intelligence approach to address the fixed-budget ranking and selection (R&S) problems. We formulate the sequential sampling decision as a Markov decision process and propose a Monte Carlo simulation-based rollout policy that utilizes classic R&S procedures as base policies for efficiently learning the value function of stochastic dynamic programming. We accelerate online sample-allocation by using deep reinforcement learning to pre-train a neural network model offline based on a given prior. We also propose a parallelizable computing framework for large-scale problems, effectively combining "divide and conquer" and "recursion" for enhanced scalability and efficiency. Numerical experiments demonstrate that the performance of AlphaRank is significantly improved over the base policies, which could be attributed to AlphaRank's superior capability on the trade-off among mean, variance, and induced correlation overlooked by many existing policies.

Machine Learning,Methodology
Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Yuhao Wang,Enlu Zhou

2024-07-10

Abstract:In a fixed budget ranking and Selection (R&S) problem, one aims to identify the best design among a finite number of candidates by efficiently allocating the given computing budget to evaluate design performance. Classical methods for R&S usually assume the distribution of the randomness in the system is exactly known. In this paper, we consider the practical scenario where the true distribution is unknown but can be estimated from streaming input data that arrive in batches over time. We formulate the R&S problem in this dynamic setting as a multi-stage problem, where we adopt the Bayesian approach to estimate the distribution and formulate a stage-wise optimization problem to allocate the computing budget. We characterize the optimality conditions for the stage-wise problem by applying the large deviations theory to maximize the decay rate of probability of false selection. Based on the optimality conditions and combined with the updating of distribution estimates, we design two sequential budget allocation procedures for R&S under streaming input data. We theoretically guarantee the consistency and asymptotic optimality of the proposed procedures. We demonstrate the practical efficiency through numerical experiments in comparison with the equal allocation policy and an extension of the Optimal Computing Budget Allocation algorithm.

Optimization and Control
Two-rank multi-attribute group decision-making with linguistic distribution assessments: An optimization-based integrated approach

Shitao Zhang,Lei Hu,Zhenzhen Ma,Xiaodi Liu

DOI: https://doi.org/10.1016/j.engappai.2023.106170

IF: 8

2023-05-01

Engineering Applications of Artificial Intelligence

Abstract:In real life, two-rank multi-attribute decision-making (MADM), in which all alternatives are divided into two preference-ordered categories, is common. In this paper, we investigate two-rank multi-attribute group decision-making (MAGDM) with linguistic distribution assessments (LDAs). A challenge when tackling such two-rank problems is establishing an LDAs-based two-rank model that maintains a balance between classification accuracy and computational complexity. When neither the threshold nor the number of alternatives within each category is specified in advance, determining individual two-rank results and subsequently aggregating the two-rank results for each decision-maker to resolve conflicts within the group is another challenge. Given these, we aim to propose a novel approach for two-rank MAGDM with LDAs. The main innovations and contributions of this paper are as follows. (a) From the perspective of linguistic scale function (LSF)-based cumulative expectations, we present a new LDAs-based distance measure that exhibits several desirable properties. A new score function for comparing LDAs is subsequently proposed using the new distance and the idea of the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS). (b) Using the minimum intensity of reversed rankings combined with the misclassification ratio of alternatives as an integrated objective function, we construct two 0-1 integer programming models incorporating constraints associated with the centers and priorities of categories to determine the optimal individual and group two-rank results of alternatives, respectively. (c) We apply our method to two-rank MAGDM associated with short video placement platforms. Comparing the proposed approach with other two-rank MAGDM approaches further demonstrates its effectiveness and rationality.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
Ranking and Selection as Stochastic Control

Yijie Peng,Edwin K. P. Chong,Chun-Hung Chen,Michael C. Fu

DOI: https://doi.org/10.1109/tac.2018.2797188

IF: 6.549

2018-08-01

IEEE Transactions on Automatic Control

Abstract:Under a Bayesian framework, we formulate the fully sequential sampling and selection decision in statistical ranking and selection as a stochastic control problem, and derive the associated Bellman equation. Using a value function approximation, we derive an approximately optimal allocation policy. We show that this policy is not only computationally efficient but also possesses both one-step-ahead and asymptotic optimality for independent normal sampling distributions. Moreover, the proposed allocation policy is easily generalizable in the approximate dynamic programming paradigm.

automation & control systems,engineering, electrical & electronic
Ranking and Selection with Covariates for Personalized Decision Making

Haihui Shen,L. Jeff Hong,Xiaowei Zhang

DOI: https://doi.org/10.1287/ijoc.2020.1009

IF: 3.288

2021-02-12

INFORMS Journal on Computing

Abstract:We consider a problem of ranking and selection via simulation in the context of personalized decision making, in which the best alternative is not universal, but varies as a function of some observable covariates. The goal of ranking and selection with covariates (R&S-C) is to use simulation samples to obtain a selection policy that specifies the best alternative with a certain statistical guarantee for subsequent individuals upon observing their covariates. A linear model is proposed to capture the relationship between the mean performance of an alternative and the covariates. Under the indifference-zone formulation, we develop two-stage procedures for both homoscedastic and heteroscedastic simulation errors, respectively, and prove their statistical validity in terms of average probability of correct selection. We also generalize the well-known slippage configuration and prove that the generalized slippage configuration is the least favorable configuration for our procedures. Extensive numerical experiments are conducted to investigate the performance of the proposed procedures, the experimental design issue, and the robustness to the linearity assumption. Finally, we demonstrate the usefulness of R&S-C via a case study of selecting the best treatment regimen in the prevention of esophageal cancer. We find that by leveraging disease-related personal information, R&S-C can substantially improve patients’ expected quality-adjusted life years by providing a patient-specific treatment regimen.

computer science, interdisciplinary applications,operations research & management science
Exploring 2-rank strategic weight manipulation in multiple attribute decision making and its applications in project review and university ranking

Yating Liu,Siqi Wu,Congcong Li,Yucheng Dong

DOI: https://doi.org/10.1016/j.engappai.2022.105525

IF: 8

2022-10-30

Engineering Applications of Artificial Intelligence

Abstract:In some real multiple attribute decision making (MADM) problems, sometimes, it is time-consuming and unnecessary to obtain a complete ranking of alternatives, thus, a decision maker would classify the alternatives into two ordered categories, forming a 2-rank MADM problem. Occasionally, a decision maker can manipulate the desired 2-rank results by strategically setting attribute weights. This process is called 2-rank strategic weight manipulation (2RSWM). First, this study defines the 2-rank range of alternatives. Subsequently, several mixed 0–1 linear programming models (MLPMs) are constructed to obtain the 2-rank range and the strategic attribute weight vector of the desired 2-rank result of the alternative(s) of the decision maker. Furthermore, we provide conditions for the existence of the strategic attribute weight vector based on the 2-rank range of the alternatives and the proposed MLPMs. Finally, two illustrative examples and two simulation experiments are conducted to validate the effectiveness of our proposed models. Due to the ordered weighted averaging (OWA) operator having smaller average width of the 2-rank range, and a larger minimum distance between the impersonal and strategic attribute weight vectors, we argue that the OWA operator has a better performance than the weighted averaging (WA) operator in defending against 2RSWM.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
A Novel Decision-Making Method for Selecting Superintendent Based on a q-Rung Dual Hesitant Fuzzy Power Partitioned Bonferroni Mean Operator

Tiedong Chen,Long Ye

DOI: https://doi.org/10.3390/sym14030590

2022-03-16

Symmetry

Abstract:The q-rung dual hesitant fuzzy (q-RDHF) set is famous for expressing information composed of asymmetry evaluations, because it allows for several possible evaluations in both the membership degree and non-membership degree. Compared with some existing extended fuzzy theories, the q-RDHF set is more superior and flexible because it can handle asymmetric assessments. In order to assemble the evaluation information expressed by q-RDHF elements, this paper aims to propose new operators to integrate q-RDHF elements. The partitioned Bonferroni mean (PBM) operator is well-known for its advantages in coping with the inhomogeneous relationship between asymmetry input arguments. In this paper, we combine the PBM operator with the power average operator, and propose a family of q-RDHF power PBM operators. Some theorems and special cases for the new proposed operators are discussed. Furthermore, we provide a general framework for dealing with multiple attribute decision-making (MADM) problems using the novel proposed method. To better show the calculation details, a numerical case study of the application of the proposed method in a superintendent selection problem is introduced. In addition, we utilize the proposed method to compare it with some existing methods in order to show its flexibility and superiority. The results show that our method is much more advantageous when considering flexible actual situations. Finally, the conclusion is given. The main contributions of this study are to propose an appropriate method to solve unbalanced and asymmetry information in a q-RDHF environment, and to apply it into a realistic superintendent selection problem.
Choosing to Rank

Stephen Ragain,Johan Ugander

DOI: https://doi.org/10.48550/arXiv.1809.05139

2019-01-28

Abstract:Ranking data arises in a wide variety of application areas but remains difficult to model, learn from, and predict. Datasets often exhibit multimodality, intransitivity, or incomplete rankings---particularly when generated by humans---yet popular probabilistic models are often too rigid to capture such complexities. In this work we leverage recent progress on similar challenges in discrete choice modeling to form flexible and tractable choice-based models for ranking data. We study choice representations, maps from rankings (complete or top-$k$) to collections of choices, as a way of forming ranking models from choice models. We focus on the repeated selection (RS) choice representation, first used to form the Plackett-Luce ranking model from the conditional multinomial logit choice model. We fully characterize, for a prime number of alternatives, the choice representations that admit ranking distributions with unit normalization, a desirably property that greatly simplifies maximum likelihood estimation. We further show that only specific minor variations on repeated selection exhibit this property. Our choice-based ranking models provide higher out-of-sample likelihood when compared to Plackett-Luce and Mallows models on a broad collection of ranking tasks including food preferences, ranked-choice elections, car racing, and search engine relevance tasks.

Machine Learning
Data-driven Ranking and Selection under Input Uncertainty

Di Wu,Yuhao Wang,Enlu Zhou

DOI: https://doi.org/10.48550/arXiv.1708.08526

2022-09-02

Abstract:We consider a simulation-based Ranking and Selection (R&S) problem with input uncertainty, where unknown input distributions can be estimated using input data arriving in batches of varying sizes over time. Each time a batch arrives, additional simulations can be run using updated input distribution estimates. The goal is to confidently identify the best design after collecting as few batches as possible. We first introduce a moving average estimator for aggregating simulation outputs generated under heterogenous input distributions. Then, based on a Sequential Elimination framework, we devise two major R&S procedures by establishing exact and asymptotic confidence bands for the estimator. In deriving the latter confidence bands, we incorporate the result of "Multiple Comparison with Best" and establish an asymptotic normality result which explicitly characterizes the tradeoff between input uncertainty and stochastic uncertainty in an online environment. We also extend our procedures to the indifference zone setting, which helps save simulation effort for practical usage. Numerical results show the effectiveness and necessity of our procedures. Moreover, the efficiency can be further boosted through optimizing the "drop rate" parameter of the estimator.

Optimization and Control
Invidious Comparisons: Ranking and Selection as Compound Decisions

Jiaying Gu,Roger Koenker

DOI: https://doi.org/10.3982/ECTA19304

IF: 6.1

2023-02-02

Econometrica

Abstract:There is an innate human tendency, one might call it the "league table mentality," to construct rankings. Schools, hospitals, sports teams, movies, and myriad other objects are ranked even though their inherent multi‐dimensionality would suggest that—at best—only partial orderings were possible. We consider a large class of elementary ranking problems in which we observe noisy, scalar measurements of merit for n objects of potentially heterogeneous precision and are asked to select a group of the objects that are "most meritorious." The problem is naturally formulated in the compound decision framework of Robbins's (1956) empirical Bayes theory, but it also exhibits close connections to the recent literature on multiple testing. The nonparametric maximum likelihood estimator for mixture models (Kiefer and Wolfowitz (1956)) is employed to construct optimal ranking and selection rules. Performance of the rules is evaluated in simulations and an application to ranking U.S. kidney dialysis centers.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
POMDP-Based Ranking and Selection.

Ruihan Zhou,Yijie Peng

DOI: https://doi.org/10.1109/WSC60868.2023.10407663

2023-01-01

Abstract:In this paper, we formulate the ranking and selection (R&S) problem as a stochastic control problem under the Bayesian framework. We propose to use particle filter to approximate the posterior distribution of states under the general Bayesian framework. The learning and decision are treated under the umbrella of a partially observable Markov decision process and a rollout policy based on Monte Carlo simulation is proposed. This policy can use one or more classic R&S approaches as base policies to efficiently learn the value function by rolling out simulation trajectories. We present numerical examples to demonstrate the effectiveness of the rollout policy and the performance of our policy is significantly improved relatively to the base policies.
A multi-stage group decision making for strategic supplier selection based on prospect theory with interval-valued q-rung orthopair fuzzy linguistic sets

Shunsheng Guo,Yuji Gao,Jun Guo,Zhijie Yang,Baigang Du,Yibing Li

DOI: https://doi.org/10.3233/jifs-202415

2021-04-22

Abstract:With the aggravation of market competition, strategic supplier is becoming more and more critical for the success of manufacturing enterprises. Suppler selection, being the critical and foremost activity must ensure that selected suppliers are capable of supporting the long-term development of organizations. Hence, strategic supplier selection must be restructures considering the long-term relationships and prospects for sustainable cooperation. This paper proposes a novel multi-stage multi-attribute group decision making method under an interval-valued q-rung orthopair fuzzy linguistic set (IVq-ROFLS) environment considering the decision makers’ (DMs) psychological state in the group decision-making process. First, the initial comprehensive fuzzy evaluations of DMs are represented as IVq-ROFLS. Subsequently, two new operators are proposed for aggregating different stages and DMs’ preferences respectively by extending generalized weighted averaging (GWA) to IVq-ROFLS context. Later, a new hamming distance based linear programming method based on entropy measure and score function is introduced to evaluate the unknown criteria weights. Additionally, the Euclidean distance is employed to compute the gain and loss matrix, and objects are prioritized by extending the popular Prospect theory (PT) method to the IVq-ROFLS context. Finally, the practical use of the proposed decision framework is validated by using a strategic supplier selection problem, as well as the effectiveness and applicability of the framework are discussed by using comparative analysis with other methods.

English Else
A rank-based selection with cardinal payoffs and a cost of choice

Krzysztof Szajowski

DOI: https://doi.org/10.32219/isms.69.2_285

2008-12-18

Abstract:A version of the secretary problem is considered. The ranks of items, whose values are independent, identically distributed random variables $X_1,X_2,...,X_n$ from a uniform distribution on $[0; 1]$, are observed sequentially by the grader. He has to select exactly one item, when it appears, and receives a payoff which is a function of the unobserved realization of random variable assigned to the item diminished by some cost. The methods of analysis are based on the existence of an embedded Markov chain and use the technique of backward induction. The result is a generalization of the selection model considered by Bearden(2006). The asymptotic behaviour of the solution is also investigated.

Optimization and Control,Probability
Solving Large-Scale Fixed-Budget Ranking and Selection Problems

L. Jeff Hong,Guangxin Jiang,Ying Zhong

DOI: https://doi.org/10.1287/ijoc.2022.1221

IF: 3.288

2022-01-01

INFORMS Journal on Computing

Abstract:In recent years, with the rapid development of computing technology, developing parallel procedures to solve large-scale ranking and selection (R&S) problems has attracted a lot of research attention. In this paper, we take fixed-budget R&S procedure as an example to investigate potential issues of developing parallel procedures. We argue that to measure the performance of a fixed-budget R&S procedure in solving large-scale problems, it is important to quantify the minimal growth rate of the total sampling budget such that as the number of alternatives increases, the probability of correct selection (PCS) would not decrease to zero. We call such a growth rate of the total sampling budget the rate for maintaining correct selection (RMCS). We show that a tight lower bound for the RMCS of a broad class of existing fixed-budget procedures is in the order of [Formula: see text], where k is the number of alternatives. Then, we propose a new type of fixed-budget procedure, namely the fixed-budget knockout-tournament ([Formula: see text]) procedure. We prove that, in terms of the RMCS, our procedure outperforms existing fixed-budget procedures and achieves the optimal order, that is, the order of k. Moreover, we demonstrate that our procedure can be easily implemented in parallel computing environments with almost no nonparallelizable calculations. Last, a comprehensive numerical study shows that our procedure is indeed suitable for solving large-scale problems in parallel computing environments. History: Accepted by Bruno Tuffin, Area Editor for Simulation. Funding: Y. Zhong was supported by the National Natural Science Foundation of China [Grant 72101047]. L. J. Hong was supported by the National Natural Science Foundation of China [Grants 72091211 and 72161160340]. G. Jiang was supported by the National Natural Science Foundation of China [Grants 72121001 and 72171060]. Supplemental Material: The online appendix is available at https://doi.org/10.1287/ijoc.2022.1221 .
On Recoverable and Two-Stage Robust Selection Problems with Budgeted Uncertainty

André Chassein,Marc Goerigk,Adam Kasperski,Paweł Zieliński

DOI: https://doi.org/10.48550/arXiv.1701.06064

2017-02-16

Abstract:In this paper the problem of selecting $p$ out of $n$ available items is discussed, such that their total cost is minimized. We assume that costs are not known exactly, but stem from a set of possible outcomes. Robust recoverable and two-stage models of this selection problem are analyzed. In the two-stage problem, up to $p$ items is chosen in the first stage, and the solution is completed once the scenario becomes revealed in the second stage. In the recoverable problem, a set of $p$ items is selected in the first stage, and can be modified by exchanging up to $k$ items in the second stage, after a scenario reveals. We assume that uncertain costs are modeled through bounded uncertainty sets, i.e., the interval uncertainty sets with an additional linear (budget) constraint, in their discrete and continuous variants. Polynomial algorithms for recoverable and two-stage selection problems with continuous bounded uncertainty, and compact mixed integer formulations in the case of discrete bounded uncertainty are constructed.

Optimization and Control,Computational Complexity,Data Structures and Algorithms
Fully Sequential Ranking and Selection Procedures with PAC Guarantee.

Ying Zhong,L. Jeff Hong

DOI: https://doi.org/10.1109/WSC.2018.8632439

2018-01-01

Abstract:In the ranking-and-selection field, many current existing fully sequential procedures are developed under the indifference-zone (IZ) formulation which assumes an optimality gap between the best alternative and the others. In this paper, by modifying one classical fully sequential procedure, Paulson's procedure, we devise a new type of fully sequential procedure which can provide the probably approximately correct (PAC) selection guarantee. The procedure is able to select an alternative within a certain distance from the best one with the desired probability even when the IZ assumption is violated. In order to provide this selection guarantee, we lose some efficiency on the procedure. However, we show, both theoretically and numerically, that this efficiency loss is limited and acceptable when the number of alternatives is large.
IntTower: the Next Generation of Two-Tower Model for Pre-Ranking System

Xiangyang Li,Bo Chen,HuiFeng Guo,Jingjie Li,Chenxu Zhu,Xiang Long,Sujian Li,Yichao Wang,Wei Guo,Longxia Mao,Jinxing Liu,Zhenhua Dong,Ruiming Tang

DOI: https://doi.org/10.48550/arXiv.2210.09890

2022-10-18

Abstract:Scoring a large number of candidates precisely in several milliseconds is vital for industrial pre-ranking systems. Existing pre-ranking systems primarily adopt the \textbf{two-tower} model since the ``user-item decoupling architecture'' paradigm is able to balance the \textit{efficiency} and \textit{effectiveness}. However, the cost of high efficiency is the neglect of the potential information interaction between user and item towers, hindering the prediction accuracy critically. In this paper, we show it is possible to design a two-tower model that emphasizes both information interactions and inference efficiency. The proposed model, IntTower (short for \textit{Interaction enhanced Two-Tower}), consists of Light-SE, FE-Block and CIR modules. Specifically, lightweight Light-SE module is used to identify the importance of different features and obtain refined feature representations in each tower. FE-Block module performs fine-grained and early feature interactions to capture the interactive signals between user and item towers explicitly and CIR module leverages a contrastive interaction regularization to further enhance the interactions implicitly. Experimental results on three public datasets show that IntTower outperforms the SOTA pre-ranking models significantly and even achieves comparable performance in comparison with the ranking models. Moreover, we further verify the effectiveness of IntTower on a large-scale advertisement pre-ranking system. The code of IntTower is publicly available\footnote{<a class="link-external link-https" href="https://github.com/archersama/IntTower" rel="external noopener nofollow">this https URL</a>}

Information Retrieval

Ranking and Selection with Two-Stage Decision

Ranking and Selection with Two-Stage Decision

A New Framework of Designing Sequential Ranking-and-selection Procedures.

Review on ranking and selection: A new perspective

AlphaRank: An Artificial Intelligence Approach for Ranking and Selection Problems

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Two-rank multi-attribute group decision-making with linguistic distribution assessments: An optimization-based integrated approach

Ranking and Selection as Stochastic Control

Ranking and Selection with Covariates for Personalized Decision Making

Exploring 2-rank strategic weight manipulation in multiple attribute decision making and its applications in project review and university ranking

A Novel Decision-Making Method for Selecting Superintendent Based on a q-Rung Dual Hesitant Fuzzy Power Partitioned Bonferroni Mean Operator

Choosing to Rank

Data-driven Ranking and Selection under Input Uncertainty

Invidious Comparisons: Ranking and Selection as Compound Decisions

POMDP-Based Ranking and Selection.

A multi-stage group decision making for strategic supplier selection based on prospect theory with interval-valued q-rung orthopair fuzzy linguistic sets

A rank-based selection with cardinal payoffs and a cost of choice

Solving Large-Scale Fixed-Budget Ranking and Selection Problems

On Recoverable and Two-Stage Robust Selection Problems with Budgeted Uncertainty

Fully Sequential Ranking and Selection Procedures with PAC Guarantee.

IntTower: the Next Generation of Two-Tower Model for Pre-Ranking System