R\&D evaluation methodology based on group-AHP with uncertainty
Alberto Garinei,Emanuele Piccioni,Massimiliano Proietti,Andrea Marini,Stefano Speziali,Marcello Marconi,Raffaella Di Sante,Sara Casaccia,Paolo Castellini,Milena Martarelli,Nicola Paone,Gian Marco Revel,Lorenzo Scalise,Marco Arnesano,Paolo Chiariotti,Roberto Montanini,Antonino Quattrocchi,Sergio Silvestri,Giorgio Ficco,Emanuele Rizzuto,Andrea Scorza,Matteo Lancini,Gianluca Rossi,Roberto Marsili,Emanuele Zappa,Salvatore Sciuto,Gaetano Vacca,Laura Fabbiano
DOI: https://doi.org/10.48550/arXiv.2108.02595
2021-11-23
Abstract:In this paper, we present an approach to evaluate Research \& Development (R\&D) performance based on the Analytic Hierarchy Process (AHP) method. Through a set of questionnaires submitted to a team of experts, we single out a set of indicators needed for R\&D performance evaluation. The indicators, together with the corresponding criteria, form the basic hierarchical structure of the AHP method. The numerical values associated with all the indicators are then used to assign a score to a given R\&D project. In order to aggregate consistently the values taken on by the different indicators, we operate on them so that they are mapped to dimensionless quantities lying in a unit interval. This is achieved by employing the empirical Cumulative Density Function (CDF) for each of the indicators. We give a thorough discussion on how to assign a score to an R\&D project along with the corresponding uncertainty due to possible inconsistencies of the decision process. A particular example of R\&D performance is finally considered.
Computers and Society,Data Analysis, Statistics and Probability,Applications