Abstract:In this paper, a likelihood based evidence acquisition approach is proposed to acquire evidence from experts'assessments as recorded in historical datasets. Then a data-driven evidential reasoning rule based model is introduced to R&D project selection process by combining multiple pieces of evidence with different weights and reliabilities. As a result, the total belief degrees and the overall performance can be generated for ranking and selecting projects. Finally, a case study on the R&D project selection for the National Science Foundation of China is conducted to show the effectiveness of the proposed model. The data-driven evidential reasoning rule based model for project evaluation and selection (1) utilizes experimental data to represent experts' assessments by using belief distributions over the set of final funding outcomes, and through this historic statistics it helps experts and applicants to understand the funding probability to a given assessment grade, (2) implies the mapping relationships between the evaluation grades and the final funding outcomes by using historical data, and (3) provides a way to make fair decisions by taking experts' reliabilities into account. In the data-driven evidential reasoning rule based model, experts play different roles in accordance with their reliabilities which are determined by their previous review track records, and the selection process is made interpretable and fairer. The newly proposed model reduces the time-consuming panel review work for both managers and experts, and significantly improves the efficiency and quality of project selection process. Although the model is demonstrated for project selection in the NSFC, it can be generalized to other funding agencies or industries.

A Group Decision Support Approach to Evaluate Experts for R&D Project Selection

A Hybrid Knowledge and Model Approach for Reviewer Assignment

An intelligent decision support approach for reviewer assignment in R&D project selection

Solving multiple-criteria R&D project selection problems with a data-driven evidential reasoning rule

An Integrated Decision Support Model to Assess Reviewers for Research Project Selection.

Approach to Evaluating Level of Experts for Assessment of Science Research Projects

Research on Decision Support System for R&D Portfolio Selection

Study on Project Experts' Evaluation Based on Analytic Hierarchy Process and Fuzzy Comprehensive Evaluation

Industrial Robot Selection Using Stochastic Multicriteria Acceptability Analysis for Group Decision Making

A Uncertainty-based Expert Comprehensive Evaluation Method in Group Decision-Making

A Group-Evaluation Method Based on AHP and Theory of Triangular Fuzzy Number

An organizational decision support approach to R and D project selection

A group decision making method to manage internal and external experts with an application to anti-lung cancer drug selection

Design and implementation of a group decision support system for university innovation projects evaluation

A Group Decision-Making Approach Based on DST and AHP for New Product Selection under Epistemic Uncertainty

A Relative Projection-Based Multiattribute Group Decision-Making Model With Noncooperative Behavior Management and Application to NEV Supplier Selection

Study on Assessment Level of Experts based on Difference Preference Information

A Large Group Decision Making Method Considering Experts’ Non-cooperative Behavior for Investment Selection of Renewable Energy Projects

A Fuzzy Group Decision Making Method For Supplier Selection

Developing An R&D Projects Portfolio Selection Decision System Based On Fuzzy Logic

A method for member selection of R&D teams using the individual and collaborative information