Abstract:In this paper, an approach is proposed for assessing the performance of experts in the group from two perspectives: (1) individual consistencies and (2) deviations from the group decision. The quality of performance of the experts is based on combining the standard and rough analytic hierarchy process (AHP) with the technique for order of preference by similarity to the ideal solution (TOPSIS). The statistical method CRITIC is used to derive weights for the TOPSIS method before the experts are assessed based on demonstrated consistency and deviations from the group. Common performance indicators, such as consistency ratio, Euclidean distance, compatibility, and Spearman's correlation coefficient, are proposed for re-grouping experts before making the final decisions. A genetic algorithm enables the efficient solving of this complex clustering problem. Implementing the described approach and method can be useful in comparable assessment frameworks. A critical aspect is conducting a thorough pre-assessment of the competence of potential decision makers, often referred to as experts who may not consistently exhibit apparent expertise. The competence of decision makers (which does not have to be associated with compatibility) is evidenced by selected consistency parameters, and in a way, a pre-assessment of their competence follows Plato's 'government of the wise' principle. In the presented study, the compatibility of individuals in the group with the collective position (group decision) is measured by parameters related to their compatibility with the group solution and statistical deviation while ranking decision elements. The proposed multi-model-based approach stands out for its resilience in conducting thorough pre-assessment of the quality (competence) of potential decision makers, often regarded as experts who might not consistently display evident expertise. The wetland study area in Serbia is used as an example application, where seven measures for reducing the risk of drought were evaluated by twelve experts coming from different sectors and with different backgrounds and expertise.

Consensus-based TOPSIS-Sort-B for multi-criteria sorting in the context of group decision-making

An Automatic Method to Reach Consensus in a Local Context for AHP Group Decision Making

A generalized TOPSIS method for group decision making with heterogeneous information in a dynamic environment

Multi-Model Assessing and Visualizing Consistency and Compatibility of Experts in Group Decision-Making

TOPSIS Method Based on Complex Spherical Fuzzy Sets with Bonferroni Mean Operators

A consensus model for group decision making under additive reciprocal matrices with flexibility

Lexicographic optimization-based approaches to learning a representative model for multi-criteria sorting with non-monotonic criteria

An Improved TOPSIS Method for Multi-Criteria Decision Making Based on Hesitant Fuzzy Β Neighborhood

An incremental preference elicitation-based approach to learning potentially non-monotonic preferences in multi-criteria sorting

Consensus reaching with two-stage minimum adjustments in multi-attribute group decision making: A method based on preference-approval structure and prospect theory

Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS

Optimizing consistency and consensus in group decision making based on relative projection between multiplicative reciprocal matrices

A preference group consensus method with three-way decisions and regret theory under multi-scale information systems

Consensus reaching in multi-criteria social network group decision making: A stochastic multicriteria acceptability analysis-based method

Multi-stage multi-criteria group decision making method based on hierarchical criteria interaction and trust rejection threshold under uncertain preference information

Minimum adjustment cost-based multi-stage goal programming models for consistency improving and consensus building with multiplicative reciprocal paired comparison matrices

A Novel Multi-Criteria Group Decision-Making Approach Using Simplified Neutrosophic Information

Consensus Reaching in Multiple Attribute Group Decision Making: A Multi-Stage Optimization Feedback Mechanism with Individual Bounded Confidences

Multi-criteria group decision-making for portfolio allocation with consensus reaching process under interval type-2 fuzzy environment

Multi-criteria sequential three-state three-way decision consensus model based on set pair analysis theory

Consensus Reaching Process With Multiobjective Optimization for Large-Scale Group Decision Making With Cooperative Game