Abstract:Along with the developments of numerous MaOO algorithms in the last decades, comparing the performance of MaOO algorithms with one another is also highly needed. Many studies have attempted to manipulate such comparison to analyze the performance quality of MaOO. In such cases, the weight of importance is critical for evaluating the performance of MaOO algorithms. All evaluation studies for MaOO algorithms have ignored to assign such weight for the target criteria during evaluation process, which plays a key role in the final decision results. Therefore, the weight value of each criterion must be determined to guarantee the accuracy of results in the evaluation process. Multicriteria decision-making (MCDM) methods are extremely preferred in solving weighting issues in the evaluation process of MaOO algorithms. Several studies in MCDM have proposed competitive weighting methods. However, these methods suffer from inconsistency issues arising from the high subjectivity of pairwise comparison. The inconsistency rate increases in an exorbitant manner when the number of criteria increases, and the final results are affected. The primary objective of this study is to propose a new method, called a Novel Fuzzy-Weighted Zero-Inconsistency (FWZIC) Method which can determine the weight coefficients of criteria with zero consistency. This method depends on differences in the preference of experts per criterion to compute its significance level in the decision-making process. The proposed FWZIC method comprises five phases for determining the weights of the evaluation criteria: (1) the set of evaluation criteria is explored and defined, (2) the structured expert judgement (SEJ) is used, (3) the expert decision matrix (EDM) is built on the basis of the crossover of criteria and SEJ, (4) a fuzzy membership function is applied to the result of the EDM and (5) the final values of the weight coefficients of the evaluation criteria are computed. The proposed method is applied to the evaluation criteria of MaOO competitive algorithms. The case study consists of more than 50 items distributed amongst the major criteria, subcriteria and indicators. The significant contribution of each item to the algorithm evaluation is determined. Results show that the criteria, subcriteria and their related indicators are weighted without inconsistency. The findings clearly show that the FWZIC method can deal with the inconsistency issue and provide accurate weight values to each criterion.

A Modified CRITIC Method to Estimate the Objective Weights of Decision Criteria

CRITID: enhancing CRITIC with advanced independence testing for robust multi-criteria decision-making

Determining Importance of Many-Objective Optimisation Competitive Algorithms Evaluation Criteria Based on a Novel Fuzzy-Weighted Zero-Inconsistency Method

Specific character of objective methods for determining weights of criteria in MCDM problems: Entropy, CRITIC and SD

Basic statistical methods in determining criteria weights

Opinion Weight Criteria Method (OWCM): A New Method for Weighting Criteria With Zero Inconsistency

Research on cloud-CRITIC-PDR method for hybrid multi-criteria decision making

Supporting multi-criteria decision-making processes with unknown criteria weights

A model for determining weights of criteria using subjective and objective information

A Novel Method for Assessing the Weight Coefficients of Criteria within the Framework of Multi-Criteria Decision-Making: Measurement Relying on the Impacts of an Exponential Curve Function (MIEXCF)

A Cross-Efficiency Evaluation Method Based on Evaluation Criteria Balanced on Interval Weights

Inter-company comparison using modified TOPSIS with objective weights

Research on the Satisfaction Degree and Criteria Weight Obtaining for Multiple Criteria Decision Making Problem

Taxicab distance based best-worst method for multi-criteria decision-making: An analytical approach

Comparison of Objective Weight Determination Methods in Network Performance Evaluation

Sensitivity Assessment of Multi-Criteria Decision-Making Methods in Chemical Engineering Optimization Applications

Simple additive weighting—A metamodel for multiple criteria decision analysis methods

Spatial Interpretation of Multi-Criteria Analysis: A Case Study with a Decreasing Number of Criteria and Subjective Approach to Determining Their Importance

Product design evaluation based on improved CRITIC and Comprehensive Cloud-TOPSIS – Applied to automotive styling design evaluation

A Study of Decision Process in MCDM Problems with Large Number of Criteria

An α-cut intervals based fuzzy best-Worst method for Multi-Criteria Decision-Making