Support A simple method to improve the consistency ratio of the pairwise comparison matrix in ANP

Daji Ergu,Gang Kou,Yi Peng,Yong Shi

2011-01-01

Abstract:Article history: Received 18 January 2011 Accepted 8 March 2011 Available online 13 March 2011

What problem does this paper attempt to address?

A Simple Method to Improve the Consistency Ratio of the Pair-Wise Comparison Matrix in ANP

Daji Ergu,Gang Kou,Yi Peng,Yong Shi

DOI: https://doi.org/10.1016/j.ejor.2011.03.014

IF: 6.4

2011-01-01

European Journal of Operational Research

Abstract:Tests of consistency for the pair-wise comparison matrices have been studied extensively since AHP was introduced by Saaty in 1970s. However, existing methods are either too complicated to be applied in the revising process of the inconsistent comparison matrix or are difficult to preserve most of the original comparison information due to the use of a new pair-wise comparison matrix. Those methods might work for AHP but not for ANP as the comparison matrix of ANP needs to be strictly consistent. To improve the consistency ratio, this paper proposes a simple method, which combines the theorem of matrix multiplication, vectors dot product, and the definition of consistent pair-wise comparison matrix, to identify the inconsistent elements. The correctness of the proposed method is proved mathematically. The experimental studies have also shown that the proposed method is accurate and efficient in decision maker's revising process to satisfy the consistency requirements of AHP/ANP. (C) 2011 Elsevier B.V. All rights reserved.
A New Consistency Index for Comparison Matrices in the ANP

Daji Ergu,Gang Kou,Yi Peng,Yong Shi

DOI: https://doi.org/10.1007/978-3-642-19695-9_4

2011-01-01

Abstract: The inconsistency test is more difficult in the analytical network process (ANP) than in the analytical hierarchy process (AHP) because there are more comparison matrices in the ANP. The consistency ratio (CR) introduced by Saaty for the AHP is used for inconsistency test in the ANP. When the number of comparison matrices increases, the inconsistency test of comparison matrices in the ANP becomes complicated. In an attempt to simplify the inconsistency test, this paper proposes a maximum eigenvalue threshold as the consistency index for ANP, which is mathematically equivalent to the CR method. In addition, a block diagonal matrix is introduced for the comparison matrices in the ANP to conduct inconsistency tests simultaneously for all comparison matrices. An illustrative example is used to show the effectiveness and the simplicity of the proposed maximum eigenvalue threshold method.
Consistency Issues of Interval Pairwise Comparison Matrices

Yucheng Dong,Xia Chen,Cong-Cong Li,Wei-Chiang Hong,Yinfeng Xu

DOI: https://doi.org/10.1007/s00500-014-1426-2

IF: 3.732

2014-01-01

Soft Computing

Abstract:In this paper, we investigate the consistency issues of interval pairwise comparison matrices in detail. Using logarithmic Manhattan distance to define the deviation degree of a pairwise comparison matrix to consistent pairwise comparison matrices, we propose a new consistency index of pairwise comparison matrices. Based on this consistency index of pairwise comparison matrices, we develop a consistency index of interval pairwise comparison matrices. Several desired properties of the proposed consistency indexes are presented. Furthermore, linear programming (LP) models are developed to compute the consistency indexes. Then, we propose a LP-based consistency improving model, which optimally preserves original pairwise comparison information in improving consistency. Meanwhile, considering the uncertainty plays an important role in the consistency index of interval pairwise comparison matrices, this consistency improving model is extended to simultaneously manage the uncertain degree in interval pairwise comparison matrices. Finally, we discuss the consistency-based prioritization method, and propose the strong consistency index of interval pairwise comparison matrices.
Is It Reasonable for Saaty's Consistency Test in the Pairwise Comparison Method?

Wei-Jun Xu,Yu-Cheng Dong,Wei-Lin Xiao

DOI: https://doi.org/10.1109/CCCM.2008.136

2008-01-01

Abstract:In the pairwise comparison method, Saaty's consistency test is performed to ensure that the decision maker is being neither random nor illogical in his or her pairwise comparisons. Saaty suggested that the consistency ratio (CR) should be less than or equal to 0.1. Some researchers argued that the cut-off rule should be a function of the matrix size. In this paper, by simulation analysis, we find that, as the matrix size increases, the percent of the matrices with acceptable consistency (CR les 0.1) decreases dramatically, however, on the other hand, there will be more and more contradictory judgements in these sufficiently consistent matrices. This paradox shows that it is impossible to find some proper critical values of CR for different matrix sizes. Thus we argue that Saaty's consistency test could be unreasonable.
Consistency and Consensus Improving Methods for Pairwise Comparison Matrices Based on Abelian Linearly Ordered Group

Meimei Xia,Jian Chen

DOI: https://doi.org/10.1016/j.fss.2014.07.019

IF: 4.462

2015-01-01

Fuzzy Sets and Systems

Abstract:The aim of a valued pairwise comparison matrix is to derive the priority structure over a set of criteria (or alternatives) in decision making. The consistency and consensus of a pairwise comparison matrix should be measured and improved to avoid a misleading priority structure. The basic entries of a pairwise comparison matrix can be described in different forms; hence, different consistency and consensus methods should be developed for different types of matrices. To provide a general framework, the pairwise comparison matrix based on Abelian linearly ordered group is first introduced. A consistency index is defined by constructing the nearest consistent pairwise comparison matrix from an inconsistent one, and two consistency improving methods are introduced. A group pairwise comparison matrix is derived, a consensus index of individual pairwise comparison matrices is defined and two consensus improving methods are developed by introducing a general aggregation operator based on Abelian linearly ordered group. The proposed consistency and consensus methods are convergent and can provide a general framework for existing methods.
Simulation Experiments for Improving the Consistency Ratio of Reciprocal Matrices

D. Ergu,G. Kou,Y. Peng,X. Yang

DOI: https://doi.org/10.15837/ijccc.2014.4.1165

2014-01-01

Abstract:The consistency issue is one of the hot research topics in the analytic hierarchy process (AHP) and analytic network process (ANP). To identify the most inconsistent elements for improving the consistency ratio of a reciprocal pairwise comparison matrix (P CM), a bias matrix can be induced to efficiently identify the most inconsistent elements, which is only based on the original PCM. The goal of this paper is to conduct simulation experiments by randomly generating millions numbers of reciprocal matrices with different orders in order to validate the effectiveness of the induced bias matrix model. The experimental results show that the consistency ratios of most of the random inconsistent matrices can be improved by the induced bias matrix model, few random inconsistent matrices with high orders failed the consistency adjustment.
A Discrete Region-Based Approach To Improve The Consistency Of Pair-Wise Comparison Matrix

Hengshan Zhang,Qinghua Zheng,Ting Liu,Zijiang Yang,Jiahe Liu

DOI: https://doi.org/10.1109/FUZZ-IEEE.2013.6622447

2013-01-01

Abstract:The consistency of pair-wise comparison matrix is a serious challenge for the multiple-criteria decision-making problem. However, existing methods are either too complicated to be applied in the revising process of the inconsistent comparison matrix or are difficult to preserve most of the original comparison information due to the use of a new pair-wise comparison matrix. In this paper, a discrete region-based approach is proposed to improve the consistency of the pair-wise comparison matrix. When the decision makers feel confused or uncertain, they could express their evaluation as a discrete region containing multiple judgments, instead of a single result. A new data structure, named as set-matrix, is designed to store the combinations of those multiple judgments. An iterative searching algorithm is designed to find the pair-wise comparison matrix with approximate optimal consistency from the set-matrix. The experiments show that: 1) the consistency is significantly improved when the experts apply the discrete region evaluation instead of the single evaluation; and 2) the users can find the matrix with approximate optimal consistency quickly exploiting the iterative searching algorithm.
A new approach to improve the consistency of linguistic pair-wise comparison matrix and derive interval weight vector

Hengshan Zhang,Qinghua Zheng,Ting Liu,Yan Nan

DOI: https://doi.org/10.1109/FUZZ-IEEE.2014.6891795

2014-01-01

Abstract:H. Zhang, Q. Zheng, and T. Liu et al. proposed a discrete region based approach to improve the consistency of the pair-wise comparison matrix. The approach is able to significantly improve the consistency of pair-wise comparison matrix without to revise the decision maker's opinion. In the approach, a discrete region matrix is transformed into a set-matrix in which the elements are the real number set. In this paper, a discrete region matrix is transformed into a reciprocal interval matrix. A new iterative searching algorithm (NISA) is proposed to find the pair-wise comparison matrix with approximate optimum consistency from the reciprocal interval matrix. Based on the similarly principle, a new algorithm is proposed to derive the interval weight vector for the reciprocal interval matrix. The key character of this algorithm is that the derived interval weight vector includes the weight vector got by NISA for the same reciprocal interval matrix. In the experiment, five experimental strategies are designed, and the experimental results show that H. Zhang et al. proposed approach and NISA can get approximately similar weight vector according to the same pair-wise comparison matrix used the discrete region.
A New Method of Adjusting Inconsistent Pairwise Comparison Matrix

guohua wang,zhe cui,jingxian chen,liang liang

DOI: https://doi.org/10.1007/978-3-642-54924-3_41

2014-01-01

Abstract:In this paper, we develop a new approach to adjust an inconsistent pairwise comparison matrix (PCM). By deriving the consistent matrices from given PCM and finding out maximum consistent set of PCM, the consistent benchmark matrix of given PCM is obtained. Then, we can adjust the inconsistency by linear combination of the original PCM and benchmark matrix. Considering the reality of new PCM, a possible threshold of the value of linear combination parameter is given a mention. Finally, an illustrative example is given to show the practicality of the method.
An Automatic Method to Reach Consensus in a Local Context for AHP Group Decision Making

Yucheng Dong,Weijun Xu,Weidong Xu

DOI: https://doi.org/10.1504/ejie.2013.055018

2013-01-01

European Journal of Industrial Engineering

Abstract:In the analytic hierarchy process (AHP), Saaty's consistency index is performed to ensure that the preference information, provided in an individual judgement matrix, is neither random nor illogical. Based on the extension of Saaty's consistency index, this paper proposes a consensus index to measure the difference between the individual preference values and the collective preference value in AHP group decision making. Furthermore, based on the consensus index, we propose a consensus prioritisation method to obtain the collective priority vector for AHP group decision making, and develop a non-linear programme model to automatically reach acceptable consensus in a local context (a unique criterion). The consensus model in this paper can optimally preserve original preference information in reaching acceptable consensus (in some sense). A genetic algorithm also is designed to solve this non-linear programme model.
Consistency Measurement Of Pair-Wise Comparison

Z Liu,My Guo

2002-01-01

Abstract:Analytical Hierarchy Process (AMP) recognizes the basic rationality by breaking down a problem into its smaller constituent Paris and then calls for only simple pair-wise comparison judgments to develop priorities in each hierarchy. A fundamental aspect of the AMP is to use pair-wise comparisons to form a positive reciprocal matrix called pair-wise comparison matrix (PCM). Only a consistent PCM can be applied to make decision. A consistency ratio (CR) method is used to define consistency of a PCM in traditional AMP. But, when criteria are fair many, the calculation of CR of a PCM becomes troublesome. Moreover, the traditional CR method has a weakness that it cannot describe the consistency of a PCM precisely. Two examples are given to show it in this paper. And a scale distance (SD) method for improving the measurement of the consistency of PCM is proposed. An algorithm for judging the consistency of a PCM and an interactive program based on the algorithm for inputting PCM are illustrated. The program can aid decision makers to make pair-wise comparisons easily, to form the PCM and then to judge the consistency of the PCM automatically. Also, it has a performance to aid decision makers to revise their judgments made before by smallest modification.
Improving Linguistic Pairwise Comparison Consistency Via Linguistic Discrete Regions

Hengshan Zhang,Qinghua Zheng,Ting Liu,Zijiang Yang,Minnan Luo,Yu Qu

DOI: https://doi.org/10.1109/tfuzz.2015.2463744

IF: 12.253

2015-01-01

IEEE Transactions on Fuzzy Systems

Abstract:Linguistic pairwise comparison matrices are widely used in decision-making procedures. However, the matrices often give conflicting results when there are multiple criteria under consideration. Despite intensive research, achieving consistency of such matrices remains a daunting task. In this paper, a novel approach based on linguistic discrete region is proposed to address the challenge. Unlike existing methods that require a single value for each comparison, our approach allows a comparison to be expressed by a discrete region with multiple linguistic terms. Such front-end gives users more freedom to express their opinions. In the back-end, we propose an iterative searching algorithm that is able to achieve approximate optimal consistency for the comparison matrices with discrete region values. The final results are single-value matrices that not only guarantee approximate optimal consistency but comply with evaluators' intentions a well, as our approach does not modify any linguistic values like many existing methods. We have conducted extensive evaluations, and our empirical study confirms that the linguistic discrete region-based approach significantly improves the consistency of linguistic pairwise comparison matrices.
A direct consistency test and improvement method for the analytic hierarchy process

Kang Xu,Jiuping Xu

DOI: https://doi.org/10.1007/s10700-020-09323-y

IF: 5.274

2020-04-07

Fuzzy Optimization and Decision Making

Abstract:The consistency test is a vital component of pairwise comparison matrices if meaningful results are to be guaranteed, and it has been studied extensively since the analytic hierarchy process was developed by Saaty. However, when using the existing methods, it is imperative to carry out matrix operations, which are usually not intuitional. In this paper, a direct method, from the perspective of 3 tuples, is proposed to test and improve the consistency of a pairwise comparison matrix, which is far more intuitional and easier to understand. In the proposed 3 tuples iterative method, only simple mathematical calculations are needed, without the need for matrix operations. Furthermore, the calculation of Saaty's consistency ratio is only conducted to verify the proposed method. Some related theorems and propositions are proved mathematically or verified by random simulations. The proposed method is applied to some published examples to verify its effectiveness and practicability. Finally, we provide an improved iterative method, which is based on the 3 tuples iterative method. The improved iterative method and the 3 tuples iterative method are closely linked and each has its own different perspective. Moreover, they are applied on different occasions and reinforce one another.

computer science, artificial intelligence,operations research & management science
Consistency Improvement of Comparison Matrix Based on Geometric Consistency Index

Qunyan ZHOU,Peng TIAN,Zhiyou TIAN

DOI: https://doi.org/10.3969/j.issn.0258-2724.2006.02.021

2006-01-01

Journal of Southwest Jiaotong University

Abstract:A new criterion,consistency-credibility degree,of comparison matrix was defined by introducing the principle of "possibility-satisfiability degree" to overcome the deficiencies of available consistency improving methods.Row geometric mean method(RGMM) was taken for determining weights,and geometric consistency index(GCI) was taken as consistency measure.Then a new consistency improving method was proposed.An example was presented to show that this method abstains from the unreasonableness of traditional improving criterions,and the optimal improved matrix obtained preserves the original preference information as much as possible as well as improving the consistency of comparison matrix.
A gradient method for inconsistency reduction of pairwise comparisons matrices

Jean-Pierre Magnot,Jiří Mazurek,Viera Čerňanová

DOI: https://doi.org/10.48550/arXiv.2108.04034

2022-07-16

Abstract:We investigate an application of a mathematically robust minimization method -- the gradient method -- to the consistencization problem of a pairwise comparisons (PC) matrix. Our approach sheds new light on the notion of a priority vector and leads naturally to the definition of instant priority vectors. We describe a sample family of inconsistency indicators based on various ways of taking an average value, which extends the inconsistency indicator based on the "$\sup$"- norm. We apply this family of inconsistency indicators both for additive and multiplicative PC matrices to show that the choice of various inconsistency indicators lead to non-equivalent consistencization procedures.

Rings and Algebras,Numerical Analysis,Optimization and Control,Statistics Theory
Geometric consistency index for interval pairwise comparison matrices

Jiancheng Tu,Zhibin Wu,Jiuping Xu

DOI: https://doi.org/10.1080/01605682.2022.2075803

IF: 3.6

2022-05-26

Journal of the Operational Research Society

Abstract:Interval pairwise comparison matrices are widely accepted for practical decision making problems when the decision maker is unable to provide an exact judgment on the alternatives. However, as measuring the preference consistencies in pairwise comparison decision making problems is important, this paper proposes a new interval pairwise comparison matrix consistency measure, the average geometric consistency index, that assumes that the preference in a given interval follows the lognormal distribution. This geometric consistency measure accounts for the interval boundaries and uncertainties. As it is often difficult to rationally rank alternatives when interval pairwise comparison matrices are highly uncertain and/or inconsistent, we propose an optimization model to reduce the inconsistencies of these matrices while minimizing information loss and controlling uncertainties. An interval priority vector is derived to rank the alternatives. The feasibility and efficiency of the models are demonstrated using numerical examples.

management,operations research & management science
Inconsistency indices in pairwise comparisons: an improvement of the Consistency Index

Yuji Sato,Kim Hua Tan

DOI: https://doi.org/10.1007/s10479-021-04431-3

IF: 4.82

2022-01-25

Annals of Operations Research

Abstract:The Consistency Index and the Consistency Ratio of the analytic hierarchy process (AHP) were designed to measure the ratio of inconsistent judgments among pairwise comparisons (PCs), which have been the principal indices for the past four decades. Definitions of inconsistency measures for PCs have yet to be established, however, because of the difficulty in quantifying subjectivity in judgments. Therefore, an empirical review that can take such subjective factors into account is essential. In this paper, the Consistency Ratio is thus reviewed using subjective data, and then a new inconsistency index for PCs is proposed based on the review. The review is based on subjective data obtained from two opinion surveys, which focuses on the relationship between the Consistency Ratio and two indicators: (1) the conformity of the results of the AHP and that of the ranking method, and (2) the goodness-of-fit of weight elicited by the AHP to human perception. A new inconsistency index is then proposed based on the mathematical property of a pairwise comparison matrix and further validated based on the conformity and the goodness-of-fit of weight. The results show that the proposed index detects inconsistency among real-world PCs more sensitively than could the Consistency Ratio; the index might suggest the reliability of the output of a pairwise comparison matrix.

operations research & management science
Optimizing consistency improvement of positive reciprocal matrices with implications for Monte Carlo Analytic Hierarchy Process

Ashkan Negahban

DOI: https://doi.org/10.1016/j.cie.2018.07.018

2018-10-01

Abstract:Motivated by a situation encountered in a real-world application of the Analytic Hierarchy Process (AHP), this paper extends previous work on improving consistency of positive reciprocal judgment matrices by optimizing their transformation into near-consistent matrices. A sampling-optimization-adjustment approach is proposed and integrated into the Monte Carlo AHP framework, allowing it to deal with situations where no or insufficient distinct near-consistent matrices can be generated by directly sampling from the original pairwise comparison distributions – a situation that prohibits meaningful statistical analysis and effective decision-making using the traditional Monte Carlo AHP. Three mixed-integer nonlinear programing models are formulated for minimizing the sum of adjustments, maximum adjustment, and number of adjusted elements. Four heuristic algorithms are proposed to solve the models. The most appropriate heuristic(s) under each objective function and matrix size is determined through extensive statistical analysis of numerical experiments. The paper also presents an application of the proposed enhanced Monte Carlo AHP in a real-world industrial example of facility layout design selection, where the traditional Monte Carlo AHP fails to provide sufficient information to perform any statistical analysis on the final ranks and weights for the components in the hierarchy.

computer science, interdisciplinary applications,engineering, industrial
Possibility-Satisfiability Degree and the Test and Improvement of the Comparison Matrix' Consistency

田志友,王浣尘,吴瑞明

DOI: https://doi.org/10.3321/j.issn:1000-6788.2004.12.017

IF: 2.034

2004-01-01

Systems Engineering

Abstract:It is an important problem to test and improve the consistency of the comparison matrix in AHP. Owing to the shortcomings of existing methods, we applied the concept of into this realm, and put forward a new kind of optimal adjustment algorithm. It made use of the maximum eigenvalue and Frobenius-norm of the comparison matrix to define the possibility degree and satisfiability degree of that matrix, which could examine respectively the improvement extent and the degree of deviation between original matrix and the adjusted one. Then by combining the two measurements into a synthetical index: the possibility-satisfiability degree of the comparison matrix, the general effect of the adjustment could be embodied. Through this index accompanied with Saaty's CR standard, the direction and extent of the improvement would be controlled, and the optimal matrix with acceptable consistency could be available, which had preserved furthest the decision maker's primitive judgment information. The final example illustrated the flow and efficiency of the new method.
Reducing inconsistency measured by the geometric consistency index in the analytic hierarchy process

Juan Aguarón,María Teresa Escobar,José María Moreno-Jiménez

DOI: https://doi.org/10.1016/j.ejor.2020.06.014

IF: 6.4

2021-01-01

European Journal of Operational Research

Abstract:This paper presents a theoretical framework and a procedure for revising the judgements and improving the inconsistency of an Analytic Hierarchy Process (AHP) pairwise comparison matrix when the Row Geometric Mean (RGM) is used as the prioritisation procedure and the Geometric Consistency Index (GCI) is the inconsistency measure. Inconsistency is improved by slightly modifying the judgements that further reduce the GCI. Both the judgements and the derived priority vector will be close to the initial values. A simulation study is utilised to analyse the performance of the algorithm. The proposed framework allows the specification of the procedure to particular interests. A numerical example illustrates the proposed procedure.

operations research & management science

Support A simple method to improve the consistency ratio of the pairwise comparison matrix in ANP

A Simple Method to Improve the Consistency Ratio of the Pair-Wise Comparison Matrix in ANP

A New Consistency Index for Comparison Matrices in the ANP

Consistency Issues of Interval Pairwise Comparison Matrices

Is It Reasonable for Saaty's Consistency Test in the Pairwise Comparison Method?

Consistency and Consensus Improving Methods for Pairwise Comparison Matrices Based on Abelian Linearly Ordered Group

Simulation Experiments for Improving the Consistency Ratio of Reciprocal Matrices

A Discrete Region-Based Approach To Improve The Consistency Of Pair-Wise Comparison Matrix

A new approach to improve the consistency of linguistic pair-wise comparison matrix and derive interval weight vector

A New Method of Adjusting Inconsistent Pairwise Comparison Matrix

An Automatic Method to Reach Consensus in a Local Context for AHP Group Decision Making

Consistency Measurement Of Pair-Wise Comparison

Improving Linguistic Pairwise Comparison Consistency Via Linguistic Discrete Regions

A direct consistency test and improvement method for the analytic hierarchy process

Consistency Improvement of Comparison Matrix Based on Geometric Consistency Index

A gradient method for inconsistency reduction of pairwise comparisons matrices

Geometric consistency index for interval pairwise comparison matrices

Inconsistency indices in pairwise comparisons: an improvement of the Consistency Index

Optimizing consistency improvement of positive reciprocal matrices with implications for Monte Carlo Analytic Hierarchy Process

Possibility-Satisfiability Degree and the Test and Improvement of the Comparison Matrix' Consistency

Reducing inconsistency measured by the geometric consistency index in the analytic hierarchy process