Ordering-based Method to Evaluate Reputation Models

LIU Wei,WANG Huai-min,TANG Yang-bin,LU Gang

2011-01-01

Abstract:Aiming to solve the problem of lacking a generally and quantitatively comparative analysis on existing reputation models,this paper proposes an ordering-based method to evaluate reputation models.It ignores the reputation values and translates the model evaluation to the comparison and contrast between two ranking orderings.Moreover,this paper introduces two evaluation criteria for a reputation model-precision and robustness,and give two metric for them —— matching degree and hitting rate.Evaluating on the related reputation models by our method,the experimental results suggest that the ordering-based method can evaluate different reputation models in multi-dimension and it provides a possible way to evaluate different reputation models.