Robustness of rank aggregation methods for malicious disturbance

Dongmei Chen,Yu Xiao,Huan Zhu,Ye Deng,Jun Wu

DOI: https://doi.org/10.1016/j.ins.2023.01.008

IF: 8.1

2023-01-05

Information Sciences

Abstract:Rank aggregation has widespread applications in social choice, information retrieval, and bioinformatics. Given the enormous social and economic implications of these applications and the consequent incentives for malicious users to disturb the aggregated ranking, evaluating the robustness of rank aggregation methods for malicious disturbance is a key challenge. In this article, we introduce an analytical framework for the robustness of rank aggregation for malicious disturbances, in which we generate rankings with imperfect information and observe the response of rank aggregation methods. Along with the analytical framework, we propose an experimental data generation method and a new robustness measure. Then we investigate the robustness of five common rank aggregation methods using our proposed method. Extensive experiments demonstrate that our method can effectively compare the robustness of different rank aggregation methods for malicious disturbance. Moreover, the experimental results show that the performance of rank aggregation methods for malicious disturbance may be very different from that for random error.

computer science, information systems