Abstract:A major threat to the peer-review systems of computer science conferences is the existence of "collusion rings" between reviewers. In such collusion rings, reviewers who have also submitted their own papers to the conference work together to manipulate the conference's paper assignment, with the aim of being assigned to review each other's papers. The most straightforward way that colluding reviewers can manipulate the paper assignment is by indicating their interest in each other's papers through strategic paper bidding. One potential approach to solve this important problem would be to detect the colluding reviewers from their manipulated bids, after which the conference can take appropriate action. While prior work has developed effective techniques to detect other kinds of fraud, no research has yet established that detecting collusion rings is even possible. In this work, we tackle the question of whether it is feasible to detect collusion rings from the paper bidding. To answer this question, we conduct empirical analysis of two realistic conference bidding datasets, including evaluations of existing algorithms for fraud detection in other applications. We find that collusion rings can achieve considerable success at manipulating the paper assignment while remaining hidden from detection: for example, in one dataset, undetected colluders are able to achieve assignment to up to 30% of the papers authored by other colluders. In addition, when 10 colluders bid on all of each other's papers, no detection algorithm outputs a group of reviewers with more than 31% overlap with the true colluders. These results suggest that collusion cannot be effectively detected from the bidding using popular existing tools, demonstrating the need to develop more complex detection algorithms as well as those that leverage additional metadata (e.g., reviewer-paper text-similarity scores).

Collusion Detection in Public Procurement with Limited Information

Collusion detection in public procurement auctions with machine learning algorithms

Detecting collusion in procurement auctions

Detecting Indicators of Horizontal Collusion in Public Procurement with Machine Learning Methods

On suspicious tracks: machine-learning based approaches to detect cartels in railway-infrastructure procurement

Detecting the Collusive Bidding Behavior in below Average Bid Auction

Is Collusion-Proof Procurement Expensive?

Detecting bid-rigging coalitions in different countries and auction formats

Collusion risk in corporate networks

A Detector and Evaluation Framework of Abnormal Bidding Behavior Based on Supplier Portrait

Detecting bid rigging in public auctions for procuring infrastructure projects: formulating the reference scenario for decision-making

A network approach to cartel detection in public auction markets

Deep learning for detecting bid rigging: Flagging cartel participants based on convolutional neural networks

CReam: A Smart Contract Enabled Collusion-Resistant E-Auction

A Machine Learning Approach for Flagging Incomplete Bid-rigging Cartels

DETERRING BIDDER COLLUSION: AUCTION DESIGN COMPLEMENTS ANTITRUST POLICY

On the Detection of Reviewer-Author Collusion Rings From Paper Bidding

Confidence Screening Detector: A New Method for Detecting Test Collusion

The Influence of Collusive Information Dissemination on Bidder’s Collusive Willingness in Urban Construction Projects

Procurement cartels and the fight against (outsider) bribing

Algorithmic Collusion in Assortment Games