Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels

Manoel Horta Ribeiro,Shagun Jhaver,Savvas Zannettou,Jeremy Blackburn,Emiliano De Cristofaro,Gianluca Stringhini,Robert West

DOI: https://doi.org/10.1145/3476057

2021-08-20

Abstract:When toxic online communities on mainstream platforms face moderation measures, such as bans, they may migrate to other platforms with laxer policies or set up their own dedicated websites. Previous work suggests that within mainstream platforms, community-level moderation is effective in mitigating the harm caused by the moderated communities. It is, however, unclear whether these results also hold when considering the broader Web ecosystem. Do toxic communities continue to grow in terms of their user base and activity on the new platforms? Do their members become more toxic and ideologically radicalized? In this paper, we report the results of a large-scale observational study of how problematic online communities progress following community-level moderation measures. We analyze data from r/The_Donald and r/Incels, two communities that were banned from Reddit and subsequently migrated to their own standalone websites. Our results suggest that, in both cases, moderation measures significantly decreased posting activity on the new platform, reducing the number of posts, active users, and newcomers. In spite of that, users in one of the studied communities (r/The_Donald) showed increases in signals associated with toxicity and radicalization, which justifies concerns that the reduction in activity may come at the expense of a more toxic and radical community. Overall, our results paint a nuanced portrait of the consequences of community-level moderation and can inform their design and deployment.

Computers and Society

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: when toxic online communities face management measures (such as bans) from mainstream platforms, will these communities continue to grow after migrating to other platforms, and will their members become more toxic and ideologically radical? Specifically, the paper studied two communities banned by Reddit - r/The_Donald and r/Incels - to see whether their activity levels and ability to attract new members remained the same after migrating to their own independent websites, and whether the members of these communities became more toxic or ideologically radical after the migration.

By analyzing the activity data of these two communities before and after the migration, the paper explored the effectiveness of community - level management measures. The research results are of great significance for understanding the impact of management measures in the entire network ecosystem and are helpful for relevant stakeholders to formulate more effective management policies.