The Design and Operation of Digital Platform under Sociotechnical Folk Theories

Jordan W. Suchow,Lea Burton,Vahid Ashrafimoghari
DOI: https://doi.org/10.48550/arXiv.2305.03291
2023-05-05
Abstract:We consider the problem of how a platform designer, owner, or operator can improve the design and operation of a digital platform by leveraging a computational cognitive model that represents users's folk theories about a platform as a sociotechnical system. We do so in the context of Reddit, a social media platform whose owners and administrators make extensive use of shadowbanning, a non-transparent content moderation mechanism that filters a user's posts and comments so that they cannot be seen by fellow community members or the public. After demonstrating that the design and operation of Reddit have led to an abundance of spurious suspicions of shadowbanning in case the mechanism was not in fact invoked, we develop a computational cognitive model of users's folk theories about the antecedents and consequences of shadowbanning that predicts when users will attribute their on-platform observations to a shadowban. The model is then used to evaluate the capacity of interventions available to a platform designer, owner, and operator to reduce the incidence of these false suspicions. We conclude by considering the implications of this approach for the design and operation of digital platforms at large.
Information Theory,Computers and Society,Social and Information Networks
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to improve the design and operation of digital platforms by leveraging computational cognitive models, especially when these models can represent users' "folk theories" of the platform as a sociotechnical system. Specifically, taking Reddit as an example, the paper explores how to reduce users' false suspicions of "shadowbanning", a non - transparent content management mechanism, by understanding users' "folk theories". First, the paper analyzes the situation of users' suspicions of shadowbanning on Reddit and finds that most of the suspicions are actually unfounded. Then, the author develops a computational cognitive model to predict when users will attribute their platform observations to being shadowbanned and evaluates the interventions that platform designers, owners or operators can take to reduce these unfounded suspicions. Finally, the paper discusses the implications of this method for the broader design and operation of digital platforms.