Hidden in Plain Sight: Exploring the Intersections of Mental Health, Eating Disorders, and Content Moderation on TikTok

Charles Bickham,Kia Kazemi-Nia,Luca Luceri,Kristina Lerman,Emilio Ferrara
2024-04-24
Abstract:Social media platforms actively moderate content glorifying harmful behaviors like eating disorders, which include anorexia and bulimia. However, users have adapted to evade moderation by using coded hashtags. Our study investigates the prevalence of moderation evaders on the popular social media platform TikTok and contrasts their use and emotional valence with mainstream hashtags. We notice that moderation evaders and mainstream hashtags appear together, indicating that vulnerable users might inadvertently encounter harmful content even when searching for mainstream terms. Additionally, through an analysis of emotional expressions in video descriptions and comments, we find that mainstream hashtags generally promote positive engagement, while moderation evaders evoke a wider range of emotions, including heightened negativity. These findings provide valuable insights for content creators, platform moderation efforts, and interventions aimed at cultivating a supportive online environment for discussions on mental health and eating disorders.
Social and Information Networks
What problem does this paper attempt to address?
The paper primarily explores issues related to mental health, eating disorders, and content moderation on the TikTok platform. The core objective of the study is to reveal how content about eating disorders on TikTok evades platform moderation and to analyze the emotional expression characteristics of such content. Specifically, the paper attempts to address the following questions: 1. **Co-occurrence of Moderation Evaders and Mainstream Tags**: The study aims to explore whether videos that evade content moderation by using coded tags co-occur with mainstream, health-promoting tags. This indicates that even if users search for positive themes, they may inadvertently encounter harmful information. 2. **Differences in Emotional Expression Under Different Tags**: The paper also compares and analyzes the emotional expressions in video descriptions related to mainstream tags and those related to moderation evader tags. The results show that mainstream tags tend to promote positive interactions, while moderation evader tags elicit more complex emotional responses, including high levels of negative emotions. 3. **Emotional Expression in Comments and Its Association with Video Descriptions**: The paper further explores the relationship between emotional expressions in video descriptions and user comments. The study finds that video descriptions and comments associated with mainstream tags generally exhibit more positive emotions, whereas those related to moderation evader tags display more diverse and often more negative emotional expressions. In summary, this paper reveals the challenges the TikTok platform faces in handling content related to eating disorders and the potential impact of such content on users' mental health by analyzing video content and user interactions. Additionally, the study emphasizes the importance of improving content moderation strategies and supportive interventions to foster a healthier online discussion environment.