Abstract:Gang violence is a severe issue in major cities across the U.S. and recent studies [Patton et al. 2017] have found evidence of social media communications that can be linked to such violence in communities with high rates of exposure to gang activity. In this paper we partnered computer scientists with social work researchers, who have domain expertise in gang violence, to analyze how public tweets with images posted by youth who mention gang associations on Twitter can be leveraged to automatically detect psychosocial factors and conditions that could potentially assist social workers and violence outreach workers in prevention and early intervention programs. To this end, we developed a rigorous methodology for collecting and annotating tweets. We gathered 1,851 tweets and accompanying annotations related to visual concepts and the psychosocial codes: aggression, loss, and substance use. These codes are relevant to social work interventions, as they represent possible pathways to violence on social media. We compare various methods for classifying tweets into these three classes, using only the text of the tweet, only the image of the tweet, or both modalities as input to the classifier. In particular, we analyze the usefulness of mid-level visual concepts and the role of different modalities for this tweet classification task. Our experiments show that individually, text information dominates classification performance of the loss class, while image information dominates the aggression and substance use classes. Our multimodal approach provides a very promising improvement (18% relative in mean average precision) over the best single modality approach. Finally, we also illustrate the complexity of understanding social media data and elaborate on open challenges.

Broadcasting Badness: Violence, Identity, and Performance in the Online Gang Rap Scene

Internet banging: New trends in social media, gang violence, masculinity and hip hop

Youth Perspectives on Gangs, Violence, and Social Media in a High Crime City

"EBK" : Leveraging Crowd-Sourced Social Media Data to Quantify How Hyperlocal Gang Affiliations Shape Personal Networks and Violence in Chicago's Contemporary Southside

Visualizing YouTube’s comment space: online hostility as a networked phenomena

Using Natural Language Processing and Qualitative Analysis to Intervene in Gang Violence: A Collaboration Between Social Work Researchers and Data Scientists

How Social Media Use Mitigates Urban Violence: Communication Visibility and Third-Party Intervention Processes in Digital Urban Contexts

THE ANATOMY OF DIGITAL CLOUT(CHASING): BLACK AESTHETICS, ONLINE VISIBILITY AND RELATIONAL LABOR AMONG DIY HIP-HOP MUSICIANS ON CHICAGO’S SOUTH SIDE

Denying humanness to victims: How gang members justify violent behavior

Understanding Lexical Biases when Identifying Gang-related Social Media Communications

Violent music vs violence and music: Drill rap and violent crime in London

Multimodal Social Media Analysis for Gang Violence Prevention

Changing images of violence in Rap music lyrics: 1979-1997

The American Ghetto, Gangster, and Respect on the Streets of Copenhagen: Media(tion)s between Structure and Street Culture

Using Rap Music to Better Understand African American Experiences

Digital mourning in tweets: Multimodal analysis of image-based grieving practices among gang-affiliated Black youth

Convention Versus Deviance: Moral Agency in Adolescent Gang Members' Decision Making

The Death of Dissent and the Decline of Dissin’: A Diachronic Study of Race, Gender, and Genre in Mainstream American Rap

COUNTERING HIP-HOP AS A BLACK SPACE: HOW “THE OTHERS” STRUGGLED TO FIND SPACE IN RAP BATTLE CULTURE AS ANALYZED IN 8 MILE (2002) AND BAD RAP (2016)

Detecting Gang-Involved Escalation on Social Media Using Context

Rap Music as Resistive Occupation: Constructions of Black American Identity and Culture for Performers and their Audiences