Examining Similar and Ideologically Correlated Imagery in Online Political Communication

Amogh Joshi,Cody Buntain

DOI: https://doi.org/10.48550/arXiv.2110.01183

2021-10-04

Computers and Society

Abstract:This paper investigates visual media shared by US national politicians on Twitter, how a politician's variety of image types shared reflects their political position, and identifies a hazard in using standard methods for image characterization in this context. While past work has yielded valuable results on politicians' use of imagery in social media, that work has focused primarily on photographic media, which may not be sufficient given the variety of visual media shared in such spaces (e.g., infographics, illustrations, or memes). Leveraging three popular deep learning models to characterize politicians' visuals, this work uses clustering to identify eight types of visual media shared on Twitter, several of which are not photographic in nature. Results also show individual politicians share a variety of these types, and the distributions of their imagery across these clusters is correlated with their overall ideological position -- e.g., liberal politicians appear to share a larger proportion of infographic-style images, and conservative politicians appear to share more patriotic imagery. At the same time, manual assessment reveals that these image characterization models group images with vastly different semantic meaning into the same clusters, as confirmed in a post-hoc analysis of hateful memetic imagery. These results suggest that, while image-characterization techniques do identify general types of imagery that correlate with political ideology, these methods miss critical semantic -- and therefore politically relevant -- differences among images. Consequently, care should be taken when dealing with the varieties of imagery shared in online spaces, especially in political contexts.