Abstract:Media coverage possesses a substantial effect on the public perception of events. The way media frames events can significantly alter the beliefs and perceptions of our society. Nevertheless, nearly all media outlets are known to report news in a biased way. While such bias can be introduced by altering the word choice or omitting information, the perception of bias also varies largely depending on a reader's personal background. Therefore, media bias is a very complex construct to identify and analyze. Even though media bias has been the subject of many studies, previous assessment strategies are oversimplified, lack overlap and empirical evaluation. Thus, this study aims to develop a scale that can be used as a reliable standard to evaluate article bias. To name an example: Intending to measure bias in a news article, should we ask, "How biased is the article?" or should we instead ask, "How did the article treat the American president?". We conducted a literature search to find 824 relevant questions about text perception in previous research on the topic. In a multi-iterative process, we summarized and condensed these questions semantically to conclude a complete and representative set of possible question types about bias. The final set consisted of 25 questions with varying answering formats, 17 questions using semantic differentials, and six ratings of feelings. We tested each of the questions on 190 articles with overall 663 participants to identify how well the questions measure an article's perceived bias. Our results show that 21 final items are suitable and reliable for measuring the perception of media bias. We publish the final set of questions on http://bias-question-tree.gipplab.org/.

Is the Media Biased Against Me? A Meta-Analysis of the Hostile Media Effect Research

Hostile Media or Hostile Source? Bias Perception of Shared News

Whose media are hostile? The spillover effect of interpersonal discussions on media bias perceptions

Hostile media bias on social media: Testing the effect of user comments on perceptions of news bias and credibility

Who thinks the media is hostile?! An examination of individual differences predicting the hostile media effect concerning news media coverage of individuals with a migratory background in Germany

Intraparty Hostility: Social Identity, Subidentity, and the Hostile Media Effect in a Contested Primary

When media become the mirror: a meta-analysis on media and body image

Media Literacy Messages and Hostile Media Perceptions: Processing of Nonpartisan Versus Partisan Political Information

Do You Think It's Biased? How To Ask For The Perception Of Media Bias

When Social Media Become Hostile Media: An Experimental Examination of News Sharing, Partisanship, and Follower Count

Behind the black box: The moderating role of the machine heuristic on the effect of transparency information about automated journalism on hostile media bias perception

Why Do Journalists Face Varying Degrees of Digital Hostility? Examining the Interplay Between Minority Identity and Celebrity Capital

Hostile media perceptions and consumption of genetically modified and organic foods: Examining the mediating role of risk‐benefit assessments

Gender differences and similarities in news media effects on political candidate evaluations: a meta-analysis

Hostility and Perceptions of Support in Ambiguous Social Interactions

Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Bias

Inside the spiral: Hostile media, minority perception, and willingness to speak out on a weblog

Measuring Hostile Interpretation Bias

How Does Multi-Platform Social Media Use Lead to Biased News Engagement? Examining the Role of Counter-Attitudinal Incidental Exposure, Cognitive Elaboration, and Network Homogeneity

Do media portrayals and social consensus information impact anti-fat attitudes and support for anti-weight discrimination laws and policies?

The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias