Abstract:Journalism, Ahead of Print. The production of data-driven journalism is becoming increasingly automated, impacting its composition and comprehensibility. Given the importance of data-driven reporting for democratic participation, this study investigates, firstly, how readers evaluate the composition of data-driven articles produced with and without the help of automation and, secondly, how these evaluations affect readers' perceptions of the articles' comprehensibility. In an online survey experiment, 3135 online news consumers evaluated 24 articles produced with or without automation using criteria developed in prior research. Our factor analysis reduced those criteria to five categories that matter in readers' evaluations of the articles' composition: numeric features, writing style, sentence and paragraph length, descriptive language, and word choice. Our results show, firstly, that although the perception of news stories produced with automation did not differ significantly from that of news stories produced without automation regarding sentence and paragraph length and writing style, the stories produced with automation were evaluated as significantly less comprehensible; and, secondly, that this can be explained partly by readers' perceptions of some of the other article composition categories, which were rated significantly worse in automated articles. Our findings suggest that using automation to produce data-driven news articles changes their perceived composition in ways that negatively impact comprehensibility. However, this study also suggests how such articles could be made more comprehensible. Specifically, when 'post-editing' automated articles, journalists should aim to further reduce the quantity of numbers, better explain words that readers are unlikely to understand and change inappropriate wording.

Attitudes to automated and human written sport journalism

Automated journalism: The effects of AI authorship and evaluative information on the perception of a science journalism article

Too many numbers and worse word choice: Why readers find data-driven news articles produced with automation harder to understand

Automated Journalism

A systematic review of automated journalism scholarship: guidelines and suggestions for future research

Automated Journalism in UK Local Newsrooms: Attitudes, Integration, Impact

Changing or Reinforcing the “Rules of the Game”: A Field Theory Perspective on the Impacts of Automated Journalism on Media Practitioners

Cheerleaders or Critics?

Artificial Intelligence and Journalism: Current Situation and Expectations in the Portuguese Sports Media

AMERICAN SPORTS WRITERS’ SOCIAL MEDIA USE AND ITS INFLUENCE ON PROFESSIONALISM

Automated news in practice: a cross-national exploratory study

Technology or content: Which factor is more important in people's evaluation of artificial intelligence news?

Public Perceptions and Attitudes Towards the Application of Artificial Intelligence in Journalism: From a China-based Survey

Behind the black box: The moderating role of the machine heuristic on the effect of transparency information about automated journalism on hostile media bias perception

Can an Algorithm Reduce the Perceived Bias of News? Testing the Effect of Machine Attribution on News Readers’ Evaluations of Bias, Anthropomorphism, and Credibility

The Main Influencing Factors of Artificial Intelligence Big Data Sports News Coverage

Gender byline bias in sports reporting: Examining the visibility and audience perception of male and female journalists in sports coverage

Towards a “Digital” Sports Journalism: Field Theory, Changing Boundaries and Evolving Technologies

Human Perception of Performance

Reviewer Experience Detecting and Judging Human Versus Artificial Intelligence Content: The Stroke Journal Essay Contest

Automation, Journalism, and Human–Machine Communication: Rethinking Roles and Relationships of Humans and Machines in News