Towards Hybrid Intelligence in Journalism: Findings and Lessons Learnt from a Collaborative Analysis of Greek Political Rhetoric by ChatGPT and Humans

Thanasis Troboukis,Kelly Kiki,Antonis Galanopoulos,Pavlos Sermpezis,Stelios Karamanidis,Ilias Dimitriadis,Athena Vakali
2024-10-17
Abstract:This chapter introduces a research project titled "Analyzing the Political Discourse: A Collaboration Between Humans and Artificial Intelligence", which was initiated in preparation for Greece's 2023 general elections. The project focused on the analysis of political leaders' campaign speeches, employing Artificial Intelligence (AI), in conjunction with an interdisciplinary team comprising journalists, a political scientist, and data scientists. The chapter delves into various aspects of political discourse analysis, including sentiment analysis, polarization, populism, topic detection, and Named Entities Recognition (NER). This experimental study investigates the capabilities of large language model (LLMs), and in particular OpenAI's ChatGPT, for analyzing political speech, evaluates its strengths and weaknesses, and highlights the essential role of human oversight in using AI in journalism projects and potentially other societal sectors. The project stands as an innovative example of human-AI collaboration (known also as "hybrid intelligence") within the realm of digital humanities, offering valuable insights for future initiatives.
Computers and Society,Computation and Language
What problem does this paper attempt to address?
The problems that this paper attempts to solve mainly focus on two aspects: 1. **Comprehensive analysis of political leaders' campaign speeches**: This project aims to conduct a comprehensive analysis of the campaign speeches of political leaders during the 2023 general election in Greece in order to reveal the qualitative characteristics in their discourses. Specific objectives include: - Identifying the main themes emphasized by political leaders in their campaign speeches. - Analyzing the emotions conveyed in the speeches. - Quantifying the degree of the existence of polarizing and populist elements in the speeches. 2. **Exploring the boundaries of modern technology**: The project also aims to explore the capabilities of large - language models (LLMs), especially OpenAI's ChatGPT, in conducting qualitative and comparative studies of political discourses. Specific objectives include: - Evaluating the efficiency, challenges, and limitations of ChatGPT in handling news items. - Exploring how to develop robust and reliable methodologies. - Determining whether and to what extent human supervision is required. Through these two main objectives, the project hopes to demonstrate the innovative application of the cooperation between artificial intelligence and human experts (i.e., "hybrid intelligence") in the field of digital humanities and provide valuable insights for similar projects in the future.