Politicians vs ChatGPT. A study of presuppositions in French and Italian political communication

Davide Garassino,Vivana Masia,Nicola Brocca,Alice Delorme Benites
DOI: https://doi.org/10.62408/ai-ling.v1i1
2024-11-27
Abstract:This paper aims to provide a comparison between texts produced by French and Italian politicians on polarizing issues, such as immigration and the European Union, and their chatbot counterparts created with ChatGPT 3.5. In this study, we focus on implicit communication, in particular on presuppositions and their functions in discourse, which have been considered in the literature as a potential linguistic feature of manipulation. This study also aims to contribute to the emerging literature on the pragmatic competences of Large Language Models.
Computation and Language,Computers and Society
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to explore the text differences between speeches made by French and Italian politicians on controversial issues (such as immigration and the EU) and the chatbot version generated by ChatGPT 3.5, especially how these differences are reflected in implicit communication, in particular presupposition and its function in discourse. The research aims to evaluate the pragmatic ability of large - language models (LLMs) by comparing the use of presupposition in texts generated by real politicians and artificial intelligence, and to explore the potential risks of texts generated by these models in spreading false information and suspicious content. Specifically, the research proposes the following three sub - questions: 1. **Frequency**: Compared with the texts produced by real politicians, does ChatGPT generate more or fewer potentially manipulative presuppositions (PMPs) on average? 2. **Form**: Are the forms of PMPs in ChatGPT texts (i.e., the trigger words that activate them) similar to those in politicians' texts? 3. **Form**: Are the discourse functions of PMPs in ChatGPT texts similar to those in politicians' texts? Through these questions, the research hopes to reveal how the texts generated by ChatGPT are different from the speeches of real politicians in terms of implicit communication and what impacts these differences may bring.