Staying vigilant in the Age of AI: From content generation to content authentication

Yufan Li,Zhan Wang,Theo Papatheodorou

2024-07-01

Abstract:This paper presents the Yangtze Sea project, an initiative in the battle against Generative AI (GAI)-generated fake con-tent. Addressing a pressing issue in the digital age, we investigate public reactions to AI-created fabrications through a structured experiment on a simulated academic conference platform. Our findings indicate a profound public challenge in discerning such content, highlighted by GAI's capacity for realistic fabrications. To counter this, we introduce an innovative approach employing large language models like ChatGPT for truthfulness assess-ment. We detail a specific workflow for scrutinizing the authenticity of everyday digital content, aimed at boosting public awareness and capability in identifying fake mate-rials. We apply this workflow to an agent bot on Telegram to help users identify the authenticity of text content through conversations. Our project encapsulates a two-pronged strategy: generating fake content to understand its dynamics and developing assessment techniques to mitigate its impact. As part of that effort we propose the creation of speculative fact-checking wearables in the shape of reading glasses and a clip-on. As a computational media art initiative, this project under-scores the delicate interplay between technological progress, ethical consid-erations, and societal consciousness.

Computers and Society

What problem does this paper attempt to address?

The main problems that this paper attempts to solve are as follows: With the progress of generative artificial intelligence (Generative AI, GAI) technology, the generation of false content has become increasingly easy and realistic, making it difficult for the public to distinguish between true and false information. Specifically:

1. **Insufficient ability of the public to identify false content**: Research shows that even experts have difficulty accurately identifying content generated by generative AI. This indicates that there is a significant cognitive gap among the public when facing such content.

2. **The risk of spreading false information**: Through platforms such as social media, false content can spread rapidly, mislead the public and influence public opinion. Especially when this content is disguised as real academic or news reports, the harm is more serious.

3. **Lack of effective detection tools**: Existing detection algorithms and techniques are not sufficient to meet the challenges brought by generative AI, especially in text generation. AI - generated content is more difficult to detect than images.

To solve these problems, the author proposes an innovative method, using large - language models (such as ChatGPT) for authenticity assessment, and designs a specific process to verify the authenticity of daily digital content. In addition, they also develop chatbots and other tools to help users identify the authenticity of text content through conversations.

### Specific measures include:

- **Generating and analyzing false content**: By simulating academic conference websites, generate false academic papers and conference information, and study the reactions of the public and experts to them.
- **Developing an authenticity assessment workflow**: Use large - language models to evaluate text content sentence by sentence, give local and global authenticity scores, and mark suspicious parts.
- **Creating chatbots**: Develop two chatbots (@Alethiometer and a GPT - based chatbot). Users can submit text through conversations and obtain authenticity assessment results and explanations.

### Goals:
Increase the public's vigilance and ability to distinguish content generated by generative AI, reduce the risk of spreading false information, and promote the responsible use of AI technology in society.

Through these measures, the author hopes to provide an effective method to enhance the public's information discrimination ability and maintain the authenticity and credibility of digital content in the era of widespread application of generative AI technology.