The Adversarial AI-Art: Understanding, Generation, Detection, and Benchmarking

Yuying Li,Zeyan Liu,Junyi Zhao,Liangqin Ren,Fengjun Li,Jiebo Luo,Bo Luo

2024-04-23

Abstract:Generative AI models can produce high-quality images based on text prompts. The generated images often appear indistinguishable from images generated by conventional optical photography devices or created by human artists (i.e., real images). While the outstanding performance of such generative models is generally well received, security concerns arise. For instance, such image generators could be used to facilitate fraud or scam schemes, generate and spread misinformation, or produce fabricated artworks. In this paper, we present a systematic attempt at understanding and detecting AI-generated images (AI-art) in adversarial scenarios. First, we collect and share a dataset of real images and their corresponding artificial counterparts generated by four popular AI image generators. The dataset, named ARIA, contains over 140K images in five categories: artworks (painting), social media images, news photos, disaster scenes, and anime pictures. This dataset can be used as a foundation to support future research on adversarial AI-art. Next, we present a user study that employs the ARIA dataset to evaluate if real-world users can distinguish with or without reference images. In a benchmarking study, we further evaluate if state-of-the-art open-source and commercial AI image detectors can effectively identify the images in the ARIA dataset. Finally, we present a ResNet-50 classifier and evaluate its accuracy and transferability on the ARIA dataset.

Computer Vision and Pattern Recognition,Artificial Intelligence,Cryptography and Security

What problem does this paper attempt to address?

The paper focuses on the understanding and detection of adversarial scenes in AI-generated artworks. With the development of AI image generation technology, these models can create high-quality and indistinguishable images based on text prompts, which raises issues of copyright, ethics, and security. Research shows that AI image generators can be used for fraud, spreading false information, or creating counterfeit artworks.

The paper first creates a large-scale dataset called ARIA, which contains over 140,000 images divided into five categories: artworks, social media pictures, news photos, disaster scenes, and anime pictures. This dataset aims to support future research on adversarial AI art. The paper then conducts a user study to evaluate the ability of users to identify AI-generated images with or without reference images and finds that the accuracy is not high. In addition, the paper benchmarks existing AI image detection tools and finds that most tools perform poorly in detection performance.

The main contributions of the paper include:
1. A systematic exploration of the understanding and detection of adversarial AI art.
2. Collection and sharing of the first comprehensive dataset of adversarial AI art.
3. Large-scale user study evaluating human ability to recognize AI art.
4. Large-scale benchmark testing of open-source and commercial AI image detectors showing poor performance of most detectors.

The research also highlights the security risks of AI image generation, such as social media fraud, fake news and misinformation, unauthorized art style imitation, and emphasizes the need to increase public awareness of AI misuse and develop more effective detection tools to address these risks.