Organic or Diffused: Can We Distinguish Human Art from AI-generated Images?

Anna Yoo Jeong Ha,Josephine Passananti,Ronik Bhaskar,Shawn Shan,Reid Southen,Haitao Zheng,Ben Y. Zhao
2024-07-03
Abstract:The advent of generative AI images has completely disrupted the art world. Distinguishing AI generated images from human art is a challenging problem whose impact is growing over time. A failure to address this problem allows bad actors to defraud individuals paying a premium for human art and companies whose stated policies forbid AI imagery. It is also critical for content owners to establish copyright, and for model trainers interested in curating training data in order to avoid potential model collapse. There are several different approaches to distinguishing human art from AI images, including classifiers trained by supervised learning, research tools targeting diffusion models, and identification by professional artists using their knowledge of artistic techniques. In this paper, we seek to understand how well these approaches can perform against today's modern generative models in both benign and adversarial settings. We curate real human art across 7 styles, generate matching images from 5 generative models, and apply 8 detectors (5 automated detectors and 3 different human groups including 180 crowdworkers, 4000+ professional artists, and 13 expert artists experienced at detecting AI). Both Hive and expert artists do very well, but make mistakes in different ways (Hive is weaker against adversarial perturbations while Expert artists produce higher false positives). We believe these weaknesses will remain as models continue to evolve, and use our data to demonstrate why a combined team of human and automated detectors provides the best combination of accuracy and robustness.
Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
The problem this paper attempts to address is: how to reliably distinguish between artworks created by humans and images generated by generative AI models. With the development of generative AI technology, AI-generated images are becoming increasingly visually similar to works by human artists, posing a challenge to the art world. Distinguishing between these two sources of images is crucial not only for preventing fraud when individuals and companies purchase artworks but also involves issues of copyright law and the purity of AI model training data. Specifically, the paper explores the following aspects: 1. **Are there currently any detection methods (whether manual or automated) that can accurately distinguish between human artworks and AI-generated images?** This includes comparing artists' understanding of art fundamentals with semantic-agnostic supervised classification and research tools specifically designed to detect diffusion model outputs. 2. **What are the limitations of current detectors, and why do they make mistakes?** 3. **How do detectors perform under adversarial conditions (i.e., when images are modified to avoid recognition)?** 4. **What is the performance trend of detection methods as models continue to evolve, and what are the future implications?** The paper aims to comprehensively understand the feasibility of this task and provide guidance for the future development of detection technologies by conducting a comprehensive evaluation of different types of detection methods, including automated tools and human judgment, and considering various art styles, AI image sources, adversarial perturbations, and other factors.