Abstract:The proliferation of AI techniques for image generation, coupled with their increasing accessibility, has raised significant concerns about the potential misuse of these images to spread misinformation. Recent AI-generated image detection (AGID) methods include CNNDetection, NPR, DM Image Detection, Fake Image Detection, DIRE, LASTED, GAN Image Detection, AIDE, SSP, DRCT, RINE, OCC-CLIP, De-Fake, and Deep Fake Detection. However, we argue that the current state-of-the-art AGID techniques are inadequate for effectively detecting contemporary AI-generated images and advocate for a comprehensive reevaluation of these methods. We introduce the Visual Counter Turing Test (VCT^2), a benchmark comprising ~130K images generated by contemporary text-to-image models (Stable Diffusion 2.1, Stable Diffusion XL, Stable Diffusion 3, DALL-E 3, and Midjourney 6). VCT^2 includes two sets of prompts sourced from tweets by the New York Times Twitter account and captions from the MS COCO dataset. We also evaluate the performance of the aforementioned AGID techniques on the VCT$^2$ benchmark, highlighting their ineffectiveness in detecting AI-generated images. As image-generative AI models continue to evolve, the need for a quantifiable framework to evaluate these models becomes increasingly critical. To meet this need, we propose the Visual AI Index (V_AI), which assesses generated images from various visual perspectives, including texture complexity and object coherence, setting a new standard for evaluating image-generative AI models. To foster research in this domain, we make our <a class="link-external link-https" href="https://huggingface.co/datasets/anonymous1233/COCO_AI" rel="external noopener nofollow">this https URL</a> and <a class="link-external link-https" href="https://huggingface.co/datasets/anonymous1233/twitter_AI" rel="external noopener nofollow">this https URL</a> datasets publicly available.

Visual Veracity: Advancing AI-Generated Image Detection with Convolutional Neural Networks

Advancing AI-Generated Image Detection: Enhanced Accuracy through CNN and Vision Transformer Models with Explainable AI Insights

Harnessing Machine Learning for Discerning AI-Generated Synthetic Images

Detection of AI-Generated Synthetic Images with a Lightweight CNN

Transfer Learning-Based Models for Comparative Evaluation for the Detection of AI-Generated Images

No One Can Escape: A General Approach to Detect Tampered and Generated Image

AI vs. AI: Can AI Detect AI-Generated Images?

CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Images

Addressing Vulnerabilities in AI-Image Detection: Challenges and Proposed Solutions

Development of a Dual-Input Neural Model for Detecting AI-Generated Imagery

Auguring Fake Face Images Using Dual Input Convolution Neural Network

Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Models

An improvised CNN model for fake image detection

Incremental learning for the detection and classification of GAN-generated images

CGNet: Detecting computer-generated images based on transfer learning with attention module

Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks

Detecting the Undetectable: Combining Kolmogorov-Arnold Networks and MLP for AI-Generated Image Detection

A Sanity Check for AI-generated Image Detection

Visual Counter Turing Test (VCT^2): Discovering the Challenges for AI-Generated Image Detection and Introducing Visual AI Index (V_AI)