Abstract:Machine recognition systems now rival humans in their ability to classify natural images. However, their success is accompanied by a striking failure: a tendency to commit bizarre misclassifications on inputs specifically selected to fool them. What do ordinary people know about the nature and prevalence of such classification errors? Here, five experiments exploit the recent discovery of "natural adversarial examples" to ask whether naive observers can predict when and how machines will misclassify natural images. Whereas classical adversarial examples are inputs that have been minimally perturbed to induce misclassifications, natural adversarial examples are simply unmodified natural photographs that consistently fool a wide variety of machine recognition systems. For example, a bird casting a shadow might be misclassified as a sundial, or a beach umbrella made of straw might be misclassified as a broom. In Experiment 1, subjects accurately predicted which natural images machines would misclassify and which they would not. Experiments 2 through 4 extended this ability to how the images would be misclassified, showing that anticipating machine misclassifications goes beyond merely identifying an image as nonprototypical. Finally, Experiment 5 replicated these findings under more ecologically valid conditions, demonstrating that subjects can anticipate misclassifications not only under two-alternative forced-choice conditions (as in Experiments 1-4), but also when the images appear one at a time in a continuous stream-a skill that may be of value to human-machine teams. We suggest that ordinary people can intuit how easy or hard a natural image is to classify, and we discuss the implications of these results for practical and theoretical issues at the interface of biological and artificial vision.

Cognitive Anthropomorphism of AI: How Humans and Computers Classify Images

Anthropomorphization of AI: Opportunities and Risks

Won't you see my neighbor?: User predictions, mental models, and similarity-based explanations of AI classifiers

When will AI misclassify? Intuiting failures on natural images

Explanation Strategies for Image Classification in Humans vs. Current Explainable AI

Human Learning about AI Performance

AI anthropomorphism and its effect on users' self-congruence and self–AI integration: A theoretical framework and research agenda

From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?

Designing Human-AI Systems: Anthropomorphism and Framing Bias on Human-AI Collaboration

Challenges of Human-Aware AI Systems

I create, therefore I agree: Exploring the effect of AI anthropomorphism on human decision-making

Understanding Human Cognition Through Computational Modeling

Decoding AI in Contemporary Art: A Five-Trope Classification for Understanding and Categorization

Explanation strategies in humans versus current explainable artificial intelligence: Insights from image classification

The Switch, the Ladder, and the Matrix: Models for Classifying AI Systems

Can Machines Imitate Humans? Integrative Turing Tests for Vision and Language Demonstrate a Narrowing Gap

Can a Machine Have Two Systems for Recognition, Like Human Beings?

Mindsets and mirrors: How growth mindsets shape anthropomorphism in AI‐enabled technologies

Human-to-AI Coach: Improving Human Inputs to AI Systems

Anthropomorphizing Machines: Reality or Popular Myth?

Diagnosing AI Explanation Methods with Folk Concepts of Behavior