Abstract:The recent wave of generative AI has sparked unprecedented global attention, with both excitement and concern over potentially superhuman levels of artificial intelligence: models now take only seconds to produce outputs that would challenge or exceed the capabilities even of expert humans. At the same time, models still show basic errors in understanding that would not be expected even in non-expert humans. This presents us with an apparent paradox: how do we reconcile seemingly superhuman capabilities with the persistence of errors that few humans would make? In this work, we posit that this tension reflects a divergence in the configuration of intelligence in today's generative models relative to intelligence in humans. Specifically, we propose and test the Generative AI Paradox hypothesis: generative models, having been trained directly to reproduce expert-like outputs, acquire generative capabilities that are not contingent upon -- and can therefore exceed -- their ability to understand those same types of outputs. This contrasts with humans, for whom basic understanding almost always precedes the ability to generate expert-level outputs. We test this hypothesis through controlled experiments analyzing generation vs. understanding in generative models, across both language and image modalities. Our results show that although models can outperform humans in generation, they consistently fall short of human capabilities in measures of understanding, as well as weaker correlation between generation and understanding performance, and more brittleness to adversarial inputs. Our findings support the hypothesis that models' generative capability may not be contingent upon understanding capability, and call for caution in interpreting artificial intelligence by analogy to human intelligence.

Masterminds of Generative AI: Vaswani and Altman

Generative Artificial Intelligence Enhances Sudden Moments of Inspiration among Novice Designers

Generative AI in the Wild: Prospects, Challenges, and Strategies

Generative AI: An In-depth Exploration of Methods, Uses, and Challenges

Generative Artificial Intelligence: Trends and Prospects

Managing the emerging role of generative AI in next-generation business

Generative Ai: potential and pitfalls

Generative AI for Product Design: Getting the Right Design and the Design Right

Generative AI, Innovation, and Trust

Enhancing Reality: Exploring the Potential of Generative Artificial Intelligence

Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work

Generative AI as a New Innovation Platform

Creativity in the age of generative AI

The Rise of Creative Machines: Exploring the Impact of Generative AI

Early Adoption of Generative AI by Global Business Leaders: Insights from an INSEAD Alumni Survey

AI Horizons: Unveiling the Future of Generative Intelligence

Watching the Generative AI Hype Bubble Deflate

On the Challenges and Opportunities in Generative AI

The Generative AI Paradox: "What It Can Create, It May Not Understand"

Art and the science of generative AI: A deeper dive

Art and the science of generative AI