Abstract:The emergence of large language models (LLMs) has opened up exciting possibilities for simulating human behavior and cognitive processes, with potential applications in various domains, including marketing research and consumer behavior analysis. However, the validity of utilizing LLMs as stand-ins for human subjects remains uncertain due to glaring divergences that suggest fundamentally different underlying processes at play and the sensitivity of LLM responses to prompt variations. This paper presents a novel approach based on Shapley values from cooperative game theory to interpret LLM behavior and quantify the relative contribution of each prompt component to the model's output. Through two applications - a discrete choice experiment and an investigation of cognitive biases - we demonstrate how the Shapley value method can uncover what we term "token noise" effects, a phenomenon where LLM decisions are disproportionately influenced by tokens providing minimal informative content. This phenomenon raises concerns about the robustness and generalizability of insights obtained from LLMs in the context of human behavior simulation. Our model-agnostic approach extends its utility to proprietary LLMs, providing a valuable tool for practitioners and researchers to strategically optimize prompts and mitigate apparent cognitive biases. Our findings underscore the need for a more nuanced understanding of the factors driving LLM responses before relying on them as substitutes for human subjects in survey settings. We emphasize the importance of researchers reporting results conditioned on specific prompt templates and exercising caution when drawing parallels between human behavior and LLMs.

Amplifying the Anomaly: How Humans Choose Unproven Options and Large Language Models Avoid Them

Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking

Creativity Has Left the Chat: The Price of Debiasing Language Models

Divergent Creativity in Humans and Large Language Models

On the Creativity of Large Language Models

Characterising the Creative Process in Humans and Large Language Models

The Creative Frontier of Generative AI: Managing the Novelty-Usefulness Tradeoff

Steering Large Language Models to Evaluate and Amplify Creativity

Homogenization Effects of Large Language Models on Human Creative Ideation

Fluid Transformers and Creative Analogies: Exploring Large Language Models' Capacity for Augmenting Cross-Domain Analogical Creativity

Hallucinations or Attention Misdirection? The Path to Strategic Value Extraction in Business Using Large Language Models

Large Language Models show both individual and collective creativity comparable to humans

The Language of Creativity: Evidence from Humans and Large Language Models

Explaining Large Language Models Decisions Using Shapley Values

Less Likely Brainstorming: Using Language Models to Generate Alternative Hypotheses

Generative AI enhances individual creativity but reduces the collective diversity of novel content

Unravelling the Mysteries of Hallucination in Large Language Models: Strategies for Precision in Artificial Intelligence Language Generation

Alien Recombination: Exploring Concept Blends Beyond Human Cognitive Availability in Visual Art

Large Language Models Assume People are More Rational than We Really are

Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization Function

Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solve