Abstract:Abstract Creativity research requires assessing the quality of ideas and products. In practice, conducting creativity research often involves asking several human raters to judge participants’ responses to creativity tasks, such as judging the novelty of ideas from the alternate uses task (AUT). Although such subjective scoring methods have proved useful, they have two inherent limitations—labor cost (raters typically code thousands of responses) and subjectivity (raters vary on their perceptions and preferences)—raising classic psychometric threats to reliability and validity. We sought to address the limitations of subjective scoring by capitalizing on recent developments in automated scoring of verbal creativity via semantic distance, a computational method that uses natural language processing to quantify the semantic relatedness of texts. In five studies, we compare the top performing semantic models (e.g., GloVe, continuous bag of words) previously shown to have the highest correspondence to human relatedness judgements. We assessed these semantic models in relation to human creativity ratings from a canonical verbal creativity task (AUT; Studies 1–3) and novelty/creativity ratings from two word association tasks (Studies 4–5). We find that a latent semantic distance factor—comprised of the common variance from five semantic models—reliably and strongly predicts human creativity and novelty ratings across a range of creativity tasks. We also replicate an established experimental effect in the creativity literature (i.e., the serial order effect) and show that semantic distance correlates with other creativity measures, demonstrating convergent validity. We provide an open platform to efficiently compute semantic distance, including tutorials and documentation ( https://osf.io/gz4fc/ ).

Augmenting Creativity using Generative AI: The Method of Trisociation

How Generative AI Can Augment Human Creativity

Supermind Ideator: Exploring generative AI to support creative problem-solving

Creativity in the age of generative AI

Artificial Intelligence-Augmented Brainstorming: How Humans and Ai Beat Humans Alone

AutoTRIZ: Artificial Ideation with TRIZ and Large Language Models

Enhancing Creativity in Large Language Models through Associative Thinking Strategies

A Mathematical Model to Enhance Creativity in Generative AI Systems

Divergent semantic integration (DSI): Extracting creativity from narratives with distributional semantic modeling

Human-AI Co-Creativity: Exploring Synergies Across Levels of Creative Collaboration

Goetterfunke: Creativity in Machinae Sapiens. About the Qualitative Shift in Generative AI with a Focus on Text-To-Image

Divergent Creativity in Humans and Large Language Models

Rapid AIdeation: Generating Ideas With the Self and in Collaboration With Large Language Models

The Effects of Generative AI on Design Fixation and Divergent Thinking

A foundation model enhanced approach for generative design in combinational creativity

Alien Recombination: Exploring Concept Blends Beyond Human Cognitive Availability in Visual Art

Design Contradictions: Help or Hindrance?

Automating creativity assessment with SemDis: An open platform for computing semantic distance

Augmenting Minds or Automating Skills: The Differential Role of Human Capital in Generative AI's Impact on Creative Tasks

"Who" Is the Best Creative Thinking Partner? An Experimental Investigation of Human–Human, Human–Internet, and Human–AI Co‐Creation

Creativity in AI: Progresses and Challenges