Abstract:This study investigates the phenomena of semantic drift through the lenses of language and situated simulation (LASS) and the word frequency effect (WFE) within a timed word association task. Our primary objectives were to determine whether semantic drift can be identified over the short time (25 seconds) of a free word association task (a predicted corollary of LASS), and whether more frequent terms are generated earlier in the process (as expected due to the WFE). Respondents were provided with five cue words (tree, dog, quality, plastic and love), and asked to write as many associations as they could. We hypothesized that terms generated later in the task (fourth time quartile, the last 19-25 seconds) would be semantically more distant (cosine similarity) from the cue word than those generated earlier (first quartile, the first 1-7 seconds), indicating semantic drift. Additionally, we explored the WFE by hypothesizing that earlier generated words would be more frequent and less diverse. Utilizing a dataset matched with GloVe 300B word embeddings, BERT and WordNet synsets, we analysed semantic distances among 1569 unique term pairs for all cue words across time. Our results supported the presence of semantic drift, with significant evidence of within-participant, semantic drift from the first to fourth time (LASS) and frequency (WFE) quartiles. In terms of the WFE, we observed a notable decrease in the diversity of terms generated earlier in the task, while more unique terms (greater diversity and relative uniqueness) were generated in the 4th time quartile, aligning with our hypothesis that more frequently used words dominate early stages of a word association task. We also found that the size of effects varied substantially across cues, suggesting that some cues might invoke stronger and more idiosyncratic situated simulations. Theoretically, our study contributes to the understanding of LASS and the WFE. It suggests that semantic drift might serve as a scalable indicator of the invocation of language versus simulation systems in LASS and might also be used to explore cognition within word association tasks more generally. The findings also add a temporal and relational dimension to the WFE. Practically, our research highlights the utility of word association tasks in understanding semantic drift and the diffusion of word usage over a sub-minute task, arguably the shortest practically feasible timeframe, offering a scalable method to explore group and individual changes in semantic relationships, whether via the targeted diffusion of influence in a marketing campaign, or seeking to understand differences in cognition more generally. Possible practical uses and opportunities for future research are discussed.

Where Divergent Ideas Converge: Answers to AUT Found on Short List of Word Co-Occurrences Terms

Natural Language Processing Algorithms for Divergent Thinking Assessment

Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints

Automating creativity assessment with SemDis: An open platform for computing semantic distance

Multilingual semantic distance: Automatic verbal creativity assessment in many languages.

Probing the Creativity of Large Language Models: Can models produce divergent semantic association?

Automatic assessment of divergent thinking in Chinese language with TransDis: A transformer-based language model approach

On the role of creativity in the formation of new complex words

Sparking creativity: Encouraging creative idea generation through automatically generated word recommendations

A Comparison Study of Human and Machine-Generated Creativity

Divergent Creativity in Humans and Large Language Models

The Language of Creativity: Evidence from Humans and Large Language Models

Divergent semantic integration (DSI): Extracting creativity from narratives with distributional semantic modeling

Beyond Openness: A Variety of Creative Experiences Increases Flexibility and Originality of Visuospatial Divergent Thinking

Creative Connections: Computational Semantic Distance Captures Individual Creativity and Resting-State Functional Connectivity

Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking

Large Language Models are Fixated by Red Herrings: Exploring Creative Problem Solving and Einstellung Effect using the Only Connect Wall Dataset

Automated Scoring of Scientific Creativity in German

Missed Connections: Lateral Thinking Puzzles for Large Language Models

Keystrokes: A practical exploration of semantic drift in timed word association tasks

Putting GPT-3's Creativity to the (Alternative Uses) Test