Abstract:Abstract This article proposes a comprehensive strategy for training, evaluating, and optimizing domain-specific word2vec-based word embeddings, using social science literature as an example. Our primary objectives are: (1) to train the embeddings utilizing a corpus of social science text, (2) to test their performance against domain-unspecific embeddings using our developed intrinsic and extrinsic evaluation strategy, and (3) to enhance their performance even further by using domain knowledge. As an integral part of this approach, we present SociRel-461 , a domain-knowledge dictionary designed for the intrinsic evaluation and subsequent refinement of social science word embeddings. Using a dataset of 100,000 full-text scientific articles in sociology, we train multiple vector space models, which we then benchmark against a larger, pre-trained general language embedding model as part of our extrinsic evaluation. Furthermore, we developed a transfer learning multi-label classification task for extrinsic evaluation. Our findings reveal that domain-specific embeddings outperform their domain-unspecific counterparts in both intrinsic and extrinsic evaluations. We also investigated the retrofitting post-processing method to enhance domain-unspecific embeddings with the domain knowledge embedded in SociRel-461 . While retrofitting does not enhance our domain-specific vector space models, it significantly improves the performance of the domain-unspecific embeddings. This highlights the potential of retrofitting for the transfer of domain knowledge to domain-unspecific embeddings. Our results emphasize the importance of utilizing domain-specific word embeddings for better performance in domain specific transfer learning tasks, as they outperform conventional embeddings trained on everyday language.

Theoretical foundations and limits of word embeddings: what types of meaning can they capture?

Cultural cartography with word embeddings

The Geometry of Culture: Analyzing Meaning through Word Embeddings

A Primer on Word Embeddings: AI Techniques for Text Analysis in Social Work

Identification, Interpretability, and Bayesian Word Embeddings

Word embedding analysis on colonial history, present issues, and optimism toward the future in Senegal

The Expressive Power of Word Embeddings

Word Embedding for Social Sciences: An Interdisciplinary Survey

Do Word Embeddings Really Understand Loughran-McDonald's Polarities?

Analyzing the Surprising Variability in Word Embedding Stability Across Languages

Simple dynamic word embeddings for mapping perceptions in the public sphere

The principal components of meaning, revisited

What company do words keep? Revisiting the distributional semantics of J.R. Firth & Zellig Harris

Word-Embeddings Distinguish Denominal and Root-Derived Verbs in Semitic

Measuring the Meaning of Words in Contexts: An automated analysis of controversies about Monarch butterflies, Frankenfoods, and stem cells

Diachronic Synonymy and Polysemy: Exploring Dynamic Relation Between Forms and Meanings of Words Based on Word Embeddings

A Survey On Neural Word Embeddings

Contextualized Word Embeddings Encode Aspects of Human-Like Word Sense Knowledge

Analogies minus analogy test: measuring regularities in word embeddings

Enriching Word Embeddings with Temporal and Spatial Information

Advancing language models through domain knowledge integration: a comprehensive approach to training, evaluation, and optimization of social scientific neural word embeddings