Abstract:Abstract This article proposes a comprehensive strategy for training, evaluating, and optimizing domain-specific word2vec-based word embeddings, using social science literature as an example. Our primary objectives are: (1) to train the embeddings utilizing a corpus of social science text, (2) to test their performance against domain-unspecific embeddings using our developed intrinsic and extrinsic evaluation strategy, and (3) to enhance their performance even further by using domain knowledge. As an integral part of this approach, we present SociRel-461 , a domain-knowledge dictionary designed for the intrinsic evaluation and subsequent refinement of social science word embeddings. Using a dataset of 100,000 full-text scientific articles in sociology, we train multiple vector space models, which we then benchmark against a larger, pre-trained general language embedding model as part of our extrinsic evaluation. Furthermore, we developed a transfer learning multi-label classification task for extrinsic evaluation. Our findings reveal that domain-specific embeddings outperform their domain-unspecific counterparts in both intrinsic and extrinsic evaluations. We also investigated the retrofitting post-processing method to enhance domain-unspecific embeddings with the domain knowledge embedded in SociRel-461 . While retrofitting does not enhance our domain-specific vector space models, it significantly improves the performance of the domain-unspecific embeddings. This highlights the potential of retrofitting for the transfer of domain knowledge to domain-unspecific embeddings. Our results emphasize the importance of utilizing domain-specific word embeddings for better performance in domain specific transfer learning tasks, as they outperform conventional embeddings trained on everyday language.

Socialized Word Embeddings.

Enhanced Double-Carrier Word Embedding Via Phonetics and Writing

Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings

Personalized word representations Carrying Personalized Semantics Learned from Social Network Posts

Cross-media User Profiling with Joint Textual and Social User Embedding.

Social Rank Regulated Large-scale Network Embedding

Visual Exploration and Comparison of Word Embeddings.

Do We Trust What They Say or What They Do? A Multimodal User Embedding Provides Personalized Explanations

User Profile Preserving Social Network Embedding

SocialVec: Social Entity Embeddings

Word Embeddings to Enhance Twitter Gang Member Profile Identification

Learning Chinese Word Embeddings from Stroke, Structure and Pinyin of Characters

BioWordVec, improving biomedical word embeddings with subword information and MeSH

Advancing language models through domain knowledge integration: a comprehensive approach to training, evaluation, and optimization of social scientific neural word embeddings

A Primer on Word Embeddings: AI Techniques for Text Analysis in Social Work

Enriching Word Embeddings with Temporal and Spatial Information

Mixed Membership Word Embeddings for Computational Social Science

Exploring the Value of Personalized Word Embeddings

Utility of General and Specific Word Embeddings for Classifying Translational Stages of Research

Word Embedding for Social Sciences: An Interdisciplinary Survey