Abstract:Background: Data from the social media platform X (formerly Twitter) can provide insights into the types of language that are used when discussing drug use. In past research using latent Dirichlet allocation (LDA), we found that tweets containing "street names" of prescription drugs were difficult to classify due to the similarity to other colloquialisms and lack of clarity over how the terms were used. Conversely, "brand name" references were more amenable to machine-driven categorization. Objective: This study sought to use next-generation techniques (beyond LDA) from natural language processing to reprocess X data and automatically cluster groups of tweets into topics to differentiate between street- and brand-name data sets. We also aimed to analyze the differences in emotional valence between the 2 data sets to study the relationship between engagement on social media and sentiment. Methods: We used the Twitter application programming interface to collect tweets that contained the street and brand name of a prescription drug within the tweet. Using BERTopic in combination with Uniform Manifold Approximation and Projection and k-means, we generated topics for the street-name corpus (n=170,618) and brand-name corpus (n=245,145). Valence Aware Dictionary and Sentiment Reasoner (VADER) scores were used to classify whether tweets within the topics had positive, negative, or neutral sentiments. Two different logistic regression classifiers were used to predict the sentiment label within each corpus. The first model used a tweet's engagement metrics and topic ID to predict the label, while the second model used those features in addition to the top 5000 tweets with the largest term-frequency-inverse document frequency score. Results: Using BERTopic, we identified 40 topics for the street-name data set and 5 topics for the brand-name data set, which we generalized into 8 and 5 topics of discussion, respectively. Four of the general themes of discussion in the brand-name corpus referenced drug use, while 2 themes of discussion in the street-name corpus referenced drug use. From the VADER scores, we found that both corpora were inclined toward positive sentiment. Adding the vectorized tweet text increased the accuracy of our models by around 40% compared with the models that did not incorporate the tweet text in both corpora. Conclusions: BERTopic was able to classify tweets well. As with LDA, the discussion using brand names was more similar between tweets than the discussion using street names. VADER scores could only be logically applied to the brand-name corpus because of the high prevalence of non-drug-related topics in the street-name data. Brand-name tweets either discussed drugs positively or negatively, with few posts having a neutral emotionality. From our machine learning models, engagement alone was not enough to predict the sentiment label; the added context from the tweets was needed to understand the emotionality of a tweet.

Enabling Semantic Topic Modeling on Twitter Using MetaMap

Integrating Social and Auxiliary Semantics for Multifaceted Topic Modeling in Twitter.

Enhanced Short Text Modeling: Leveraging Large Language Models for Topic Refinement

A Semantic Embedding Enhanced Topic Model for User-Generated Textual Content Modeling in Social Ecosystems

A Topic Modeling Comparison Between LDA, NMF, Top2Vec, and BERTopic to Demystify Twitter Posts

Automatic Labelling Of Topic Models Learned From Twitter By Summarisation

Incorporating Social Role Theory into Topic Models for Social Media Content Analysis.

A systematic review of the use of topic models for short text social media analysis

A Joint Model of Conversational Discourse and Latent Topics on Microblogs

A hybrid deep learning method for identifying topics in large-scale urban text data: Benefits and trade-offs

Evaluation of the Optimal Topic Classification for Social Media Data Combined with Text Semantics: A Case Study of Public Opinion Analysis Related to COVID-19 with Microblogs

Discovering Mental Health Research Topics with Topic Modeling

An integrated latent Dirichlet allocation and Word2vec method for generating the topic evolution of mental models from global to local

Detecting Global and Local Topics Via Mining Twitter Data

Predicting the topic influence trends in social media with multiple models

An Improved Latent Dirichlet Allocation Model for Hot Topic Extraction

Digital Epidemiology of Prescription Drug References on X (Formerly Twitter): Neural Network Topic Modeling and Sentiment Analysis

Short Text Topic Modeling: Application to tweets about Bitcoin

Multilingual Topic Classification in X: Dataset and Analysis

Using Topic Modeling Methods for Short-Text Data: A Comparative Analysis

Hybrid Semantic Analysis for Mapping Adverse Drug Reaction Mentions in Tweets to Medical Terminology