Analyzing Patient Experience on Weibo: Machine Learning Approach to Topic Modeling and Sentiment Analysis

Xiao Chen,Zhiyun Shen,Tingyu Guan,Yuchen Tao,Yichen Kang,Yuxia Zhang

DOI: https://doi.org/10.2196/59249

IF: 3.2

2024-12-01

JMIR Medical Informatics

Abstract:Background: Social media platforms allow individuals to openly gather, communicate, and share information about their interactions with healthcare services, becoming an essential supplemental means of understanding patient experience. Objective: To identify common discussion topics related to healthcare experience from the public's perspective and to determine areas of concern from patients' perspectives that healthcare providers should act. Methods: This study conducted a spatiotemporal analysis of the volume, sentiment, and topic of patient experience related posts on the Weibo platform. We applied a supervised machine learning approach including human annotation and machine learning-based models for topic modelling and sentiment analysis of the public discourse. A multiclassifier voting method based on logistic regression, multinomial naïve Bayes and random forest was used. Results: A total of 4,008 posts were manually classified into patient experience topics. A patient experience theme framework was developed. The accuracy, precision, recall, and F-measure of the method integrating logistic regression, multinomial naïve Bayes and random forest for patient experience themes were 0.93, 0.95, 0.80, 0.77 and 0.84 respectively, indicating a satisfactory prediction. The sentiment analysis revealed that negative sentiment posts constituted the highest proportion (3319/4008, 82.8%). Twenty patient experience themes were discussed on the social media platform. The majority of the posts described the interpersonal aspects of care (73.5%, 2947/4008); the five most frequently discussed topics were "provider attitude", "access to care", "communication, information and education", "technical competence", and "efficacy of treatment". Conclusions: Hospital administrators and clinicians should consider the value of social media and pay attention to what patients and their family members are communicating on social media. To increase the utility of these data, a machine learning algorithm can be used for topic modelling. The results of this study highlighted the interpersonal and functional aspects of care, especially the interpersonal aspects, which are often the "moment of truth" during a service encounter in which patients make a critical evaluation of hospital services.

medical informatics