Abstract:Background. Medication nonadherence represents a major burden on national health systems. According to the World Health Organization, increasing medication adherence may have a greater impact on public health than any improvement in specific medical treatments. More research is needed to better predict populations at risk of medication nonadherence. Objective. To develop clinically informative, easy-to-interpret machine learning classifiers to predict people with psychiatric disorders at risk of medication nonadherence based on the syntactic and structural features of written posts on health forums. Methods. All data were collected from posts between 2016 and 2021 on mental health forum, administered by Together 4 Change, a long-running not-for-profit organisation based in Oxford, UK. The original social media data were annotated using the Tool for the Automatic Analysis of Syntactic Sophistication and Complexity (TAASSC) system. Through applying multiple feature optimisation techniques, we developed a best-performing model using relevance vector machine (RVM) for the probabilistic prediction of medication nonadherence among online mental health forum discussants. Results. The best-performing RVM model reached a mean AUC of 0.762, accuracy of 0.763, sensitivity of 0.779, and specificity of 0.742 on the testing dataset. It outperformed competing classifiers with more complex feature sets with statistically significant improvement in sensitivity and specificity, after adjusting the alpha levels with Benjamini-Hochberg correction procedure. Discussion. We used the forest plot of multiple logistic regression to explore the association between written post features in the best-performing RVM model and the binary outcome of medication adherence among online post contributors with psychiatric disorders. We found that increased quantities of 3 syntactic complexity features were negatively associated with psychiatric medication adherence: "dobj_stdev " (standard deviation of dependents per direct object of nonpronouns) (OR, 1.486, 95% CI, 1.202-1.838, P < 0.001), "cl_av_deps " (dependents per clause) (OR, 1.597, 95% CI, 1.202-2.122, P, 0.001), and "VP_T " (verb phrases per T-unit) (OR, 2.23, 95% CI, 1.211-4.104, P, 0.010). Finally, we illustrated the clinical use of the classifier with Bayes' monograph which gives the posterior odds and their 95% CI of positive (nonadherence) versus negative (adherence) cases as predicted by the best-performing classifier. The odds ratio of the posterior probability of positive cases was 3.9, which means that around 10 in every 13 psychiatric patients with a positive result as predicted by our model were following their medication regime. The odds ratio of the posterior probability of true negative cases was 0.4, meaning that around 10 in every 14 psychiatric patients with a negative test result after screening by our classifier were not adhering to their medications. Conclusion. Psychiatric medication nonadherence is a large and increasing burden on national health systems. Using Bayesian machine learning techniques and publicly accessible online health forum data, our study illustrates the viability of developing cost-effective, informative decision aids to support the monitoring and prediction of patients at risk of medication nonadherence.

Bayesian model selection in logistic regression for the detection of adverse drug reactions

Combining a Pharmacological Network Model with a Bayesian Signal Detection Algorithm to Improve the Detection of Adverse Drug Events

A Bayesian generating function approach to adverse drug reaction screening

Principled Drug-Drug Interaction Terms for Bayesian Logistic Regression Models of Drug Safety in Oncology Phase I Combination Trials

Dealing with adverse drug reactions in the context of polypharmacy using regression models

A Bayesian neural network method for adverse drug reaction signal generation

An Exposure Model Framework for Signal Detection based on Electronic Healthcare Data

Multivariate generalized mixed-effects models for screening multiple adverse drug reactions in spontaneous reporting systems

A Bayesian method to detect drug‐drug interaction using external information for spontaneous reporting system

Fast selection of nonlinear mixed effect models using penalized likelihood

Identifying Drug-Drug Interactions in Spontaneous Reports Utilizing Signal Detection and Biological Plausibility Aspects

Application of Bayesian Instrumental Variable in Active Surveillance Data of Adverse Drug Reactions:a Simulation Study

Bayesian Multivariate Logistic Regression for Superiority and Inferiority Decision-Making under Observable Treatment Heterogeneity

A Supervised Adverse Drug Reaction Signalling Framework Imitating Bradford Hill's Causality Considerations

Probabilistic Prediction of Nonadherence to Psychiatric Disorder Medication from Mental Health Forum Data: Developing and Validating Bayesian Machine Learning Classifiers.

Bayesian Inference for Generalized Linear Mixed Models with Predictors Subject to Detection Limits: an Approach That Leverages Information from Auxiliary Variables.

Adverse Subpopulation Regression for Multivariate Outcomes with High-Dimensional Predictors

ConvSCCS: convolutional self-controlled case series model for lagged adverse event detection

RETRACTED: Probabilistic Prediction of Nonadherence to Psychiatric Disorder Medication from Mental Health Forum Data: Developing and Validating Bayesian Machine Learning Classifiers (retracted Article)

Bayesian modelling for binary outcomes in the Regression Discontinuity Design

Measuring Adverse Drug Effects on Multimorbity using Tractable Bayesian Networks