Abstract:Objectives: Adverse drug reactions (ADRs) are believed to be a leading cause of death in the world. Pharmacovigilance systems are aimed at early detection of ADRs. With the popularity of social media, Web forums and discussion boards become important sources of data for consumers to shake their drug use experience, as a result may provide useful information on drugs and their adverse reactions. In this study, we propose an automated ADR related posts filtering mechanism using text classification methods. In real-life settings, ADR related messages are highly distributed in social media, while non-ADR related messages are unspecific and topically diverse. It is expensive to manually label a large amount of ADR related messages (positive examples) and non-ADR related messages (negative examples) to train classification systems. To mitigate this challenge, we examine the use of a partially supervised learning classification method to automate the process.Methods: We propose a novel pharmacovigilance system leveraging a Latent Dirichlet Allocation modeling module and a partially supervised classification approach. We select drugs with more than 500 threads of discussion, and collect all the original posts and comments of these drugs using an automatic Web spidering program as the text corpus. Various classifiers were trained by varying the number of positive examples and the number of topics. The trained classifiers were applied to 3000 posts published over 60 days. Top-ranked posts from each classifier were pooled and the resulting set of 300 posts was reviewed by a domain expert to evaluate the classifiers.Results: Compare to the alternative approaches Using supervised learning methods and three general purpose partially supervised learning methods, our approach performs significantly better in terms of precision, recall, and the F measure (the harmonic mean of precision and recall), based on a computational experiment using online discussion threads from Medhelp.Conclusions: Our design provides satisfactory performance in identifying ADR related posts for post-marketing drug surveillance. The overall design of our system also points out a potentially fruitful direction for building other early warning systems that need to filter big data from social media networks. (C) 2015 Elsevier Inc. All rights reserved.

Detecting Potential Serious Adverse Drug Reactions Using Sequential Pattern Mining Method

Study of Serious Adverse Drug Reactions Using FDA-approved Drug Labeling and MedDRA

Identification of Adverse Drug Events in Chinese Clinical Narrative Text

Application of Data Mining Algorithm to Detect Adverse Drug Reaction Signal

Application of Association Rules Analysis in Mining Adverse Drug Reaction Signals

Mining Real-World Big Data to Characterize Adverse Drug Reaction Quantitatively: Mixed Methods Study

Detecting Potential Adverse Drug Reactions Using Association Rules and Embedding Models.

A Comparison Of Methods Of Data Mining Algorithms Directed Predictive Pharmacosafety Networks For Adverse Drug Event Detection

Causality Patterns for Detecting Adverse Drug Reactions From Social Media: Text Mining Approach

A method for systematic discovery of adverse drug events from clinical notes.

Establishment of a Rapid Identification of Adverse Drug Reaction Program in R Language Implementation Based on Monitoring Data

Exploration of the Association Rules Mining Technique for the Signal Detection of Adverse Drug Events in Spontaneous Reporting Systems

Detecting Potential Adverse Drug Reactions from Health-Related Social Networks

A Survey on Computational Approaches to Predicting Adverse Drug Reactions.

Developing A Deep Learning Natural Language Processing Algorithm For Automated Reporting Of Adverse Drug Reactions

Filtering Big Data from Social Media - Building an Early Warning System for Adverse Drug Reactions

Towards Large-scale Twitter Mining for Drug-related Adverse Events.

Comparison of Data Mining Methods for the Signal Detection of Adverse Drug Events with a Hierarchical Structure in Postmarketing Surveillance

Changing paradigms in detecting rare adverse drug reactions: from disproportionality analysis, old and new, to machine learning

Application of Data Mining Algorithms in Pharmacovigilance

Interactive crowdsourcing to spontaneous reporting of Adverse Drug Reactions