Abstract:Objectives: Adverse drug reactions (ADRs) are believed to be a leading cause of death in the world. Pharmacovigilance systems are aimed at early detection of ADRs. With the popularity of social media, Web forums and discussion boards become important sources of data for consumers to shake their drug use experience, as a result may provide useful information on drugs and their adverse reactions. In this study, we propose an automated ADR related posts filtering mechanism using text classification methods. In real-life settings, ADR related messages are highly distributed in social media, while non-ADR related messages are unspecific and topically diverse. It is expensive to manually label a large amount of ADR related messages (positive examples) and non-ADR related messages (negative examples) to train classification systems. To mitigate this challenge, we examine the use of a partially supervised learning classification method to automate the process.Methods: We propose a novel pharmacovigilance system leveraging a Latent Dirichlet Allocation modeling module and a partially supervised classification approach. We select drugs with more than 500 threads of discussion, and collect all the original posts and comments of these drugs using an automatic Web spidering program as the text corpus. Various classifiers were trained by varying the number of positive examples and the number of topics. The trained classifiers were applied to 3000 posts published over 60 days. Top-ranked posts from each classifier were pooled and the resulting set of 300 posts was reviewed by a domain expert to evaluate the classifiers.Results: Compare to the alternative approaches Using supervised learning methods and three general purpose partially supervised learning methods, our approach performs significantly better in terms of precision, recall, and the F measure (the harmonic mean of precision and recall), based on a computational experiment using online discussion threads from Medhelp.Conclusions: Our design provides satisfactory performance in identifying ADR related posts for post-marketing drug surveillance. The overall design of our system also points out a potentially fruitful direction for building other early warning systems that need to filter big data from social media networks. (C) 2015 Elsevier Inc. All rights reserved.

Application of Stratification Analysis in Adverse Drug Reaction Signal Detection

Application of Association Rules Analysis in Mining Adverse Drug Reaction Signals

Application of Data Mining Algorithm to Detect Adverse Drug Reaction Signal

Research progress in adverse drug reaction signal detection methods based on spontaneous reporting system

Establishment of quantitative signal detection system on adverse drug reaction spontaneous reporting database of Shanghai

Filtering Big Data from Social Media - Building an Early Warning System for Adverse Drug Reactions

Drug Safety Signal Detection in a Regional Healthcare Database Using the Tree-Based Scan Statistic and Comparison to 3 Other Mining Methods

Detection of cluster adverse drug events in the spontaneous reporting system of China using a disproportionality filter algorithm

Detecting high-quality signals of adverse drug-drug interactions from spontaneous reporting data

Establishment of a Rapid Identification of Adverse Drug Reaction Program in R Language Implementation Based on Monitoring Data

Study of Serious Adverse Drug Reactions Using FDA-approved Drug Labeling and MedDRA

An Improved Algorithm for ADR Signal Detection and Its Application to Shanghai Spontaneous ADR Reporting System

Detecting Potential Serious Adverse Drug Reactions Using Sequential Pattern Mining Method

Data mining techniques for detecting signals of adverse drug reaction of cardiac therapy drugs based on Jinan adverse event reporting system database: a retrospective study

Risk Factor Analysis and Discrimination of Adverse Drug Reactions to Ibuprofen

Propensity score‐adjusted three‐component mixture model for drug‐drug interaction data mining in FDA Adverse Event Reporting System

Comparison of Data Mining Methods for the Signal Detection of Adverse Drug Events with a Hierarchical Structure in Postmarketing Surveillance

Analysis on the Adverse Drug Reaction Signal and Its Impact Factors Induced by Oral Hypoglycemic Agents

Development of a drug risk analysis and assessment system and its application in signal excavation and analysis of 263 cases of fluoroquinolone-induced adverse reactions

Common Signal Detection Methods of Adverse Drug Reaction

Adverse Drug Reaction Related Post Detecting Using Sentiment Feature