Abstract:Background: Adverse events (AEs) in clinical trials may be reported in multiple sources. Different methods for reporting adverse events across trials or across sources for a single trial may produce inconsistent information about the adverse events associated with interventions. Methods: We compared the methods authors use to decide which AEs to include in a particular source (i.e., "selection criteria"), including the number of different types of AEs reported (i.e., rather than the number of events). We compared sources (e.g., journal articles, clinical study reports (CSRs)) of trials for two drug-indications-gabapentin for neuropathic pain and quetiapine for bipolar depression. Electronic searches were completed in 2015. We identified selection criteria and assessed how criteria affected AE reporting. Results: We identified 21 gabapentin and 7 quetiapine trials. We found 6 gabapentin CSRs and 2 quetiapine CSRs, all written by drug manufacturers. All CSRs reported all AEs without applying selection criteria; by comparison, no other source reported all AEs, and 15/68 (22%) gabapentin sources and 19/48 (40%) quetiapine sources reported using selection criteria. Selection criteria greatly affected the number of AEs reported. For example, 67/316 (21%) AEs in one quetiapine trial met the criterion "occurring in ≥2% of participants in any treatment group," while only 5/316 (2%) AEs met the criterion "occurring in ≥10% of quetiapine-treated patients and twice as frequent in the quetiapine group as the placebo group." Conclusions: Selection criteria for reporting AEs vary across trials and across sources for individual trials. If investigators do not pre-specify selection criteria, they might "cherry-pick" AEs based on results. Even if investigators pre-specify selection criteria, selective reporting will produce biased meta-analyses and clinical practice guidelines. Data about all AEs identified in clinical trials should be publicly available; however, sharing data will not solve all the problems identified in this study.

Adverse events in single-arm clinical trials with non-fatal time-to-event efficacy endpoint: from clinical questions to methods for statistical analysis

On estimands and the analysis of adverse events in the presence of varying follow-up times within the benefit assessment of therapies

Eliciting adverse effects data from participants in clinical trials.

Adversity Index for Clinical Trials: An Inclusive Approach for Analysis of Safety Data

Statistical methods leveraging the hierarchical structure of adverse events for signal detection in clinical trials: a scoping review of the methodological literature

Survival analysis for AdVerse events with VarYing follow-up times (SAVVY) -- comparison of adverse event risks in randomized controlled trials

Evaluating causal effects on time-to-event outcomes in an RCT in Oncology with treatment discontinuation due to adverse events

Survival analysis for AdVerse events with VarYing follow-up times (SAVVY): summary of findings and a roadmap for the future of safety analyses in clinical trials

The "small" clinical trial: Methods, analysis and interpretation in acute care cardiology.

Using Data Augmentation to Facilitate Conduct of Phase I-Ii Clinical Trials with Delayed Outcomes

A comparison of estimation methods adjusting for selection bias in adaptive enrichment designs with time-to-event endpoints

Statistical Monitoring of Safety in Clinical Trials

Estimating and comparing adverse event probabilities in the presence of varying follow-up times and competing events

Meta-analysis of Censored Adverse Events

Improved mortality analysis in early‐phase dose‐ranging clinical trials for emergency medical diseases using Bayesian time‐to‐event models with active comparators

Premarketing Adverse Drug Experiences: Data Management Procedures

Adaptive clinical trial designs with blinded selection of binary composite endpoints and sample size reassessment

Analysis of composite time-to-event endpoints in cardiovascular outcome trials

Critical design considerations for time-to-event endpoints in amyotrophic lateral sclerosis clinical trials

Opportunities for selective reporting of harms in randomized clinical trials: Selection criteria for non-systematic adverse events

Time-to-event estimands and loss to follow-up in oncology in light of the estimands framework