Abstract:Trial monitoring is an important component of good clinical practice to ensure the safety and rights of study participants, confidentiality of personal information, and quality of data. However, the effectiveness of various existing monitoring approaches is unclear. Information to guide the choice of monitoring methods in clinical intervention studies may help trialists, support units, and monitors to effectively adjust their approaches to current knowledge and evidence. To evaluate the advantages and disadvantages of different monitoring strategies (including risk‐based strategies and others) for clinical intervention studies examined in prospective comparative studies of monitoring interventions. We systematically searched CENTRAL, PubMed, and Embase via Ovid for relevant published literature up to March 2021. We searched the online 'Studies within A Trial' (SWAT) repository, grey literature, and trial registries for ongoing or unpublished studies. We included randomized or non‐randomized prospective, empirical evaluation studies of different monitoring strategies in one or more clinical intervention studies. We applied no restrictions for language or date of publication. We extracted data on the evaluated monitoring methods, countries involved, study population, study setting, randomization method, and numbers and proportions in each intervention group. Our primary outcome was critical and major monitoring findings in prospective intervention studies. Monitoring findings were classified according to different error domains (e.g. major eligibility violations) and the primary outcome measure was a composite of these domains. Secondary outcomes were individual error domains, participant recruitment and follow‐up, and resource use. If we identified more than one study for a comparison and outcome definitions were similar across identified studies, we quantitatively summarized effects in a meta‐analysis using a random‐effects model. Otherwise, we qualitatively summarized the results of eligible studies stratified by different comparisons of monitoring strategies. We used the GRADE approach to assess the certainty of the evidence for different groups of comparisons. We identified eight eligible studies, which we grouped into five comparisons. 1. Risk‐based versus extensive on‐site monitoring: based on two large studies, we found moderate certainty of evidence for the combined primary outcome of major or critical findings that risk‐based monitoring is not inferior to extensive on‐site monitoring. Although the risk ratio was close to 'no difference' (1.03 with a 95% confidence interval [CI] of 0.81 to 1.33, below 1.0 in favor of the risk‐based strategy), the high imprecision in one study and the small number of eligible studies resulted in a wide CI of the summary estimate. Low certainty of evidence suggested that monitoring strategies with extensive on‐site monitoring were associated with considerably higher resource use and costs (up to a factor of 3.4). Data on recruitment or retention of trial participants were not available. 2. Central monitoring with triggered on‐site visits versus regular on‐site visits: combining the results of two eligible studies yielded low certainty of evidence with a risk ratio of 1.83 (95% CI 0.51 to 6.55) in favor of triggered monitoring intervention. Data on recruitment, retention, and resource use were not available. 3. Central statistical monitoring and local monitoring performed by site staff with annual on‐site visits versus central statistical monitoring and local monitoring only: based on one study, there was moderate certainty of evidence that a small number of major and critical findings were missed with the central monitoring approach without on‐site visits: 3.8% of participants in the group without on‐site visits and 6.4% in the group with on‐site visits had a major or critical monitoring finding (odds ratio 1.7, 95% CI 1.1 to 2.7; P = 0.03). The absolute number of monitoring findings was very low, probably because defined major and critical findings were very study specific and central monitoring was present in both intervention groups. Very low certainty of evidence did not suggest a relevant effect on participant retention, and very low certainty evidence indicated an extra cost for on‐site visits of USD 2,035,392. There were no data on recruitment. 4. Traditional 100% source data verification (SDV) versus targeted or remote SDV: the two studies assessing targeted and remote SDV reported findings only related to source documents. Compared to the final database obtained using the full SDV monitoring process, only a small proportion of remaining errors on overall data were identified using the targeted SDV process in the MONITORING study (absolute difference 1.47%, 95% CI 1.41% to 1.53%). Targeted SDV was effective in the verification of source documents, but increased the workload on -Abstract Truncated-

A test for monitoring under- and overtreatment in Dutch hospitals

Overtesting and undertesting in primary care: a systematic review and meta-analysis

Separating the wheat from the chaff: How to measure hospital quality in routine data?

152: A MEASURE FOR ESTIMATING THE MAGNITUDE OF UNNECESSARY OVERTREATMENT, OVER TESTING AND OVER PREVENTING

Assessment of Overuse of Medical Tests and Treatments at US Hospitals Using Medicare Claims

Detecting critical treatment effect bias in small subgroups

A Multicenter Before-After Study on Reducing Unnecessary Diagnostics by Changing the Attitude of Caregivers: Protocol for the RODEO Project

Monitoring strategies for clinical intervention studies.

The landscape of inappropriate laboratory testing: a 15-year meta-analysis

Evaluation of adaptive treatment strategies in an observational study where time-varying covariates are not monitored systematically

Between-hospital variation in indicators of quality of care: a systematic review

Determining the Extent and Frequency of On-Site Monitoring: a Bayesian Risk-Based Approach

Reducing Care Overuse in Older Patients Using Professional Norms and Accountability

Measuring Adverse Events in Hospitalized Patients: An Administrative Method for Measuring Harm

Pitfalls in the Assessment, Analysis, and Interpretation of Routine Outcome Monitoring (ROM) Data: Results from an Outpatient Clinic for Integrative Mental Health

Time-consuming and Expensive Data Quality Monitoring Procedures Persist in Clinical Trials: A National Survey.

Reliability and Validity of the New Urgency Classification Model for Acute Medical Care in Dutch Nursing Home Setting

Organizing to address overtreatment in cancer care near the end of life: Evidence from Denmark

Clinical Decision-Making Suffers from Inequivalent Measurement Results and Inadequate Reference Intervals

A pragmatic approach to estimating average treatment effects from EHR data: the effect of prone positioning on mechanically ventilated COVID-19 patients

Prediction under interventions: evaluation of counterfactual performance using longitudinal observational data