Abstract:Abstract Background In a pandemic setting, it is critical to evaluate and deploy accurate diagnostic tests rapidly. This relies heavily on the sample size chosen to assess the test accuracy (e.g. sensitivity and specificity) during the diagnostic accuracy study. Too small a sample size will lead to imprecise estimates of the accuracy measures, whereas too large a sample size may delay the development process unnecessarily. This study considers use of a Bayesian method to guide sample size determination for diagnostic accuracy studies, with application to COVID-19 rapid viral detection tests. Specifically, we investigate whether utilising existing information (e.g. from preceding laboratory studies) within a Bayesian framework can reduce the required sample size, whilst maintaining test accuracy to the desired precision. Methods The method presented is based on the Bayesian concept of assurance which, in this context, represents the unconditional probability that a diagnostic accuracy study yields sensitivity and/or specificity intervals with the desired precision. We conduct a simulation study to evaluate the performance of this approach in a variety of COVID-19 settings, and compare it to commonly used power-based methods. An accompanying interactive web application is available, which can be used by researchers to perform the sample size calculations. Results Results show that the Bayesian assurance method can reduce the required sample size for COVID-19 diagnostic accuracy studies, compared to standard methods, by making better use of laboratory data, without loss of performance. Increasing the size of the laboratory study can further reduce the required sample size in the diagnostic accuracy study. Conclusions The method considered in this paper is an important advancement for increasing the efficiency of the evidence development pathway. It has highlighted that the trade-off between lab study sample size and diagnostic accuracy study sample size should be carefully considered, since establishing an adequate lab sample size can bring longer-term gains. Although emphasis is on its use in the COVID-19 pandemic setting, where we envisage it will have the most impact, it can be usefully applied in other clinical areas.

Comparing the predictive values of diagnostic tests: sample size and analysis for paired study designs

Statistical Methods for Comparing Predictive Values in Medical Diagnosis

Statistical inference for diagnostic test accuracy studies with multiple comparisons

A Comparative Review of Methods for Comparing Means Using Partially Paired Data

Sample size estimation in diagnostic test studies of biomedical informatics

Medical diagnostic accuracy measures: an innovative approach based on the area under predictive values curves

Nonparametric Sample Size Estimation for Sensitivity and Specificity with Multiple Observations per Subject

Statistical Evaluation of Medical Tests

Statistics in diagnostic medicine

Prediagnostic evaluation of multicancer detection tests: Design and analysis considerations

On the Statistical Testing Methods for Single Laboratory Validation of Qualitative Microbiological Assays with a Paired Design

Estimating sample sizes for continuous, binary, and ordinal outcomes in paired comparisons: practical hints

Hypothesis Test to Compare Two Paired Binomial Proportions: Assessment of 24 Methods

Practical Sample Size Calculations for Surveillance and Diagnostic Investigations

Sample Size Calculation for Comparing Variabilities

Evaluation of Predictive Capacities of Biomarkers Based on Research Synthesis.

Sample size determination for point-of-care COVID-19 diagnostic tests: a Bayesian approach

Assessment of the accuracy of diagnostic tests: the cross-sectional study

A Dunnett-Type Test and Its Sample Size Calculation for Comparing K ROC Curves with a Control

Unconditional Exact Tests for Equivalence or Noninferiority for Paired Binary Endpoints

A Non-Parametric Method for the Comparison of Partial Areas under ROC Curves and Its Application to Large Health Care Data Sets.