Abstract:Abstract Background In a pandemic setting, it is critical to evaluate and deploy accurate diagnostic tests rapidly. This relies heavily on the sample size chosen to assess the test accuracy (e.g. sensitivity and specificity) during the diagnostic accuracy study. Too small a sample size will lead to imprecise estimates of the accuracy measures, whereas too large a sample size may delay the development process unnecessarily. This study considers use of a Bayesian method to guide sample size determination for diagnostic accuracy studies, with application to COVID-19 rapid viral detection tests. Specifically, we investigate whether utilising existing information (e.g. from preceding laboratory studies) within a Bayesian framework can reduce the required sample size, whilst maintaining test accuracy to the desired precision. Methods The method presented is based on the Bayesian concept of assurance which, in this context, represents the unconditional probability that a diagnostic accuracy study yields sensitivity and/or specificity intervals with the desired precision. We conduct a simulation study to evaluate the performance of this approach in a variety of COVID-19 settings, and compare it to commonly used power-based methods. An accompanying interactive web application is available, which can be used by researchers to perform the sample size calculations. Results Results show that the Bayesian assurance method can reduce the required sample size for COVID-19 diagnostic accuracy studies, compared to standard methods, by making better use of laboratory data, without loss of performance. Increasing the size of the laboratory study can further reduce the required sample size in the diagnostic accuracy study. Conclusions The method considered in this paper is an important advancement for increasing the efficiency of the evidence development pathway. It has highlighted that the trade-off between lab study sample size and diagnostic accuracy study sample size should be carefully considered, since establishing an adequate lab sample size can bring longer-term gains. Although emphasis is on its use in the COVID-19 pandemic setting, where we envisage it will have the most impact, it can be usefully applied in other clinical areas.

Revisiting sample size planning for receiver operating characteristic studies: A confidence interval approach with precision and assurance

Sample size planning for estimating the global win probability with precision and assurance

A Sample Size Planning Approach That Considers Both Statistical Significance and Clinical Significance

A comparison of confidence/credible interval methods for the area under the ROC curve for continuous diagnostic tests with small sample size

Confidence Intervals for the Probability of Superiority Effect Size Measure and the Area Under a Receiver Operating Characteristic Curve

Practical Sample Size Calculations for Surveillance and Diagnostic Investigations

Sample size estimation in diagnostic test studies of biomedical informatics

Nonparametric Sample Size Estimation for Sensitivity and Specificity with Multiple Observations per Subject

Sample size formulas for estimating intraclass correlation coefficients with precision and assurance

A Bayesian approach on sample size calculation for comparing means.

Review of sample size determination methods for the intraclass correlation coefficient in the one-way analysis of variance model

Nonparametric statistical inference method for partial areas under receiver operating characteristic curves, with application to genomic studies.

Optimal two-phase sampling for comparing correlated areas under the ROC curves of two screening tests in the presence of verification bias

Sample size determination for point-of-care COVID-19 diagnostic tests: a Bayesian approach

Calculation of sample size guaranteeing the required width of the empirical confidence interval with predefined probability

Adaptive sample size re-estimation in MRMC studies

Simultaneous inference for partial areas under receiver operating curves -- with a view towards efficiency

Sample size determination for interval estimation of the prevalence of a sensitive attribute under non‐randomized response models

User's guide to sample size estimation in diagnostic accuracy studies

Semiparametric empirical likelihood confidence intervals for the difference of areas under two correlated ROC curves under density ratio model

A review of Bayesian perspectives on sample size derivation for confirmatory trials