The morphogenesis and fate of the nucleolar channel system in the human endometrial glandular cell.

I. More,E. Armstrong,D. McSeveney,W. R. Chatfield

DOI: https://doi.org/10.1016/S0022-5320(74)90027-6

1974-04-01

Journal of Ultrastructure Research

Abstract:

What problem does this paper attempt to address?

Bayesian Updating and Sequential Testing: Overcoming Inferential Limitations of Screening Tests

Jacques Balayla

DOI: https://doi.org/10.48550/arXiv.2006.11641

2020-08-30

Abstract:Bayes' Theorem confers inherent limitations on the accuracy of screening tests as a function of disease prevalence. We have shown in previous work that a testing system can tolerate significant drops in prevalence, up until a certain well-defined point known as the $prevalence$ $threshold$, below which the reliability of a positive screening test drops precipitously. Herein, we establish a mathematical model to determine whether sequential testing overcomes the aforementioned Bayesian limitations and thus improves the reliability of screening tests. We show that for a desired positive predictive value of $\rho$ that approaches $k$, the number of positive test iterations $n_i$ needed is: $ n_i =\lim_{\rho \to k}\left\lceil\frac{ln\left[\frac{\rho(\phi-1)}{\phi(\rho-1)}\right]}{ln\left[\frac{a}{1-b}\right]}\right\rceil$ where $n_i$ = number of testing iterations necessary to achieve $\rho$, the desired positive predictive value, a = sensitivity, b = specificity, $\phi$ = disease prevalence and $k$ = constant. Based on the aforementioned derivation, we provide reference tables for the number of test iterations needed to obtain a $\rho(\phi)$ of 50, 75, 95 and 99$\%$ as a function of various levels of sensitivity, specificity and disease prevalence.

Methodology
Controlling decision errors with minimal costs: The sequential probability ratio t test.

Martin Schnuerch,Edgar Erdfelder

DOI: https://doi.org/10.1037/met0000234

IF: 10.929

2020-04-01

Psychological Methods

Abstract:For several years, the public debate in psychological science has been dominated by what is referred to as the reproducibility crisis. This crisis has, inter alia, drawn attention to the need for proper control of statistical decision errors in testing psychological hypotheses. However, conventional methods of error probability control often require fairly large samples. Sequential statistical tests provide an attractive alternative: They can be applied repeatedly during the sampling process and terminate whenever there is sufficient evidence in the data for one of the hypotheses of interest. Thus, sequential tests may substantially reduce the required sample size without compromising predefined error probabilities. Herein, we discuss the most efficient sequential design, the sequential probability ratio test (SPRT), and show how it is easily implemented for a 2-sample t test using standard statistical software. We demonstrate, by means of simulations, that the SPRT not only reliably controls error probabilities but also typically requires substantially smaller samples than standard t tests and other common sequential designs. Moreover, we investigate the robustness of the SPRT against violations of its assumptions. Finally, we illustrate the sequential t test by applying it to an empirical example and provide recommendations on how psychologists can employ it in their own research to benefit from its desirable properties. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

psychology, multidisciplinary
A class of sequential multi-hypothesis tests

Andrey Novikov

DOI: https://doi.org/10.1080/03610918.2024.2376883

2024-07-15

Communications in Statistics - Simulation and Computation

Abstract:In this article, we deal with sequential testing of multiple hypotheses. In the general scheme of construction of optimal tests based on the backward induction, we propose a modification which provides a simplified (generally speaking, and suboptimal) version of the optimal test, for any particular criterion of optimization. We call this DBC version (the one with Dropped Backward Control) of the optimal test. In particular, for the case of two simple hypotheses, dropping backward control in the Bayesian test produces the classical sequential probability ratio test (SPRT). Similarly, dropping backward control in the modified Kiefer-Weiss solutions produces Lorden's 2-SPRTs. In the case of more than two hypotheses, we obtain in this way new classes of sequential multi-hypothesis tests, and investigate their properties. The efficiency of the DBC-tests is evaluated with respect to the optimal Bayesian multi-hypothesis test and with respect to the matrix sequential probability ratio test (MSPRT) by Armitage. In a multihypothesis variant of the Kiefer-Weiss problem for binomial proportions the performance of the DBC-test is numerically compared with that of the exact solution. In a model of normal observations with a linear trend, the performance of the DBC-test is numerically compared with that of the MSPRT. Some other numerical examples are presented. In all the cases the proposed tests exhibit a very high efficiency with respect to the optimal tests (more than 99.3% when sampling from Bernoulli populations) and/or with respect to the MSPRT (even outperforming the latter in some scenarios).

statistics & probability
Performance Analysis of Sequential Probability Ratio Test

Yu Liu,X. Rong Li

DOI: https://doi.org/10.1080/07474946.2013.843329

2013-10-02

Sequential Analysis

Abstract:The sequential probability ratio test (SPRT) is a fundamental tool for sequential analysis. It forms the basis of numerous sequential techniques for different applications; for example, the truncated SPRT and Page's cumulative sum test (CUSUM). The performance of SPRT is characterized by two important functions—operating characteristic (OC) and average sample number (ASN), and CUSUM's performance is revealed by the average run length (ARL) function. These functions have been studied extensively under the assumption of independent and identically distributed log-likelihood ratios (LLRs) with constant bounds, which is too stringent for many applications. In this article, inductive integral equations governing these functions are developed under very general settings—the bounds can be time-varying and the LLRs are assumed independent but nonstationary. These inductive equations provide a theoretical foundation for performance analysis. Unfortunately, they have nonunique solutions in the general case except for the truncated SPRT. Numerical solutions for some frequently encountered special cases are developed and are compared with the results of Monte Carlo simulations.
Sequential testing for safety evaluation

Jie Chen

DOI: https://doi.org/10.1002/9781118763070.ch12

2014-12-12

Abstract:Sequential analysis of safety data ensure early detection of safety issues while minimizing the risk for patients who are exposed to the unsafe medical products. Wald presented the sequential probability ratio tests (SPRTs) in the framework of testing a simple null hypothesis against a simple alternative hypothesis. SPRT approach maximizes the (log) likelihood ratio by posting a constraint on the maximum likelihood estimate (MLE) of the parameter of interest within the domain of the alternative hypothesis, while the sequential generalized likelihood ratio (GLR) approach of Lai calculates the (log) likelihood ratio without any constraint and its stopping rule is determined jointly by the magnitude of the (log) likelihood ratio and the MLE of the parameter. The sequential GLR approach has smaller expected sample size (earlier detection of safety signals) as compared with either the SPRT or the maximized SPRT method, while still maintaining satisfactory power under a variety of circumstances.
Sequential tests of multiple hypotheses controlling type I and II familywise error rates

Jay Bartroff,Jinlin Song

DOI: https://doi.org/10.1016/j.jspi.2014.05.010

IF: 1.095

2014-10-01

Journal of Statistical Planning and Inference

Abstract:This paper addresses the following general scenario: A scientist wishes to perform a battery of experiments, each generating a sequential stream of data, to investigate some phenomenon. The scientist would like to control the overall error rate in order to draw statistically-valid conclusions from each experiment, while being as efficient as possible. The between-stream data may differ in distribution and dimension but also may be highly correlated, even duplicated exactly in some cases. Treating each experiment as a hypothesis test and adopting the familywise error rate (FWER) metric, we give a procedure that sequentially tests each hypothesis while controlling both the type I and II FWERs regardless of the between-stream correlation, and only requires arbitrary sequential test statistics that control the error rates for a given stream in isolation. The proposed procedure, which we call the sequential Holm procedure because of its inspiration from Holm's (1979) seminal fixed-sample procedure, shows simultaneous savings in expected sample size and less conservative error control relative to fixed sample, sequential Bonferroni, and other recently proposed sequential procedures in a simulation study.

statistics & probability
Bayesian sequential probability ratio test for vaccine efficacy trials

Erina Paul,Santosh Sutradhar,Jonathan Hartzel,Devan V. Mehrotra

DOI: https://doi.org/10.1007/s00180-024-01458-5

IF: 1.4049

2024-02-21

Computational Statistics

Abstract:Designing vaccine efficacy (VE) trials often requires recruiting large numbers of participants when the diseases of interest have a low incidence. When developing novel vaccines, such as for COVID-19 disease, the plausible range of VE is quite large at the design stage. Thus, the number of events needed to demonstrate efficacy above a pre-defined regulatory threshold can be difficult to predict and the time needed to accrue the necessary events can often be long. Therefore, it is advantageous to evaluate the efficacy at earlier interim analysis in the trial to potentially allow the trials to stop early for overwhelming VE or futility. In such cases, incorporating interim analyses through the use of the sequential probability ratio test (SPRT) can be helpful to allow for multiple analyses while controlling for both type-I and type-II errors. In this article, we propose a Bayesian SPRT for designing a vaccine trial for comparing a test vaccine with a control assuming two Poisson incidence rates. We provide guidance on how to choose the prior distribution and how to optimize the number of events for interim analyses to maximize the efficiency of the design. Through simulations, we demonstrate how the proposed Bayesian SPRT performs better when compared with the corresponding frequentist SPRT. An R repository to implement the proposed method is placed at: https://github.com/Merck/bayesiansprt.

statistics & probability
Comparison of SPRT and Sequential Bayes Procedures for Classifying Examinees Into Two Categories Using a Computerized Test

Judith A. Spray,Mark D. Reckase

DOI: https://doi.org/10.3102/10769986021004405

1996-12-01

Journal of Educational and Behavioral Statistics

Abstract:Many testing applications focus on classifying examinees into one of two categories (e.g., pass/fail) rather than on obtaining an accurate estimate of level of ability. Examples of such applications include licensure and certification, college selection, and placement into entry-level or developmental college courses. With the increased availability of computers for the administration and scoring of tests, computerized testing procedures have been developed for efficiently making these classification decisions. The purpose of the research reported in this article was to compare two such procedures, one based on the sequential probability ratio test and the other on sequential Bayes methodology, to determine which required fewer items for classification when the procedures were matched on classification error rates. The results showed that under the conditions studied, the SPRT procedure required fewer test items than the sequential Bayes procedure to achieve the same level of classification accuracy.

education & educational research,psychology, mathematical,social sciences, mathematical methods
Private Sequential Hypothesis Testing for Statisticians: Privacy, Error Rates, and Sample Size

Wanrong Zhang,Yajun Mei,Rachel Cummings

DOI: https://doi.org/10.48550/arXiv.2204.04597

IF: 5.414

2022-04-10

Machine Learning

Abstract:The sequential hypothesis testing problem is a class of statistical analyses where the sample size is not fixed in advance. Instead, the decision-process takes in new observations sequentially to make real-time decisions for testing an alternative hypothesis against a null hypothesis until some stopping criterion is satisfied. In many common applications of sequential hypothesis testing, the data can be highly sensitive and may require privacy protection; for example, sequential hypothesis testing is used in clinical trials, where doctors sequentially collect data from patients and must determine when to stop recruiting patients and whether the treatment is effective. The field of differential privacy has been developed to offer data analysis tools with strong privacy guarantees, and has been commonly applied to machine learning and statistical tasks. In this work, we study the sequential hypothesis testing problem under a slight variant of differential privacy, known as Renyi differential privacy. We present a new private algorithm based on Wald's Sequential Probability Ratio Test (SPRT) that also gives strong theoretical privacy guarantees. We provide theoretical analysis on statistical performance measured by Type I and Type II error as well as the expected sample size. We also empirically validate our theoretical results on several synthetic databases, showing that our algorithms also perform well in practice. Unlike previous work in private hypothesis testing that focused only on the classical fixed sample setting, our results in the sequential setting allow a conclusion to be reached much earlier, and thus saving the cost of collecting additional samples.
Mechanistic implications of cyclic ADP-ribose hydrolysis and methanolysis catalyzed by calf spleen NAD+glycohydrolase.

H. Muller-Steffner,M. Muzard,N. Oppenheimer,F. Schuber

DOI: https://doi.org/10.1006/BBRC.1994.2601

1994-11-14

Abstract:Calf spleen NAD+glycohydrolase, besides its well known reactions, was shown to catalyze hydrolysis and methanolysis (with retention of configuration) of cyclic ADP-ribose, indicating that this classical NADase also belongs to the class of cyclic ADP-ribose hydrolases. No formation of cyclic ADP-ribose could be detected during the hydrolysis of beta-NAD+; moreover, the kinetic parameters of cyclic ADP-ribose seem to rule out that it is a kinetically competent reaction intermediate in the conversion of NAD+ into ADP-ribose by this enzyme.
Sequential Testing in Reliability and Validity Studies With Repeated Measurements per Subject

Steven B. Kim,Jeffrey O. Wand

DOI: https://doi.org/10.5539/ijsp.v8n1p120

2018-12-24

International Journal of Statistics and Probability

Abstract:In medical, health, and sports sciences, researchers desire a device with high reliability and validity. This article focuses on reliability and validity studies with n subjects and m ≥2 repeated measurements per subject. High statistical power can be achieved by increasing n or m, and increasing m is often easier than increasing n in practice unless m is too high to result in systematic bias. The sequential probability ratio test (SPRT) is a useful statistical method which can conclude a null hypothesis H0 or an alternative hypothesis H1 with 50% of the required sample size of a non-sequential test on average. The traditional SPRT requires the likelihood function for each observed random variable, and it can be a practical burden for evaluating the likelihood ratio after each observation of a subject. Instead, m observed random variables per subject can be transformed into a test statistic which has a known sampling distribution under H0 and under H1. This allows us to formulate a SPRT based on a sequence of test statistics. In this article, three types of study are considered: reliabilityof a device, reliability of a device relative to a criterion device, and validity of a device relative to a  criterion device. Using SPRT for testing the reliability of a device, for small m, results in an average sample size of about 50% of the fixed sample size for a non-sequential test. For comparing a device to criterion, the average sample size approaches to 60% approximately as m increases. The SPRT tolerates violation of normality assumption for validity study, but it does not for reliability study.
On Bayes factors for hypothesis tests

Karl Christoph Klauer,Constantin G. Meyer-Grant,David Kellen

DOI: https://doi.org/10.3758/s13423-024-02612-2

2024-11-28

Psychonomic Bulletin & Review

Abstract:We develop alternative families of Bayes factors for use in hypothesis tests as alternatives to the popular default Bayes factors. The alternative Bayes factors are derived for the statistical analyses most commonly used in psychological research – one-sample and two-sample t tests, regression, and ANOVA analyses. They possess the same desirable theoretical and practical properties as the default Bayes factors and satisfy additional theoretical desiderata while mitigating against two features of the default priors that we consider implausible. They can be conveniently computed via an R package that we provide. Furthermore, hypothesis tests based on Bayes factors and those based on significance tests are juxtaposed. This discussion leads to the insight that default Bayes factors as well as the alternative Bayes factors are equivalent to test-statistic-based Bayes factors as proposed by Johnson. Journal of the Royal Statistical Society Series B: Statistical Methodology , 67 , 689–701. (2005). We highlight test-statistic-based Bayes factors as a general approach to Bayes-factor computation that is applicable to many hypothesis-testing problems for which an effect-size measure has been proposed and for which test power can be computed.

psychology, experimental, mathematical
Use one system for all results to avoid contradiction: Advice for using significance tests, equivalence tests, and Bayes factors.

Zoltan Dienes

DOI: https://doi.org/10.1037/xhp0001202

2024-04-20

Journal of Experimental Psychology Human Perception & Performance

Abstract:A nonsignificant result against an H0 of no effect does not distinguish evidence for no effect from no evidence at all one way or the other. Thus, a researcher engaged primarily in significance testing may decide to follow up just the nonsignificant results with a test from another system of inference, such as equivalence tests (more generally, inference by intervals) or Bayes factors. However, selectively using two systems of inference in this way, can lead to inferential inconsistency because different tests are based on different principles, and therefore a researcher can be tempted to select the way each system is used to get the results the researcher wants for just the tests that system is applied to. For a related set of tests, one system of inference should be consistently used. (PsycInfo Database Record (c) 2024 APA, all rights reserved)

psychology, experimental
A puzzle of proportions: Two popular Bayesian tests can yield dramatically different conclusions

Fabian Dablander,Karoline Huth,Quentin F. Gronau,Alexander Etz,Eric‐Jan Wagenmakers

DOI: https://doi.org/10.1002/sim.9278

2021-12-12

Statistics in Medicine

Abstract:Testing the equality of two proportions is a common procedure in science, especially in medicine and public health. In these domains, it is crucial to be able to quantify evidence for the absence of a treatment effect. Bayesian hypothesis testing by means of the Bayes factor provides one avenue to do so, requiring the specification of prior distributions for parameters. The most popular analysis approach views the comparison of proportions from a contingency table perspective, assigning prior distributions directly to the two proportions. Another, less popular approach views the problem from a logistic regression perspective, assigning prior distributions to logit-transformed parameters. Reanalyzing 39 null results from the New England Journal of Medicine with both approaches, we find that they can lead to markedly different conclusions, especially when the observed proportions are at the extremes (ie, very low or very high). We explain these stark differences and provide recommendations for researchers interested in testing the equality of two proportions and users of Bayes factors more generally. The test that assigns prior distributions to logit-transformed parameters creates prior dependence between the two proportions and yields weaker evidence when the observations are at the extremes. When comparing two proportions, we argue that this test should become the new default.

public, environmental & occupational health,medicine, research & experimental,medical informatics,mathematical & computational biology,statistics & probability
Rapid and Scalable Bayesian AB Testing

Srivas Chennu,Andrew Maher,Christian Pangerl,Subash Prabanantham,Jae Hyeon Bae,Jamie Martin,Bud Goswami

2023-07-27

Abstract:AB testing aids business operators with their decision making, and is considered the gold standard method for learning from data to improve digital user experiences. However, there is usually a gap between the requirements of practitioners, and the constraints imposed by the statistical hypothesis testing methodologies commonly used for analysis of AB tests. These include the lack of statistical power in multivariate designs with many factors, correlations between these factors, the need of sequential testing for early stopping, and the inability to pool knowledge from past tests. Here, we propose a solution that applies hierarchical Bayesian estimation to address the above limitations. In comparison to current sequential AB testing methodology, we increase statistical power by exploiting correlations between factors, enabling sequential testing and progressive early stopping, without incurring excessive false positive risk. We also demonstrate how this methodology can be extended to enable the extraction of composite global learnings from past AB tests, to accelerate future tests. We underpin our work with a solid theoretical framework that articulates the value of hierarchical estimation. We demonstrate its utility using both numerical simulations and a large set of real-world AB tests. Together, these results highlight the practical value of our approach for statistical inference in the technology industry.

Machine Learning,Methodology
Sequential Tests of Statistical Hypotheses with Confidence Limits

Xinjia Chen

DOI: https://doi.org/10.48550/arXiv.1007.4278

2010-07-24

Statistics Theory

Abstract:In this paper, we propose a general method for testing composite hypotheses. Our idea is to use confidence limits to define stopping and decision rules. The requirements of operating characteristic function can be satisfied by adjusting the coefficients of the confidence limits. For common distributions, such adjustment can be done via efficient computation by making use of the monotonicity of the associated operating characteristic function. We show that the problem of testing multiple hypotheses can be cast into the general framework of constructing sequential random intervals with prescribed coverage probabilities. We propose an inclusion principle for constructing multistage testing plans. It is demonstrated that our proposed testing plans can be substantially more efficient than the sequential probability ratio test and its variations. We apply our general methodology to develop an exact approach for testing hypotheses regarding the difference of two binomial proportions.
Sequential tests of multiple hypotheses controlling false discovery and nondiscovery rates

Jay Bartroff,Jinlin Song

DOI: https://doi.org/10.1080/07474946.2020.1726686

2020-01-02

Sequential Analysis

Abstract:We propose a general and flexible procedure for testing multiple hypotheses about sequential (or streaming) data that simultaneously controls both the false discovery rate (FDR) and false nondiscovery rate (FNR) under minimal assumptions about the data streams, which may differ in distribution and dimension and be dependent. All that is needed is a test statistic for each data stream that controls its conventional type I and II error probabilities, and no information or assumptions are required about the joint distribution of the statistics or data streams. The procedure can be used with sequential, group sequential, truncated, or other sampling schemes. The procedure is a natural extension of Benjamini and Hochberg's (<a href="#">1995</a> Benjamini, Y. and Hochberg, Y. (1995). Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing, Journal of the Royal Statistical Society, Series B: Methodological 57: 289–300. doi:10.1111/j.2517-6161.1995.tb02031.x<a href="/servlet/linkout?suffix=CIT0009&dbid=16&doi=10.1080%2F07474946.2020.1726686&key=10.1111%2Fj.2517-6161.1995.tb02031.x">[Crossref]</a> , <a class="google-scholar" href="http://scholar.google.com/scholar_lookup?hl=en&publication_year=1995&pages=289-300&author=Y.+Benjamini&author=Y.+Hochberg&title=Controlling+the+False+Discovery+Rate%3A+A+Practical+and+Powerful+Approach+to+Multiple+Testing">[Google Scholar]</a>) widely used fixed sample size procedure to the domain of sequential data, with the added benefit of simultaneous FDR and FNR control that sequential sampling affords. We prove the procedure's error control and give some tips for implementation in commonly encountered testing situations.
Application of Sequential Probability Ratio Test to Computerized Criterion-Referenced Testing

Yuan-chin Ivan Chang

DOI: https://doi.org/10.1081/sqa-120030194

2004-12-31

Sequential Analysis

Abstract:The adaptive testing is an important testing method in the modern educational/psychological testings. In adaptive mastery testing, the items are selected adaptively according to the estimated information of the unknown latent ability levels, and given then to the test-takers, sequentially. Hence, the decision (master or non-master; pass or fail) for each test-taker is made sequentially based on each test-taker's responses to a particular sequence of items administered to him/her. Thus, statistically speaking, by the natural character of the adaptive mastery testing, it is a sequential problem with dependent observations. The Wald's [Wald, A. Sequential Analysis; Wiley: New York, 1947] SPRT (sequential probability ratio test) has been applied to this kind of mental testing problem by many researchers in the field of educational/psychological measurement theory; for example, Reckase [Reckase, M. A procedure for decision making using tailored testing. In New Horizons in Testing – Latent Trait Test Theory and Computerized Adaptive Testing; Weiss, D.J., Ed.; Academic Press: New York, 1983; 238–257], Kingsbury and Weiss [Kingsbury, G.; Weiss, D.J. A comparison of IRT-based adaptive mastery testing and a sequential mastery testing procedure. In New Horizons in Testing – Latent Trait Test Theory and Computerized Adaptive Testing; Weiss, D.J., Ed.; Academic Press: New York, 1983; 258–288] and Spray [Spray, J. Multiple-Category Classification Using a Sequential Probability Ratio Test, ACT Research Report Series; 1993; 93–7]. Most of their results are empirical studies of the performance of SPRT with different item selection schemes. In statistical literature, the SPRT with i.i.d. observations has been intensively studied by many statisticians since Wald [Wald, A. Sequential Analysis; Wiley: New York, 1947]. In this paper, we concentrate on the properties of the stopping time of the SPRT under adaptive mastery testing; i.e., the test items (observations) are adaptively selected. Not only are there a few people discussing the properties of SPRT under non-i.i.d. setup, but also most of them study just large sample properties, which provide very little information for test-makers to design good mastery tests. Without the independence property of the observations, it will require different approaches to analyze its performance. Here we apply some results of linear growth processes and a martingale extension of the Wald's [Wald, A. Sequential Analysis; Wiley: New York, 1947] equation to obtain a bound for the expectation of the stopping rules (i.e., the test length) used in adaptive mastery tests.
Comparing researchers' degree of dichotomous thinking using frequentist versus Bayesian null hypothesis testing

Jasmine Muradchanian,Rink Hoekstra,Henk Kiers,Dustin Fife,Don van Ravenzwaaij

DOI: https://doi.org/10.1038/s41598-024-62043-w

IF: 4.6

2024-05-29

Scientific Reports

Abstract:A large amount of scientific literature in social and behavioural sciences bases their conclusions on one or more hypothesis tests. As such, it is important to obtain more knowledge about how researchers in social and behavioural sciences interpret quantities that result from hypothesis test metrics, such as p -values and Bayes factors. In the present study, we explored the relationship between obtained statistical evidence and the degree of belief or confidence that there is a positive effect in the population of interest. In particular, we were interested in the existence of a so-called cliff effect: A qualitative drop in the degree of belief that there is a positive effect around certain threshold values of statistical evidence (e.g., at p = 0.05). We compared this relationship for p -values to the relationship for corresponding degrees of evidence quantified through Bayes factors, and we examined whether this relationship was affected by two different modes of presentation (in one mode the functional form of the relationship across values was implicit to the participant, whereas in the other mode it was explicit). We found evidence for a higher proportion of cliff effects in p -value conditions than in BF conditions (N = 139), but we did not get a clear indication whether presentation mode had an effect on the proportion of cliff effects.

multidisciplinary sciences
Constructing group sequential tests with data monitoring

Michael A. Chesnaye,Steven L. Bell,James M. Harte,David M. Simpson

DOI: https://doi.org/10.1016/j.bspc.2024.106278

IF: 5.1

2024-04-04

Biomedical Signal Processing and Control

Abstract:Objective: Group sequential tests are procedures for repeatedly analysing accruing data, and aim to reduce test time by stopping data collection as soon as an effect is deemed statistically present or absent. Data monitoring, on the other hand, aims to control statistical power by repeatedly re-estimating sample variance from the accruing data, and then adjusting the sample size accordingly. The current work presents a numerical framework for combining group sequential tests with data monitoring, thus leveraging the best of both methods. Methods: The approach revolves around numerically convolving truncated probability density functions, which leads to numerically tracktable distributions for the sequential test statistic. This then allows conventional power analysis methodologies to be used during the data monitoring procedure, thus keeping the procedure relatively intuitive and transparent. The test operating characteristics of the procedure were evaluated extensively in simulations and in Auditory Brainstem Response data. Results: A good control over statistical power was observed, which was attributed to data monitoring. In some test conditions, however, data monitoring led to inflated type-I error rates and a reduced control over statistical power. This was attributed to sample variance estimation errors, and was largely overcome by initiating data monitoring after at least ∼ 40-90 samples had accrued and/or by leaving data blinded. Conclusion/Significance: When there is uncertainty regarding the effect size and/or the population variance, then group sequential tests with data monitoring may offer a solution, providing an efficient means to reach an unambiguous test outcome in terms of effect present/absent.

engineering, biomedical

The morphogenesis and fate of the nucleolar channel system in the human endometrial glandular cell.

Bayesian Updating and Sequential Testing: Overcoming Inferential Limitations of Screening Tests

Controlling decision errors with minimal costs: The sequential probability ratio t test.

A class of sequential multi-hypothesis tests

Performance Analysis of Sequential Probability Ratio Test

Sequential testing for safety evaluation

Sequential tests of multiple hypotheses controlling type I and II familywise error rates

Bayesian sequential probability ratio test for vaccine efficacy trials

Comparison of SPRT and Sequential Bayes Procedures for Classifying Examinees Into Two Categories Using a Computerized Test

Private Sequential Hypothesis Testing for Statisticians: Privacy, Error Rates, and Sample Size

Mechanistic implications of cyclic ADP-ribose hydrolysis and methanolysis catalyzed by calf spleen NAD+glycohydrolase.

Sequential Testing in Reliability and Validity Studies With Repeated Measurements per Subject

On Bayes factors for hypothesis tests

Use one system for all results to avoid contradiction: Advice for using significance tests, equivalence tests, and Bayes factors.

A puzzle of proportions: Two popular Bayesian tests can yield dramatically different conclusions

Rapid and Scalable Bayesian AB Testing

Sequential Tests of Statistical Hypotheses with Confidence Limits

Sequential tests of multiple hypotheses controlling false discovery and nondiscovery rates

Application of Sequential Probability Ratio Test to Computerized Criterion-Referenced Testing

Comparing researchers' degree of dichotomous thinking using frequentist versus Bayesian null hypothesis testing

Constructing group sequential tests with data monitoring