Optimal Paired Comparison Block Designs

Eric Nyarko

DOI: https://doi.org/10.48550/arXiv.1910.06390

2019-10-14

Methodology

Abstract:For paired comparison experiments involving competing options described by two-level attributes several different methods of constructing designs having block paired observations under the main effects model are presented. These designs are compared to alternative designs available in the literature.

What problem does this paper attempt to address?

Optimal Designs for Second-Order Interactions in Paired Comparison Experiments with Binary Attributes

Eric Nyarko,Rainer Schwabe

DOI: https://doi.org/10.48550/arXiv.1811.10973

2019-01-23

Abstract:In paired comparison experiments respondents usually evaluate pairs of competing options. For this situation we introduce an appropriate model and derive optimal designs in the presence of second-order interactions when all attributes are dichotomous.

Methodology
Optimal $2^K$ Paired Comparison Designs for Third-Order Interactions

Eric Nyarko

DOI: https://doi.org/10.48550/arXiv.1908.06092

2019-08-17

Abstract:In psychological research often paired comparisons are used in which either full or partial profiles of the alternatives described by a common set of two-level attributes are presented. For this situation the problem of finding optimal designs is considered in the presence of third-order interactions.

Methodology
Efficient Designs in Small Blocks for Comparing Consecutive Pairs of Treatments

S. Huda,Rahul Mukerjee

DOI: https://doi.org/10.48550/arXiv.1405.4358

2014-05-17

Abstract:Optimal block designs in small blocks are explored when the treatments have a natural ordering and interest lies in comparing consecutive pairs of treatments. We first develop an approximate theory which leads to a convenient multiplicative algorithm for obtaining optimal design measures. This, in turn, yields highly efficient exact designs even when the number of blocks is rather small. Moreover, our approach is seen to allow nesting of such efficient exact designs which is an advantage when the resources for the experiment are available possibly in several stages. Illustrative examples are given. Tables of optimal design measures are also provided.

Statistics Theory
Copula-based robust optimal block designs

W.G. Mueller,A. Rappold,D.C. Woods

DOI: https://doi.org/10.48550/arXiv.1811.02414

2018-11-06

Abstract:Blocking is often used to reduce known variability in designed experiments by collecting together homogeneous experimental units. A common modelling assumption for such experiments is that responses from units within a block are dependent. Accounting for such dependencies in both the design of the experiment and the modelling of the resulting data when the response is not normally distributed can be challenging, particularly in terms of the computation required to find an optimal design. The application of copulas and marginal modelling provides a computationally efficient approach for estimating population-average treatment effects. Motivated by an experiment from materials testing, we develop and demonstrate designs with blocks of size two using copula models. Such designs are also important in applications ranging from microarray experiments to experiments on human eyes or limbs with naturally occurring blocks of size two. We present methodology for design selection, make comparisons to existing approaches in the literature and assess the robustness of the designs to modelling assumptions.

Methodology
E- and R-optimality of block designs for treatment-control comparisons

Samuel Rosa

DOI: https://doi.org/10.48550/arXiv.1804.06663

2018-04-18

Abstract:We study optimal block designs for comparing a set of test treatments with a control treatment. We provide the class of all E-optimal approximate block designs characterized by simple linear constraints. Employing this characterization, we obtain a class of E-optimal exact designs for treatment-control comparisons for unequal block sizes. In the studied model, we justify the use of E-optimality by providing a statistical interpretation for all E-optimal approximate designs and for the known classes of E-optimal exact designs. Moreover, we consider the R-optimality criterion, which minimizes the volume of the rectangular confidence region based on the Bonferroni confidence intervals. We show that all approximate A-optimal designs and a large class of A-optimal exact designs for treatment-control comparisons are also R-optimal. This further reinforces the observation that A-optimal designs perform well even for rectangular confidence regions.

Statistics Theory
Partially balanced nested block designs based on 2-associate-class association schemes for test-control comparisons

Vinayaka,Rajender Parsad,B. N. Mandal

DOI: https://doi.org/10.1080/03610918.2024.2317872

2024-02-21

Communications in Statistics - Simulation and Computation

Abstract:In this article, nested partially balanced treatment incomplete block (NPBTIB) designs are introduced for making test treatments-control treatment comparisons. Several methods of constructing such designs are presented. These methods of constructions utilize group divisible treatment (GDTD) designs, nested balanced incomplete block (NBIB) designs, and nested partially balanced incomplete block (NPBIB) designs. A catalogue of efficient NPBTIB designs with 2-associate classes for the number of treatments v≤16, replications of test treatments r≤15, and replications of control treatment r0≤30 is also included.

statistics & probability
Optimal two-level designs for partial profile choice experiments

Soumen Manna,Ashish Das

DOI: https://doi.org/10.48550/arXiv.1510.07800

2015-10-27

Abstract:We improve the existing results of optimal partial profile paired choice designs and provide new designs for situations where the choice set sizes are greater than two. The optimal designs are obtained under the main effects models and the broader main effects model.

Methodology
Tightening Blocks in Complementary Analyses of Observational Studies: Optimization Algorithm and Examples

Paul R. Rosenbaum

DOI: https://doi.org/10.1080/00031305.2024.2393630

2024-09-25

The American Statistician

Abstract:An observational block design has I blocks matched for covariates and J individuals per block, but treatments were not randomly assigned to individuals within blocks, as would have been done in an experiment. Tightening an observational block design means selecting J′ individuals from each block, and possibly I′≤I blocks, to construct a new observational block design that, in some way, addresses unmeasured biases from nonrandom treatment assignment. Tightening must preserve covariate balance while altering the design to achieve some additional objective. An optimization algorithm is introduced that achieves this while maintaining the block structure by finely balancing covariates across blocks and through optimal subset matching. An example is considered in detail, both to motivate and illustrate the tightening of an observational block design. Two tightened designs are built from a study of light daily alcohol consumption and its possible effects on HDL cholesterol. One tightened design adjusts for an outcome tentatively presuming it was unaffected by the treatment. The second tightened design uses a differential effect to remove bias from an unobserved general disposition that promotes several treatments. An R package tightenBlock implements the method, contains the data, and in that package the help-file for the function tighten reproduces the example.

statistics & probability
Optimal orthogonal designs for experiments with four-level and two-level factors

Bohyn, Alexandre,Schoen, Eric D.,Goos, Peter

DOI: https://doi.org/10.1007/s11222-024-10517-2

IF: 2.3241

2024-10-18

Statistics and Computing

Abstract:Experiments with both four-level and two-level factors have been conducted in many different domains, ranging from engineering to ergonomics. In such experiments, the four-level factors are used in three different ways: as blocking factors, as qualitative factors, or as quantitative factors. However, it was generally not easy for the authors to find an appropriate design for their experiment. A solution to this problem is to use a catalog of designs with a wide range of options. To efficiently use such a catalog, one needs criteria to identify the best designs. We present good criteria for the three different usages of four-level factors, and we apply these criteria to the catalog of Bohyn et al. (J R Stat Soc Ser C: Appl Stat 72:750–769, 2023). Finally, we present tables of four-and-two-level designs that are optimal with respect to the different criteria, for run sizes 16, 32, 64 and 128, with 1, 2, or 3 four-level factors, and up to 20 two-level factors.

statistics & probability,computer science, theory & methods
Optimal Designs For Two Non-Interactive Treatment

Ralph A. Bradley,A. Hedayat

DOI: https://doi.org/10.1080/00401706.1977.10489498

1977-02-01

Technometrics

Abstract:Consider two treatments and a combination of them. Given n available experimental units, the problem is to determine the number of units n, to be assigned to the first treatment, n 2 to the second, and n, to the combination, n = Σ i , n i , n i ≥ 0, i = 1, 2, 3, subject to suitable optimality criteria. This study was motivated by an example of a weighing design with n = 18. n 1 = 2. n 2 = 9, n s = 7 given by Box and Tiao [2, Section 2.7.3]. The allocation seemed far from optimal leading to the present investigation. Four models are developed for two non-interactive treatments and the combination of them. They may be described as 1. A weighing model, 2. A sum of independent random variables model, 3. A mixtures model, and 4. A factorial model. Three optimality criteria are considered: 1. D-optimality, 2. A-optimality and 3. minimization of the variance of the difference of estimators of the two treatment means. It is shown for all criteria for Models 2, 3, 4 and for Criterion 3 for Model I that n s = 0, n 1 = n 2 = n/2 if n is even, n 1 = (n + 1)/2. n 2 = (n – 1)/2 if n is odd. But rather different optimal designs are obtained for Criteria 1 and 2 and Model I, different for the two criteria and different also from the design of the Box-Tiao example. The results presented here are of interest for two reasons. They have intrinsic interest showing that the choice of model and optimality criterion may lead to an intuitively unexpected design in a simple experimental situation. They have instructional interest providing elementary illustrations of modern design concepts that may be used as class examples or problems for solution.

statistics & probability
Bayesian optimal blocking of factorial designs

Mingyao Ai,Lulu Kang,V. Roshan Joseph

DOI: https://doi.org/10.1016/j.jspi.2009.03.008

IF: 1.095

2009-01-01

Journal of Statistical Planning and Inference

Abstract:The presence of block effects makes the optimal selection of fractional factorial designs a difficult task. The existing frequentist methods try to combine treatment and block wordlength patterns and apply minimum aberration criterion to find the optimal design. However, ambiguities exist in combining the two wordlength patterns and therefore, the optimality of such designs can be challenged. Here we propose a Bayesian approach to overcome this problem. The main technique is to postulate a model and a prior distribution to satisfy the common assumptions in blocking and then, to develop an optimal design criterion for the efficient estimation of treatment effects. We apply our method to develop regular, nonregular, and mixed-level blocked designs. Several examples are presented to illustrate the advantages of the proposed method.
Optimal two-level choice designs for the main effects and specified interaction effects model

Soumen Manna

DOI: https://doi.org/10.48550/arXiv.1510.08281

2015-10-28

Abstract:Choice designs for the main effects model, broader main effects model and main effects plus specified interaction effects model are discussed in this paper. Universally optimal choice designs are obtained for all of these models using Hadamard matrix and other combinatorial techniques. Choice experiments under the multinomial logit model for equally attractive options are assumed for finding universally optimal choice designs.

Methodology
A Comparative Review of Methods for Comparing Means Using Partially Paired Data

Beibei Guo,Ying Yuan

DOI: https://doi.org/10.1177/0962280215577111

IF: 2.494

2015-01-01

Statistical Methods in Medical Research

Abstract:In medical experiments with the objective of testing the equality of two means, data are often partially paired by design or because of missing data. The partially paired data represent a combination of paired and unpaired observations. In this article, we review and compare nine methods for analyzing partially paired data, including the two-sample t-test, paired t-test, corrected z-test, weighted t-test, pooled t-test, optimal pooled t-test, multiple imputation method, mixed model approach, and the test based on a modified maximum likelihood estimate. We compare the performance of these methods through extensive simulation studies that cover a wide range of scenarios with different effect sizes, sample sizes, and correlations between the paired variables, as well as true underlying distributions. The simulation results suggest that when the sample size is moderate, the test based on the modified maximum likelihood estimator is generally superior to the other approaches when the data is normally distributed and the optimal pooled t-test performs the best when the data is not normally distributed, with well-controlled type I error rates and high statistical power; when the sample size is small, the optimal pooled t-test is to be recommended when both variables have missing data and the paired t-test is to be recommended when only one variable has missing data.
The Pairwise Matching Design is Optimal under Extreme Noise and Assignments

David Azriel,Abba M. Krieger,Adam Kapelner

DOI: https://doi.org/10.48550/arXiv.2402.07247

2024-11-06

Abstract:We consider the general performance of the difference-in-means estimator in an equally-allocated two-arm randomized experiment under common experimental endpoints such as continuous (regression), incidence, proportion, count and uncensored survival. We consider two sources of randomness: the subject-specific assignments and the contribution of unobserved subject-specific measurements. We then examine mean squared error (MSE) performance under a new, more realistic "simultaneous tail criterion". We prove that the pairwise matching design of Greevy et al. (2004) performs best asymptotically under this criterion when compared to other blocking designs. We also prove that the optimal design must be less random than complete randomization and more random than any deterministic, optimized allocation. Theoretical results are supported by simulations in all five response types.

Methodology
Optimal designs for testing pairwise differences: A graph‐based game theoretic approach

Arpan Singh,Satya Prakash Singh,Ori Davidov

DOI: https://doi.org/10.1111/sjos.12757

2024-10-28

Scandinavian Journal of Statistics

Abstract:In a variety of experimental settings there is an interest in comparing pairs–of–treatments. Such experiments usually address one of the following two scientific questions: (1) is there a difference within any of the selected pairs of treatments? or (2) is there a difference within all of the selected pairs of treatments? In this article, we propose max–min optimal designs for testing the above hypotheses using a graph‐based game theoretic approach. Some of the max–min designs obtained are well known, but not recognized as optimal, others are novel and provide an improvement over naive designs.

statistics & probability
Optimality of Pairwise Blocked Definitive Screening Designs

Yaping Wang,Mingyao Ai,Kang Li

DOI: https://doi.org/10.1007/s10463-015-0510-4

2015-01-01

Annals of the Institute of Statistical Mathematics

Abstract:Definitive screening designs are a new class of three-level designs which are shown superior to the classical central composite designs in response surface methodology. They can be constructed by inserting conference matrices into their fold-over structures. How to block definitive screening designs in an optimal way is of practical importance, and lacks systematic theoretical research up to now. Pairwise blocking schemes are usually adopted which assign each pair of fold-over runs into the same block. In this paper, the optimality of such pairwise blocking schemes is thoroughly studied in theory. It is shown that under the linear model consisting of main effects, quadratic effects and block effects, pairwise blocked definitive screening designs are universally optimal for the main effects among all balanced blocking schemes. Moreover, such blocked designs are proved to have the same generalized wordlength pattern and are also shown optimal under the generalized minimum aberration criterion.
Optimal choice designs for the main effects plus specified two-factor interaction effects model for binary attributes

Soumen Manna,Ashish Das

DOI: https://doi.org/10.1016/j.spl.2024.110086

IF: 0.718

2024-02-01

Statistics & Probability Letters

Abstract:Unlike optimal utility-neutral binary choice designs requiring a large number of choice sets to estimate the main effects and all two-factor interactions, we construct optimal binary choice designs with fewer choice sets for estimating the main effects plus specified two-factor interactions.

statistics & probability
Models for Paired Comparison Data: A Review with Emphasis on Dependent Data

Manuela Cattelan

DOI: https://doi.org/10.1214/12-STS396

2012-10-03

Abstract:Thurstonian and Bradley-Terry models are the most commonly applied models in the analysis of paired comparison data. Since their introduction, numerous developments have been proposed in different areas. This paper provides an updated overview of these extensions, including how to account for object- and subject-specific covariates and how to deal with ordinal paired comparison data. Special emphasis is given to models for dependent comparisons. Although these models are more realistic, their use is complicated by numerical difficulties. We therefore concentrate on implementation issues. In particular, a pairwise likelihood approach is explored for models for dependent paired comparison data, and a simulation study is carried out to compare the performance of maximum pairwise likelihood with other limited information estimation methods. The methodology is illustrated throughout using a real data set about university paired comparisons performed by students.

Methodology
The Optimality of Blocking Designs in Equally and Unequally Allocated Randomized Experiments with General Response

David Azriel,Abba M. Krieger,Adam Kapelner

2023-08-14

Abstract:We consider the performance of the difference-in-means estimator in a two-arm randomized experiment under common experimental endpoints such as continuous (regression), incidence, proportion and survival. We examine performance under both equal and unequal allocation to treatment groups and we consider both the Neyman randomization model and the population model. We show that in the Neyman model, where the only source of randomness is the treatment manipulation, there is no free lunch: complete randomization is minimax for the estimator's mean squared error. In the population model, where each subject experiences response noise with zero mean, the optimal design is the deterministic perfect-balance allocation. However, this allocation is generally NP-hard to compute and moreover, depends on unknown response parameters. When considering the tail criterion of Kapelner et al. (2021), we show the optimal design is less random than complete randomization and more random than the deterministic perfect-balance allocation. We prove that Fisher's blocking design provides the asymptotically optimal degree of experimental randomness. Theoretical results are supported by simulations in all considered experimental settings.

Statistics Theory,Methodology
Optimality of Matched-Pair Designs in Randomized Controlled Trials

Yuehao Bai

DOI: https://doi.org/10.1257/aer.20201856

IF: 10.7

2022-12-01

American Economic Review

Abstract:In randomized controlled trials, treatment is often assigned by stratified randomization. I show that among all stratified randomization schemes that treat all units with probability one half, a certain matched-pair design achieves the maximum statistical precision for estimating the average treatment effect. In an important special case, the optimal design pairs units according to the baseline outcome. In a simulation study based on datasets from ten randomized controlled trials, this design lowers the standard error for the estimator of the average treatment effect by 10 percent on average, and by up to 34 percent, relative to the original designs. (JEL C13, C21)

economics

Optimal Paired Comparison Block Designs

Optimal Designs for Second-Order Interactions in Paired Comparison Experiments with Binary Attributes

Optimal $2^K$ Paired Comparison Designs for Third-Order Interactions

Efficient Designs in Small Blocks for Comparing Consecutive Pairs of Treatments

Copula-based robust optimal block designs

E- and R-optimality of block designs for treatment-control comparisons

Partially balanced nested block designs based on 2-associate-class association schemes for test-control comparisons

Optimal two-level designs for partial profile choice experiments

Tightening Blocks in Complementary Analyses of Observational Studies: Optimization Algorithm and Examples

Optimal orthogonal designs for experiments with four-level and two-level factors

Optimal Designs For Two Non-Interactive Treatment

Bayesian optimal blocking of factorial designs

Optimal two-level choice designs for the main effects and specified interaction effects model

A Comparative Review of Methods for Comparing Means Using Partially Paired Data

The Pairwise Matching Design is Optimal under Extreme Noise and Assignments

Optimal designs for testing pairwise differences: A graph‐based game theoretic approach

Optimality of Pairwise Blocked Definitive Screening Designs

Optimal choice designs for the main effects plus specified two-factor interaction effects model for binary attributes

Models for Paired Comparison Data: A Review with Emphasis on Dependent Data

The Optimality of Blocking Designs in Equally and Unequally Allocated Randomized Experiments with General Response

Optimality of Matched-Pair Designs in Randomized Controlled Trials