Williams ’ Test Comparing Multiple Dose Groups to a Control

Morton B. Brown,Shibao Feng

Abstract:In dose-ranging pharmaceutical trials, several groups of subjects who receive active doses are compared to a group receiving a placebo or conventional therapy. When the effect of the dose on the mean level of the response is expected to be monotonic, Williams (1971, 1972) proposed a test to compare multiple groups to a control. He also computed tables of the critical values for the simple design that corresponds to a one-way analysis of variance (ANOVA). Guo and Brown (1996) compared the power of Williams’ test with those of the step-down procedure and Dunnett’s multiple comparison method. Williams’ test had acceptable power over all orderings of the means, but was substantially more powerful than its two competitors for some orderings of the observed effects. In this paper we consider the implementation of Williams’ test in a more general setting, that of the general linear model. Even when the primary comparison is between groups, it is necessary to adjust for potential confounding effects, such as centre, age or gender. In section 2 we show that the 5% critical values of Williams’ test correspond to the 4 th percentile of Student’s t-distribution. More extreme critical values correspond to a percentile of Student’s t that is less than 0.8 of the desired size. Based on this we propose that the usual p-values obtained by contrasts that are used in Williams’ test be multiplied by 1.25 to approximate the p-values for Williams’ test. Using simulation, we evaluate the empirical sizes of the proposed approximation to show that the approximation is conservative.