A Primer on the Johnson-Neyman Technique : An Alternative Procedure to ANCOVA

Xuejun Ryan Ji

Abstract:The homogeneity of regression coefficients is one of the most important assumptions for appropriate of ANCOVA (Huitema, 1980). However, this assumption is not always met, but usual to reveal the heterogeneity of slopes, and thus leading to biased statistical testing results. Hence, an alternative approach to ANCOVA is required. In the present paper, JohnsonNeyman technique is briefly introduced including a sequence of statistical tests and Statistical Package Syntax. he homogeneity of regression assumption is one of the most important assumptions underlying the appropriate use of ANCOVA (Huitema, 1980). When this assumption is violated, the ANCOVA is inappropriate way to use. In the following numerical example, the ANOVA F is not statistically significant. If the homogeneity of regression assumption is not tested, the conclusion that there are no treatment effects among groups is erroneous. The biased Fcal is the result of violating the ANCOVA assumption. JohnsonNeyman is generally an appropriate alternative analysis. As Johnson and Fay (1950) pointed out, Modern statistical procedures are primarily concerned with two basic problems –determining significance and estimating parameter values. The Johnson-Neyman technique may be used for both problems; however, its primary contribution is the determination of significance of differences in groups, and its unique and additional contribution is in defining the population, in terms of control variables, for which the conclusion of [statistically] significant difference of mean performance may be held. (p. 349) In the present paper, a numerical example was presented to further explain the concept of J-N technique. The practical application of this procedure in the present paper was limited to two groups and one covariate. The system of tests described below was based on the procedure by Pedhazur (1997). The numerical example is based on the design matrix by Huitema (1980) shown in Table 1. The data in Table 1 are based on the experiment introduced by Huitema. The treatments are the two methods of therapy. The covariate is the scores on the sociability scale. The dependent variable is the aggressiveness score. Dummy code is used to categorize the group membership. The overview procedure includes: 1) conduct a full regression model to test whether the main effects and interaction effects are sufficiently meaningful or not, and to obtain the sum of squares for calculating the limits of region of significance; 2) test the homogeneity assumption of slopes by testing the significance of interaction between group and covariate; 3) establish the region of significance.

Mathematics