Statistical issues in the use of the comet assay

David P. Lovell,Takashi Omori,D. P. Lovell,T. Omori

DOI: https://doi.org/10.1093/mutage/gen015

2008-02-17

Mutagenesis

Abstract:The comet or single-cell gel electrophoresis assay is now widely used in regulatory, mechanistic and biomonitoring studies using a range of in vitro and in vivo systems. Each of these has issues associated with the experimental design which determine to a large extent the statistical analyses than can be used. A key concept is that the experimental unit is the smallest 'amount' of experimental material that can be randomly assigned to a treatment: the animal for in vivo studies and the culture for in vitro studies. Biomonitoring studies, being observational rather than experimental, are vulnerable to confounding and biases. Critical factors in any statistical analysis include the identification of suitable end points, the choice of measure to represent the distribution of the comet end point in a sample of cells, estimates of variability between experimental units and the identification of the size of effects that could be considered biologically important. Power and sample size calculations can be used in conjunction with this information to identify optimum experimental sizes and provide help in combining the results of statistical analyses with other information to aid interpretation. Interpretation based upon the size of effects and their confidence intervals is preferred to that based solely upon statistical significance tests. Statistical issues associated with the design and subsequent analyses of current validation studies for the comet assay include the identification of acceptable levels of intra- and inter-laboratory repeatability and reproducibility and criteria for dichotomizing results into positive or negative.

genetics & heredity,toxicology