Abstract:In recent years, there has been a strong drive to improve the inclusion of animals of both sexes in the design of in vivo research studies, driven by a need to increase sex representation in fundamental biology and drug development. This has resulted in inclusion mandates by funding bodies and journals, alongside numerous published manuscripts highlighting the issue and providing guidance to scientists. However, progress is slow and barriers to the routine use of both sexes remain. A frequent, major concern is the perceived need for a higher overall sample size to achieve an equivalent level of statistical power, which would result in an increased ethical and resource burden. This perception arises from either the belief that sex inclusion will increase variability in the data (either through a baseline difference or a treatment effect that depends on sex), thus reducing the sensitivity of statistical tests, or from misapprehensions about the correct way to analyse the data, including disaggregation or pooling by sex. Here, we conduct an in-depth examination of the consequences of including both sexes on statistical power. We performed simulations by constructing artificial datasets that encompass a range of outcomes that may occur in studies studying a treatment effect in the context of both sexes. This includes both baseline sex differences and situations in which the size of the treatment effect depends on sex in both the same and opposite directions. The data were then analysed using either a factorial analysis approach, which is appropriate for the design, or a t test approach following pooling or disaggregation of the data, which are common but erroneous strategies. The results demonstrate that there is no loss of power to detect treatment effects when splitting the sample size across sexes in most scenarios, providing that the data are analysed using an appropriate factorial analysis method (e.g., two-way ANOVA). In the rare situations where power is lost, the benefit of understanding the role of sex outweighs the power considerations. Additionally, use of the inappropriate analysis pipelines results in a loss of statistical power. Therefore, we recommend analysing data collected from both sexes using factorial analysis and splitting the sample size across male and female mice as a standard strategy.

A response to "Realism and robustness require increased sample size when studying both sexes"

Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies

Realism and robustness require increased sample size when studying both sexes

Power to Detect What? Considerations for Planning and Evaluating Sample Size

Detecting non-binomial sex allocation when developmental mortality operates

How large should my study be so that I can detect an altered sex ratio?

Author Correction: Adult Sex Ratios: Causes of Variation and Implications for Animal and Human Societies

A simple model suggesting economically rational sample-size choice drives irreproducibility

The hidden factor: accounting for covariate effects in power and sample size computation for a binary trait

Sample Size Estimation for Random-effects Models: Balancing Precision and Feasibility in Panel Studies

A simple statistical framework for small sample studies

Evaluating the robustness of repeated measures analyses: The case of small sample sizes and nonnormal data

How Many Participants Do We Have to Include in Properly Powered Experiments? A Tutorial of Power Analysis with Reference Tables

Sample size determination for logistic regression revisited

Intra-sexual selection in cooperative mammals and birds: why are females not bigger and better armed?

Considering sex as a biological variable will require a global shift in science culture

Determining sample size adequacy for animal model studies in nutrition research: limits and ethical challenges of ordinary power calculation procedures

Estimating adult sex ratios in nature

The multinomial index: a robust measure of reproductive skew

How Many Participants Do I Need to Test an Interaction? Conducting an Appropriate Power Analysis and Achieving Sufficient Power to Detect an Interaction

An Evolutionary Theory for the Variability Hypothesis