Abstract:Regressions and meta-regressions are widely used to estimate patterns and effect sizes in various disciplines. However, many biological and medical analyses use relatively low sample size (N), contributing to concerns on reproducibility. What is the minimum N to identify the most plausible data pattern using regressions? Statistical power analysis is often used to answer that question, but it has its own problems and logically should follow model selection to first identify the most plausible model. Here we make null, simple linear and quadratic data with different variances and effect sizes. We then sample and use information theoretic model selection to evaluate minimum N for regression models. We also evaluate the use of coefficient of determination (R2) for this purpose; it is widely used but not recommended. With very low variance, both false positives and false negatives occurred at N < 8, but data shape was always clearly identified at N ≥ 8. With high variance, accurate inference was stable at N ≥ 25. Those outcomes were consistent at different effect sizes. Akaike Information Criterion weights (AICc wi) were essential to clearly identify patterns (e.g., simple linear vs. null); R2 or adjusted R2 values were not useful. We conclude that a minimum N = 8 is informative given very little variance, but minimum N ≥ 25 is required for more variance. Alternative models are better compared using information theory indices such as AIC but not R2 or adjusted R2. Insufficient N and R2-based model selection apparently contribute to confusion and low reproducibility in various disciplines. To avoid those problems, we recommend that research based on regressions or meta-regressions use N ≥ 25.

Discussion on Regression Analysis with Small Determination Coefficient in Human-Environment Researches

Interpretation of Linear Regression Coefficients under Mean Model Miss-Specification

A solution to minimum sample size for regressions

Residuals and Regression Diagnostics: Focusing on Logistic Regression

Research on the Prediction Method of Weighted Regression Based on Sample Size

Application of statistical analysis of sample size: How many occupant responses are required for an indoor environmental quality (IEQ) field study

Hierarchical regression approach to quantify farm households’ pro-environmental behavior

Regression with Highly Correlated Predictors: Variable Omission Is Not the Solution

The Garden of Forking Paths: Reinterpreting Haseman-Elston Regression for a Genotype-by-Environment Model

RETRACTED ARTICLE: Environmental PM2.5 concentration and optimization of college students’ mental health index based on variance parameter model

Study On Quasi-Linear Regression Methods

The Acceptable R-Square in Empirical Modelling for Social Science Research

The R2 Ridge Trace in 2sls Regression Estimation

Application of statistical power analysis – How to determine the right sample size in human health, comfort and productivity research

Confounding and collinearity in regression analysis: a cautionary tale and an alternative procedure, illustrated by studies of British voting behaviour

Application of Standardized Regression Coefficient in Meta-Analysis

Multilevel grouped regression for analyzing self-reported health in relation to environmental factors: the model and its application

Normality and significance testing in simple linear regression model for large sample sizes: a simulation study

Multicollinearity and Regression Analysis

PRACTICAL METHOD OF REGRESSION ANALYSIS APPLIED IN PREDICTION OF PARAMETERS AND EXPERIMENT DESIGN

Estimation and interpretation problems and solutions when using proportion covariates in linear regression models