Abstract:Background: To address the limitations of commonly used cross-validation methods, the linear regression method (LR) was proposed to estimate population accuracy of predictions based on the implicit assumption that the fitted model is correct. This method also provides two statistics to determine the adequacy of the fitted model. The validity and behavior of the LR method have been provided and studied for linear predictions but not for nonlinear predictions. The objectives of this study were to 1) provide a mathematical proof for the validity of the LR method when predictions are based on conditional means, regardless of whether the predictions are linear or non-linear 2) investigate the ability of the LR method to detect whether the fitted model is adequate or inadequate, and 3) provide guidelines on how to appropriately partition the data into training and validation such that the LR method can identify an inadequate model. Results: We present a mathematical proof for the validity of the LR method to estimate population accuracy and to determine whether the fitted model is adequate or inadequate when the predictor is the conditional mean, which may be a non-linear function of the phenotype. Using three partitioning scenarios of simulated data, we show that the one of the LR statistics can detect an inadequate model only when the data are partitioned such that the values of relevant predictor variables differ between the training and validation sets. In contrast, we observed that the other LR statistic was able to detect an inadequate model for all three scenarios. Conclusion: The LR method has been proposed to address some limitations of the traditional approach of cross-validation in genetic evaluation. In this paper, we showed that the LR method is valid when the model is adequate and the conditional mean is the predictor, even when it is a non-linear function of the phenotype. We found one of the two LR statistics is superior because it was able to detect an inadequate model for all three partitioning scenarios (i.e., between animals, by age within animals, and between animals and by age) that were studied.

Linear Minimax Prediction of Finite Population Regression Coefficient under a Balanced Loss Function

Admissibility of Linear Predictors in the Superpopulation Model with Respect to Inequality Constraints under Matrix Loss Function

Linearly Admissible Estimators of Stochastic Regression Coefficient under Balanced Loss Function

The Superiority of the Bayes Linear Unbiased Minimum Variance Estimator under Balanced Loss Function

A Further Study of Predictions in Linear Mixed Models

Prediction with measurement errors in finite populations.

Reliability Analysis of Cox Models under the Balanced Loss Function: Based on Records

Electronic structure study by means of X-ray spectroscopy and theoretical calculations of the "ferric star" single molecule magnet

Variable Selection and Minimax Prediction in High-dimensional Functional Linear Model

Use of the linear regression method to evaluate population accuracy of predictions from non-linear models

Quasi-minimax Estimation in the General Linear Regression Model

Linearly Admissible Estimators of the Common Mean Parameter under Balanced Loss Function

Weighted Lasso Estimates for Sparse Logistic Regression: Non-Asymptotic Properties with Measurement Errors

Broad Minimax Probability Learning System and its Application in Regression Modeling

Linear predictor on linearly-generated data with missing values: non consistency and solutions

Functional Adaptive Huber Linear Regression

Functional Linear Regression with Mixed Predictors

Nonlinear Monte Carlo Method for Imbalanced Data Learning

Admissibility in general Gauss-Markov model with respect to an ellipsoidal constraint under weighted balanced loss

Optimal convex $M$-estimation via score matching

Nonnegative Estimation and Variable Selection under Minimax Concave Penalty for Sparse High-Dimensional Linear Regression Models