Abstract:Regression models are used in geosciences to extrapolate data and identify significant predictors of a response variable. Criterion approaches based on the residual sum of squares (RSS), such as the Akaike Information Criterion, Bayesian Information Criterion (BIC), Deviance Information Criterion, or Mallows' Cp can be used to compare non-nested models to identify an optimal subset of covariates. Computational limitations arise when the number of observations or candidate covariates is large in comparing all possible combinations of the available covariates, and in characterizing the covariance of the residuals for each examined model when the residuals are autocorrelated, as is often the case in spatial and temporal regression analysis. This paper presents computationally efficient algorithms for identifying the optimal model as defined using any RSS-based model selection criterion. The proposed dual criterion optimal branch and bound (DCO B&B) algorithm is guaranteed to identify the optimal model, while a single criterion heuristic (SCH) B&B algorithm provides further computational savings and approximates the optimal solution. These algorithms are applicable both to multiple linear regression (MLR) and to response variables with correlated residuals. We also propose an approach for iterative model selection, where a single set of covariance parameters is used in each iteration rather than a different set of parameters being used for each examined model. Simulation experiments are performed to evaluate the performance of the algorithms for regression models, using MLR and geostatistical regression as prototypical regression tools and BIC as a prototypical model selection approach. Results show massive computational savings using the DCO B&B algorithm relative to performing an exhaustive search. The SCH B&B is shown to provide a good approximation of the optimal model in most cases, while the DCO B&B with iterative covariance parameter optimization yields the closest approximation to the DCO B&B algorithm while also providing additional computational savings.

Evaluating the performance of AIC and BIC for selecting spatial econometric models

Model Selection with Misspecified Spatial Covariance Structure

Integrated deviance information criterion for spatial autoregressive models with heteroskedasticity

Consistent Model Selection Procedure for Random Coefficient INAR Models

Choosing models in model-based clustering and discriminant analysis

The Choice of Spatial Econometric Models Reconsidered in Empirical Studies

Comparision of AIC and BIC in the Selection of Stock-Recruitment Relationships

A backward elimination discrete optimization algorithm for model selection in spatio-temporal regression models

The Focused Information Criterion for Stochastic Model Selection Problems Using $M$-Estimators

Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC).

Spatial Regression Models: A Systematic Comparison of Different Model Specifications Using Monte Carlo Experiments

Huber Loss Meets Spatial Autoregressive Model: A Robust Variable Selection Method with Prior Information

A Simple Information Criterion for Variable Selection in High‐Dimensional Regression

Model selection using J-test for the spatial autoregressive model vs. the matrix exponential spatial model

Bayesian Model Selection for a Class of Spatially-Explicit Capture Recapture Models

A likelihood ratio test for spatial model selection

Simulation Analysis for Power of Bootstrap Moran Diagnostic Tests in Spatial Econometric Autoregressive Models

Model selection and model averaging for matrix exponential spatial models

Software for Bayesian cross section and panel spatial model comparison

A Unified Approach to Focused Information Criterion and Plug-In Averaging Method

Heteroskedasticity Robust Specification Testing In Spatial Autoregression