Abstract:Regression models are used in geosciences to extrapolate data and identify significant predictors of a response variable. Criterion approaches based on the residual sum of squares (RSS), such as the Akaike Information Criterion, Bayesian Information Criterion (BIC), Deviance Information Criterion, or Mallows' Cp can be used to compare non-nested models to identify an optimal subset of covariates. Computational limitations arise when the number of observations or candidate covariates is large in comparing all possible combinations of the available covariates, and in characterizing the covariance of the residuals for each examined model when the residuals are autocorrelated, as is often the case in spatial and temporal regression analysis. This paper presents computationally efficient algorithms for identifying the optimal model as defined using any RSS-based model selection criterion. The proposed dual criterion optimal branch and bound (DCO B&B) algorithm is guaranteed to identify the optimal model, while a single criterion heuristic (SCH) B&B algorithm provides further computational savings and approximates the optimal solution. These algorithms are applicable both to multiple linear regression (MLR) and to response variables with correlated residuals. We also propose an approach for iterative model selection, where a single set of covariance parameters is used in each iteration rather than a different set of parameters being used for each examined model. Simulation experiments are performed to evaluate the performance of the algorithms for regression models, using MLR and geostatistical regression as prototypical regression tools and BIC as a prototypical model selection approach. Results show massive computational savings using the DCO B&B algorithm relative to performing an exhaustive search. The SCH B&B is shown to provide a good approximation of the optimal model in most cases, while the DCO B&B with iterative covariance parameter optimization yields the closest approximation to the DCO B&B algorithm while also providing additional computational savings.

Bayesian Model Selection for a Class of Spatially-Explicit Capture Recapture Models

Bayesian statistics in spatial epidemiology]

Modelling spatially autocorrelated detection probabilities in spatial capture-recapture using random effects

A flexible and efficient Bayesian implementation of point process models for spatial capture‐recapture data

Evaluating tools for capture-recapture model selection to estimate the size of hidden populations: It works in practice, but does it work in theory?

Monte Carlo algorithms for model assessment via conflicting summaries

Bayesian variable selection in linear regression models with instrumental variables

A backward elimination discrete optimization algorithm for model selection in spatio-temporal regression models

Bayesian high-dimensional covariate selection in non-linear mixed-effects models using the SAEM algorithm

A Unifying Model for Capture-Recapture and Distance Sampling Surveys of Wildlife Populations

A practical guide to selecting models for exploration, inference, and prediction in ecology

Using Full Models, Stepwise Regression and Model Selection in Ecological Data Sets: Monte Carlo Simulations

Model Selection with Misspecified Spatial Covariance Structure

Ecological non-linear state space model selection via adaptive particle Markov chain Monte Carlo (AdPMCMC)

Assessing the Significance of Model Selection in Ecology

Consequences of ignoring variable and spatially autocorrelated detection probability in spatial capture-recapture

Bayesian feedback in the framework of ecological sciences

Bayesian Model Selection in High-Dimensional Settings

A local evaluation of the individual state-space to scale up Bayesian spatial capture-recapture

Assessing the practical differences between model selection methods in inferences about choice response time tasks

The Best Fit Bayesian Hierarchical Generalized Linear Model Selection Using Information Complexity Criteria in the MCMC Approach