Abstract:A vast amount of ecological knowledge generated recently has hinged upon the ability of model selection methods to discriminate among various ecological hypotheses. The last decade has seen the rise of Bayesian hierarchical models in ecology. Consequently, popular tools, such as the AIC, become largely inapplicable and other tools are not universally applicable. We focus on a class of competing Bayesian spatially explicit capture recapture (SECR) models and first apply some of the recommended Bayesian model selection tools: (1) Bayes Factor - using (a) Gelfand-Dey (b) harmonic mean methods, (2) DIC, (3) WAIC and (4) the posterior predictive loss function. In all, we evaluate 25 variants of model selection tools in our study. We evaluate these model selection tools from the standpoint of model selection and parameter estimation by contrasting the choice recommended by a tool with a `true' model. In all, we generate 120 simulated data sets using the true model and assess the frequency with which the true model is selected and how well the tool estimates N (population size). We find that when information content is low, no particular tool can be recommended to help realise, simultaneously, both the goals of model selection and parameter estimation. In such scenarios, we recommend that practitioners utilise our application of Bayes Factor for parameter estimation and recommend the posterior predictive loss approach for model selection when information content is low. When both the objectives are taken together, we recommend the use of our applications of Bayes Factor for Bayesian SECR models. Our study reveals that although new model selection tools are emerging (eg: WAIC) in the applied statistics literature, an uncritical absorption of these new tools (i.e. without assessing their efficacies for the problem at hand) into ecological practice may mislead inferences.

Comparision of AIC and BIC in the Selection of Stock-Recruitment Relationships

Comparison of Six Statistical Approaches in the Selection of Appropriate Fish Growth Models

Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC).

Model Population Analysis For Statistical Model Comparison

Evaluating the performance of AIC and BIC for selecting spatial econometric models

Forecasting Model Selection in Empirical ResearchFrom Stepwise Regression to Information Criteria

Asymptotics of AIC, BIC, and RMSEA for Model Selection in Structural Equation Modeling

Model Selection Criterion AIO and Its Application in ANOVA

A Comparative Investigation on Model Selection in Independent Factor Analysis

A brief guide to model selection, multimodel inference and model averaging in behavioural ecology using Akaike’s information criterion

The Best Fit Bayesian Hierarchical Generalized Linear Model Selection Using Information Complexity Criteria in the MCMC Approach

Consistent Model Selection Procedure for Random Coefficient INAR Models

A Theoretical Investigation of Several Model Selection Criteria for Dimensionality Reduction

A simple application of FIC to model selection

A Bayesian Information Criterion for Portfolio Selection

Model Selection with Misspecified Spatial Covariance Structure

An Information Analysis on Modeling Interaction Effects in Logistic Regression

Variable Selection with Stepwise and Best Subset Approaches.

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

The Effective Sample Size in Bayesian Information Criterion for Level-Specific Fixed and Random Effects Selection in a Two-Level Nested Model

Bayesian Model Selection for a Class of Spatially-Explicit Capture Recapture Models