Abstract:A vast amount of ecological knowledge generated recently has hinged upon the ability of model selection methods to discriminate among various ecological hypotheses. The last decade has seen the rise of Bayesian hierarchical models in ecology. Consequently, popular tools, such as the AIC, become largely inapplicable and other tools are not universally applicable. We focus on a class of competing Bayesian spatially explicit capture recapture (SECR) models and first apply some of the recommended Bayesian model selection tools: (1) Bayes Factor - using (a) Gelfand-Dey (b) harmonic mean methods, (2) DIC, (3) WAIC and (4) the posterior predictive loss function. In all, we evaluate 25 variants of model selection tools in our study. We evaluate these model selection tools from the standpoint of model selection and parameter estimation by contrasting the choice recommended by a tool with a `true' model. In all, we generate 120 simulated data sets using the true model and assess the frequency with which the true model is selected and how well the tool estimates N (population size). We find that when information content is low, no particular tool can be recommended to help realise, simultaneously, both the goals of model selection and parameter estimation. In such scenarios, we recommend that practitioners utilise our application of Bayes Factor for parameter estimation and recommend the posterior predictive loss approach for model selection when information content is low. When both the objectives are taken together, we recommend the use of our applications of Bayes Factor for Bayesian SECR models. Our study reveals that although new model selection tools are emerging (eg: WAIC) in the applied statistics literature, an uncritical absorption of these new tools (i.e. without assessing their efficacies for the problem at hand) into ecological practice may mislead inferences.

Performance of Model Fit and Selection Indices for Bayesian Structural Equation Modeling with Missing Data

Advances in Bayesian Model Fit Evaluation for Structural Equation Models

Adapting fit indices for Bayesian structural equation modeling: Comparison to maximum likelihood.

Impact of Informative Priors on Model Fit Indices in Bayesian Confirmatory Factor Analysis

The Accuracy of Bayesian Model Fit Indices in Selecting Among Multidimensional Item Response Theory Models

Fit for a Bayesian: An Evaluation of PPP and DIC for Structural Equation Modeling

Evaluating Small Sample Approaches for Model Test Statistics in Structural Equation Modeling

A Full Bayesian Model to Handle Structural Ones and Missingness in Economic Evaluations from Individual-Level Data

How robust are Structural Equation Models to model miss-specification? A simulation study

Prediction-Oriented Model Selection In Partial Least Squares Path Modeling

Alternative Ways of Assessing Model Fit

A Primer of Model Fit Indices in Structural Equation Modeling.

Bayesian Versus Frequentist Estimation for Structural Equation Models in Small Sample Contexts: A Systematic Review

Bayesian Model Selection for a Class of Spatially-Explicit Capture Recapture Models

Asymptotics of AIC, BIC, and RMSEA for Model Selection in Structural Equation Modeling

Making model judgments ROC(K)-solid: Tailored cutoffs for fit indices through simulation and ROC analysis in structural equation modeling

Model-Selection-Based Approaches to Identifying the Optimal Number of Factors in Multilevel Exploratory Factor Analysis

The Ethical Use of Fit Indices in Structural Equation Modeling: Recommendations for Psychologists

The Effect of Latent and Error Non-Normality on Measures of Fit in Structural Equation Modeling

Dynamic fit index cutoffs for one-factor models

Parsimony in Model Selection: Tools for Assessing Fit Propensity