Abstract:Claeskens and Hjort (2003) constructed the focused information criterion (FIC) and developed frequentist model averaging methods using maximum likelihood estimators assuming the observations to be independent and identically distributed. Towards the immediate extensions and generalizations of these results, the present article is aimed at providing the focused model selection and model averaging methods using general maximum likelihood type estimators, popularly known as $M$-estimators. The necessary asymptotic theory is derived in a setup of stationary and strong mixing stochastic processes employing von Mises functional calculus of empirical processes and Le Cam's contiguity lemmas. We illustrate the proposed focused stochastic modeling methods using three well-known spacial cases of $M$-estimators, namely, conditional maximum likelihood estimators, conditional least square estimators and estimators based on method of moments. For the sake of simulation exercises, we consider two simple applications of FIC. The first application discusses the simultaneous selection of order of autoregression and symmetry of innovations in asymmetric Laplace autoregressive models. The second application demonstrates the FIC based choice between general scale-shape Gamma density and exponential density with shape being unity. We observe that in terms of the correct selections, FIC outperforms classical Akaike's information criterion AIC and performs at par with Bayesian information criterion BIC.

Focused Information Criterion and Model Averaging for Varying-Coefficient Partially Linear Models with Longitudinal Data

Focused information criterion and model averaging for generalized additive partial linear models

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Partial Linear Model Averaging Prediction for Longitudinal Data

A Mallows-Type Model Averaging Estimator for the Varying-Coefficient Partially Linear Model

A Unified Approach to Focused Information Criterion and Plug-In Averaging Method

Penalized Time-Varying Model Averaging

Model Averaging for Generalized Linear Model with Covariates that are Missing completely at Random

Optimal Model Averaging Estimation for Generalized Linear Models and Generalized Linear Mixed-Effects Models

Model Averaging with Averaging Covariance Matrix

Joint Mean–covariance Model in Generalized Partially Linear Varying Coefficient Models for Longitudinal Data

Optimal model averaging for partially linear models with missing response variables and error‐prone covariates

Jackknife Model Averaging for Mixed-Data Kernel-Weighted Spline Quantile Regressions

Model Averaging for Accelerated Failure Time Models with Missing Censoring Indicators

Model Averaging Based on Leave-Subject-out Cross-Validation

Geostatistical model averaging based on conditional information criteria

Weighted Quantile Regression in Varying-Coefficient Model with Longitudinal Data

Parsimonious Model Averaging With a Diverging Number of Parameters

Variable Selection in Quantile Varying Coefficient Models with Longitudinal Data

Model averaging for right censored data with measurement error

The Focused Information Criterion for Stochastic Model Selection Problems Using $M$-Estimators