Abstract:Modern variable selection procedures make use of penalization methods to execute simultaneous model selection and estimation. A popular method is the LASSO (least absolute shrinkage and selection operator), the use of which requires selecting the value of a tuning parameter. This parameter is typically tuned by minimizing the cross-validation error or Bayesian information criterion (BIC) but this can be computationally intensive as it involves fitting an array of different models and selecting the best one. In contrast with this standard approach, we have developed a procedure based on the so-called "smooth IC" (SIC) in which the tuning parameter is automatically selected in one step. We also extend this model selection procedure to the distributional regression framework, which is more flexible than classical regression modelling. Distributional regression, also known as multiparameter regression (MPR), introduces flexibility by taking account of the effect of covariates through multiple distributional parameters simultaneously, e.g., mean and variance. These models are useful in the context of normal linear regression when the process under study exhibits heteroscedastic behaviour. Reformulating the distributional regression estimation problem in terms of penalized likelihood enables us to take advantage of the close relationship between model selection criteria and penalization. Utilizing the SIC is computationally advantageous, as it obviates the issue of having to choose multiple tuning parameters.

A Joint Regression Variable and Autoregressive Order Selection Criterion

Model Order Selection In Errors-In-Variables System Identification

Regularization and variable selection for infinite variance autoregressive models

Consistent Model Selection Procedure for Random Coefficient INAR Models

Variable Selection with Stepwise and Best Subset Approaches.

A Simple Information Criterion for Variable Selection in High‐Dimensional Regression

Selection of Regression Models under Linear Restrictions for Fixed and Random Designs

Variable Selection in Credit Risk Models for Chinese Listed Companies

Testing for variance changes in autoregressive models with unknown order

Variable Selection Using a Smooth Information Criterion for Distributional Regression Models

Deviance Information Criterion for Comparing VAR Models

Forecasting Model Selection in Empirical ResearchFrom Stepwise Regression to Information Criteria

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

Variable Selection in Data Envelopment Analysis Via Akaike’s Information Criteria

Variable Selection Based Testing for Parameter Changes in Regression with Autoregressive Dependence

Comprehensive Stepwise Selection for Logistic Regression

Two-step Adaptive Model Selection for Vector Autoregressive Processes

Variable Selection for Additive Model Via Cumulative Ratios of Empirical Strengths Total

Variable Selection of Spatial Logistic Autoregressive Model with Linear Constraints

Diagnostic checks in time series models based on a new correlation coefficient of residuals

Robust variable selection with exponential squared loss for the partially linear varying coefficient spatial autoregressive model