Bankruptcy Prediction using the XGBoost Algorithm and Variable Importance Feature Engineering

Sami Ben Jabeur,Nicolae Stef,Pedro Carmona
DOI: https://doi.org/10.1007/s10614-021-10227-1
IF: 1.741
2022-01-23
Computational Economics
Abstract:The emergence of big data, information technology, and social media provides an enormous amount of information about firms’ current financial health. When facing this abundance of data, decision makers must identify the crucial information to build upon an effective and operative prediction model with a high quality of the estimated output. The feature selection technique can be used to select significant variables without lowering the quality of performance classification. In addition, one of the main goals of bankruptcy prediction is to identify the model specification with the strongest explanatory power. Building on this premise, an improved XGBoost algorithm based on feature importance selection (FS-XGBoost) is proposed. FS-XGBoost is compared with seven machine learning algorithms based on three well-known feature selection methods that are frequently used in bankruptcy prediction: stepwise discriminant analysis, stepwise logistic regression, and partial least squares discriminant analysis (PLS-DA). Our experimental results confirm that FS-XGBoost provides more accurate predictions, outperforming traditional feature selection methods.
economics,mathematics, interdisciplinary applications,management
What problem does this paper attempt to address?