A survey of machine learning in credit risk

Joseph Breeden

DOI: https://doi.org/10.21314/jcr.2021.008

2021-01-01

The Journal of Credit Risk

Abstract:This paper surveys the impressively broad range of machine learning methods and application areas for credit risk.

What problem does this paper attempt to address?

Survey of Machine Learning in Credit Risk

Joseph L Breeden

DOI: https://doi.org/10.2139/ssrn.3616342

2020-01-01

SSRN Electronic Journal

Abstract:Machine learning algorithms have come to dominate some industries. After decades of resistance from examiners and auditors, machine learning is now moving from the research desk to the application stack for credit scoring and a range of other applications in credit risk. This migration is not without novel risks and challenges. Much of the research is now shifting from how best to make the models to how best to use the models in a regulatory-compliant business context.This article seeks to survey the impressively broad range of machine learning methods and application areas for credit risk. In the process of that survey, we create a taxonomy to think about how different machine learning components are matched to create specific algorithms. The reasons for where machine learning succeeds over simple linear methods is explored through a specific lending example. Throughout, we highlight open questions, ideas for improvements, and a framework for thinking about how to choose the best machine learning method for a specific problem.
Machine Learning for Enhanced Credit Risk Assessment: An Empirical Approach

Nicolas Suhadolnik,Jo Ueyama,Sergio Da Silva

DOI: https://doi.org/10.3390/jrfm16120496

2023-11-27

Journal of Risk and Financial Management

Abstract:Financial institutions and regulators increasingly rely on large-scale data analysis, particularly machine learning, for credit decisions. This paper assesses ten machine learning algorithms using a dataset of over 2.5 million observations from a financial institution. We also summarize key statistical and machine learning models in credit scoring and review current research findings. Our results indicate that ensemble models, particularly XGBoost, outperform traditional algorithms such as logistic regression in credit classification. Researchers and experts in the subject of credit risk can use this work as a practical reference as it covers crucial phases of data processing, exploratory data analysis, modeling, and evaluation metrics.
Machine Learning for Financial Risk Management: A Survey

Akib Mashrur,Wei Luo,Nayyar A. Zaidi,Antonio Robles-Kelly

DOI: https://doi.org/10.1109/access.2020.3036322

IF: 3.9

2020-01-01

IEEE Access

Abstract:Financial risk management avoids losses and maximizes profits, and hence is vital to most businesses. As the task relies heavily on information-driven decision making, machine learning is a promising source for new methods and technologies. In recent years, we have seen increasing adoption of machine learning methods for various risk management tasks. Machine-learning researchers, however, often struggle to navigate the vast and complex domain knowledge and the fast-evolving literature. This paper fills this gap, by providing a systematic survey of the rapidly growing literature of machine learning research for financial risk management. The contributions of the paper are four-folds: First, we present a taxonomy of financial-risk-management tasks and connect them with relevant machine learning methods. Secondly, we highlight significant publications in the past decade. Thirdly, we identify major challenges being faced by researchers in this area. And finally, we point out emerging trends and promising research directions.

computer science, information systems,telecommunications,engineering, electrical & electronic
Machine learning techniques for credit risk evaluation: a systematic literature review

Siddharth Bhatore,Lalit Mohan,Y. Raghu Reddy

DOI: https://doi.org/10.1007/s42786-020-00020-3

2020-04-01

Journal of Banking and Financial Technology

Abstract:Credit risk is the risk of financial loss when a borrower fails to meet the financial commitment. While there are many factors that constitute credit risk, due diligence while giving loan (credit scoring), continuous monitoring of customer payments and other behaviour patterns could reduce the probability of accumulating non-performing assets (NPA) and frauds. In the past few years, the quantum of NPAs and frauds have gone up significantly, and therefore it has become imperative that banks and financial institutions use robust mechanisms to predict the performance of loans. The past two decades has seen an immense growth in the area of artificial intelligence, most notably machine learning (ML) with improved access to internet, data, and compute. Whilst there are credit rating agencies and credit scoring companies that provide their analysis of a customer to banks on a fee, the researchers continue to explore various ML techniques to improve the accuracy level of credit risk evaluation. In this survey paper, we performed a systematic literature review on existing research methods and ML techniques for credit risk evaluation. We reviewed a total of 136 papers on credit risk evaluation published between 1993 and March 2019. We studied the implications of hyper parameters on ML techniques being used to evaluate credit risk and, analyzed the limitations of the current studies and research trends. We observed that Ensemble and Hybrid models with neural networks and SVM are being more adopted for credit scoring, NPA prediction and fraud detection. We also realized that lack of comprehensive public datasets continue to be an area of concern for researchers.
Machine Learning for Credit Risk Assessment in Banking: An Overview

Goutham Sabbani,

DOI: https://doi.org/10.47363/jaicc/2022(1)e102

2022-09-30

Abstract:In 2019, A European bank named Deutsche Bank adopted a machine learning model into its system. This resulted in 20% within the first year, showcasing the transformative potential of artificial intelligence in the credit risk department. The evolution of machine learning models from simple statistical models to complex machine learning algorithms capable of analyzing vast amounts of datasets with high accuracy. Early machine models relied upon logistic and linear regression, but the modern approach utilizes decision trees, neural networks, and ensemble methods to enhance prediction power and reliability. This paper will talk about advancements in machine learning techniques for credit risk assessment, the benefits and challenges of integrating these models in traditional banking systems, and the emergence of these technologies in the future. It explores various algorithms, highlighting their applications and effectiveness in our daily lives. Additionally, regulatory and ethical implications are examined to provide a comprehensive overview of the post.
Machine learning-driven credit risk: a systemic review

Si Shi,Rita Tse,Wuman Luo,Stefano D’Addona,Giovanni Pau

DOI: https://doi.org/10.1007/s00521-022-07472-2

2022-07-17

Neural Computing and Applications

Abstract:Credit risk assessment is at the core of modern economies. Traditionally, it is measured by statistical methods and manual auditing. Recent advances in financial artificial intelligence stemmed from a new wave of machine learning (ML)-driven credit risk models that gained tremendous attention from both industry and academia. In this paper, we systematically review a series of major research contributions (76 papers) over the past eight years using statistical, machine learning and deep learning techniques to address the problems of credit risk. Specifically, we propose a novel classification methodology for ML-driven credit risk algorithms and their performance ranking using public datasets. We further discuss the challenges including data imbalance, dataset inconsistency, model transparency, and inadequate utilization of deep learning models. The results of our review show that: 1) most deep learning models outperform classic machine learning and statistical algorithms in credit risk estimation, and 2) ensemble methods provide higher accuracy compared with single models. Finally, we present summary tables in terms of datasets and proposed models.

computer science, artificial intelligence
Statistical and machine learning models in credit scoring: A systematic literature survey

Xolani Dastile,Turgay Celik,Moshe Potsane

DOI: https://doi.org/10.1016/j.asoc.2020.106263

IF: 8.7

2020-06-01

Applied Soft Computing

Abstract:<p>In practice, as a well-known statistical method, the logistic regression model is used to evaluate the credit-worthiness of borrowers due to its simplicity and transparency in predictions. However, in literature, sophisticated machine learning models can be found that can replace the logistic regression model. Despite the advances and applications of machine learning models in credit scoring, there are still two major issues: the incapability of some of the machine learning models to explain predictions; and the issue of imbalanced datasets. As such, there is a need for a thorough survey of recent literature in credit scoring. This article employs a systematic literature survey approach to systematically review statistical and machine learning models in credit scoring, to identify limitations in literature, to propose a guiding machine learning framework, and to point to emerging directions. This literature survey is based on 74 primary studies, such as journal and conference articles, that were published between 2010 and 2018. According to the meta-analysis of this literature survey, we found that in general, an ensemble of classifiers performs better than single classifiers. Although deep learning models have not been applied extensively in credit scoring literature, they show promising results.</p>

computer science, artificial intelligence, interdisciplinary applications
Machine Learning in Banking Risk Management: A Literature Review

Martin Leo,Suneel Sharma,K. Maddulety

DOI: https://doi.org/10.3390/risks7010029

2019-03-05

Risks

Abstract:There is an increasing influence of machine learning in business applications, with many solutions already implemented and many more being explored. Since the global financial crisis, risk management in banks has gained more prominence, and there has been a constant focus around how risks are being detected, measured, reported and managed. Considerable research in academia and industry has focused on the developments in banking and risk management and the current and emerging challenges. This paper, through a review of the available literature seeks to analyse and evaluate machine-learning techniques that have been researched in the context of banking risk management, and to identify areas or problems in risk management that have been inadequately explored and are potential areas for further research. The review has shown that the application of machine learning in the management of banking risks such as credit risk, market risk, operational risk and liquidity risk has been explored; however, it doesn’t appear commensurate with the current industry level of focus on both risk management and machine learning. A large number of areas remain in bank risk management that could significantly benefit from the study of how machine learning can be applied to address specific problems.

English Else
Application Analysis of Machine Learning Models in Credit Risk

Shiyi Liu

DOI: https://doi.org/10.54097/6qm0dk77

2024-08-15

Abstract:Traditional credit risk assessment models frequently depend on historical data and predefined rules, a limitation that may fail to fully encompass the intricate and dynamic characteristics of credit risk. With the rise of machine learning (ML), credit risk can be assessed more easily according to historical data, and it offers a more dynamic and data-driven approach to credit risk assessment. This essay will provide an overview of significant research advancements made in the last five years. It demonstrates consumers and financial institutions have different preferred ML models. Moreover, using different criteria such as AUC and Brier to evaluate accuracy yields different results. And there is a greater prospect for deep learning. Overall, the advent of machine learning has revolutionised the field of credit risk modelling, offering new insights and methodologies for predictive analytics. These advancements utilise statistical, machine learning, and deep learning methods to tackle credit risk issues. In addition, this essay will explore several obstacles and forecast future trends.
Data Driven Credit Risk Management Process: a Machine Learning Approach

Mingrui Chen,Yann Dautais,LiGuo Huang,Jidong Ge

DOI: https://doi.org/10.1145/3084100.3084113

2017-01-01

Abstract:Credit scoring process, the most important part in credit risk management, aims at estimating the probability that an applicant will perform bad credit behaviors (e.g., loan default). Managing and developing effective and reliable risk assessment procedures in order to mitigate potential loss caused by new applicants heavily relies on the performance of scoring process. Traditionally this process is manually developed, which is time-consuming. In this paper, we propose an automated credit risk management process based on machine learning to ease the scoring process in order to reduce the human effort. This process is data driven: it leverages machine learning to automatically analyze vast amounts of historical data and build predictive model. We evaluate our process with a real-world proprietary dataset and achieved good performance, which shows the feasibility of using machine learning to facilitate the credit risk management process.
Machine Learning in Financial Crisis Prediction: A Survey

Wei-Yang Lin,Ya‐Han Hu,Chih‐Fong Tsai

DOI: https://doi.org/10.1109/tsmcc.2011.2170420

2012-01-01

Abstract:For financial institutions, the ability to predict or forecast business failures is crucial, as incorrect decisions can have direct financial consequences. Bankruptcy prediction and credit scoring are the two major research problems in the accounting and finance domain. In the literature, a number of models have been developed to predict whether borrowers are in danger of bankruptcy and whether they should be considered a good or bad credit risk. Since the 1990s, machine-learning techniques, such as neural networks and decision trees, have been studied extensively as tools for bankruptcy prediction and credit score modeling. This paper reviews 130 related journal papers from the period between 1995 and 2010, focusing on the development of state-of-the-art machine-learning techniques, including hybrid and ensemble classifiers. Related studies are compared in terms of classifier design, datasets, baselines, and other experimental factors. This paper presents the current achievements and limitations associated with the development of bankruptcy-prediction and credit-scoring models employing machine learning. We also provide suggestions for future research.
Advancing credit risk assessment and financial decision-making: Integrating modern techniques and insights

Jennifer Muhindo,Kevin Mukasa,Doreen Kitakufe,Jimmy Kato

DOI: https://doi.org/10.30574/wjarr.2024.23.2.2565

2024-08-30

World Journal of Advanced Research and Reviews

Abstract:Credit risk assessment and fraud detection are critical functions in the financial industry, necessary for ensuring the stability and integrity of financial institutions. Traditional approaches often struggle to accurately assess risk and detect fraudulent activities in a timely manner. However, the rise of machine learning has introduced powerful tools that leverage large datasets and advanced algorithms to improve these processes. This research paper investigates the application of machine learning techniques in credit risk assessment and fraud detection within financial transactions. The paper begins by emphasizing the importance of accurate risk assessment and fraud detection in the financial sector and introduces machine learning as a solution to the limitations of traditional methods. A thorough literature review examines existing methodologies, algorithms, and trends, highlighting the advancements in this field. The discussion covers data acquisition and preprocessing techniques, underscoring the necessity of clean and relevant data for effective model training. Additionally, feature engineering strategies are explored to extract valuable insights from financial transaction data, enhancing the predictive power of machine learning models. The research analyzes various machine learning algorithms, such as logistic regression, decision trees, random forests, support vector machines, and neural networks, as well as ensemble methods. Model evaluation metrics, including accuracy, precision, recall, and ROC-AUC, are employed to assess the performance of these algorithms. The paper presents case studies and experimental results to demonstrate the practical application of machine learning models in real-world scenarios, showcasing their effectiveness in improving credit risk assessment and fraud detection. Furthermore, the research explores challenges such as imbalanced datasets, model interpretability, and regulatory compliance, offering insights into potential solutions and future research directions. The integration of behavioral finance, Bayesian networks, and optimization methods is also discussed, highlighting how these modern approaches, combined with big data analytics, can enhance predictive accuracy and decision reliability. In conclusion, this research underscores the transformative potential of machine learning in credit risk assessment and fraud detection within financial transactions. By adopting advanced algorithms and data-driven approaches, financial institutions can significantly improve their risk management strategies, mitigate potential risks, and protect against fraudulent activities. This ultimately contributes to a more secure and resilient financial ecosystem, enabling institutions to maintain a competitive edge in an ever-evolving market.
How artificial intelligence and machine learning are transforming credit risk prediction in the financial sector

Bibitayo Ebunlomo Abikoye,Cedrick Agorbia-Atta

DOI: https://doi.org/10.30574/ijsra.2024.12.2.1467

2024-08-30

International Journal of Science and Research Archive

Abstract:In the rapidly evolving financial landscape, effectively managing credit risk is crucial for the stability and profitability of financial institutions. Traditional methods of credit risk management, which rely heavily on statistical models and expert judgment, are being transformed by the advent of artificial intelligence (AI) and machine learning (ML). These technologies are introducing unprecedented accuracy and efficiency into the risk assessment processes, making them indispensable tools for modern financial institutions. A recent publication, "Machine Learning for Credit Risk Prediction: A Systematic Literature Review," authored by Jomark Pablo Noriega, Luis Antonio Rivera, and Jose Alfredo Herrera, offers a comprehensive analysis of the current state of ML applications in credit risk prediction. The review synthesizes findings from 52 relevant studies, providing a detailed overview of the most effective ML models, key performance metrics, and the challenges and opportunities associated with implementing these technologies. The review identifies that machine learning models, particularly those in the boosted category, such as Gradient Boosting Machines (GBM) and XGBoost, have emerged as leading techniques in credit risk prediction due to their superior ability to handle large datasets and complex variable interactions. These models have demonstrated remarkable performance when evaluated using metrics such as the Area Under Curve (AUC), Accuracy (ACC), Recall, Precision, and the F1 Score, making them highly effective tools for predicting credit risk. However, deploying ML models has its challenges. The inherent "black box" nature of many ML algorithms poses significant interpretability issues, hindering trust and regulatory acceptance. Addressing these concerns requires the development of more transparent and explanatory AI systems. Additionally, selecting relevant features, managing multicollinearity, and dealing with imbalanced datasets remain critical areas needing further research and refinement. The review also highlights several future research directions to enhance the applicability of ML in credit risk management. These include improving model interpretability, enhancing data quality and diversity, and integrating alternative data sources such as social media and transaction data to create more comprehensive and fair credit scoring systems. The findings from this review are particularly pertinent for financial institutions in Africa, where the rapid adoption of fintech solutions is driving significant advancements in financial inclusion and risk management. By leveraging ML technologies, these institutions can enhance their predictive capabilities and foster a more inclusive financial ecosystem.
An Empirical Comparison of Machine-Learning Methods on Bank Client Credit Assessments

Lkhagvadorj Munkhdalai,Tsendsuren Munkhdalai,Oyun-Erdene Namsrai,Jong Lee,Keun Ryu

DOI: https://doi.org/10.3390/su11030699

IF: 3.9

2019-01-29

Sustainability

Abstract:Machine learning and artificial intelligence have achieved a human-level performance in many application domains, including image classification, speech recognition and machine translation. However, in the financial domain expert-based credit risk models have still been dominating. Establishing meaningful benchmark and comparisons on machine-learning approaches and human expert-based models is a prerequisite in further introducing novel methods. Therefore, our main goal in this study is to establish a new benchmark using real consumer data and to provide machine-learning approaches that can serve as a baseline on this benchmark. We performed an extensive comparison between the machine-learning approaches and a human expert-based model—FICO credit scoring system—by using a Survey of Consumer Finances (SCF) data. As the SCF data is non-synthetic and consists of a large number of real variables, we applied two variable-selection methods: the first method used hypothesis tests, correlation and random forest-based feature importance measures and the second method was only a random forest-based new approach (NAP), to select the best representative features for effective modelling and to compare them. We then built regression models based on various machine-learning algorithms ranging from logistic regression and support vector machines to an ensemble of gradient boosted trees and deep neural networks. Our results demonstrated that if lending institutions in the 2001s had used their own credit scoring model constructed by machine-learning methods explored in this study, their expected credit losses would have been lower, and they would be more sustainable. In addition, the deep neural networks and XGBoost algorithms trained on the subset selected by NAP achieve the highest area under the curve (AUC) and accuracy, respectively.

environmental sciences,environmental studies,green & sustainable science & technology
Application of Machine Learning in Credit Risk Scorecard

Choon Yi Lee,Siew Khew Koh,Min Cherng Lee,Wei Yeing Pan

DOI: https://doi.org/10.1007/978-981-16-7334-4_29

2021-01-01

Abstract:Machine Learning models have been extensively researched in the area of credit scoring. Banks have put in substantial resources into improving the credit risk model performance as improvement in accuracy by a fraction could translate into significant future savings. Given the lack of interpretability in machine learning models, it is often not used for capital provisioning in banks. This paper uses the Taiwan Credit Card dataset and illustrates the use of machine learning techniques to improve construction of credit scoring models. In factor transformation for a credit scorecard, Decision Tree technique showed the ability to produce quick and predictive transformation rule as compared to traditional approach. The resulting scorecard also showed high predictive power on Test sample. Given the ability of machine learning to produce predictive result, banks should explore on the techniques to improve their overall credit risk management framework. Credit underwriting scorecard could be built using higher discriminatory power techniques, as more good customers are likely to be better than score cut-off and thus accepted by banks.
Credit Risk Analysis Using Machine and Deep Learning Models

Peter Martey Addo,Dominique Guegan,Bertrand Hassani

DOI: https://doi.org/10.2139/ssrn.3155047

2018-01-01

SSRN Electronic Journal

Abstract:Due to the hyper technology associated to Big Data, data availability and computing power, most banks or lending financial institutions are renewing their business models. Credit risk predictions, monitoring, model reliability and effective loan processing are key to decision making and transparency. In this work, we build binary classifiers based on machine and deep learning models on real data in predicting loan default probability. The top 10 important features from these models are selected and then used in the modelling process to test the stability of binary classifiers by comparing performance on separate data. We observe that tree-based models are more stable than models based on multilayer artificial neural networks. This opens several questions relative to the intensive used of deep learning systems in the enterprises.
A Comparative Assessment of Credit Risk Model Based on Machine Learning ——a case study of bank loan data

Yuelin Wang,Yihan Zhang,Yan Lu,Xinran Yu

DOI: https://doi.org/10.1016/j.procs.2020.06.069

2020-01-01

Procedia Computer Science

Abstract:Recently some techniques (such as statistical techniques and machine learning techniques) have been developed for evaluating individual credit information to decide whether the person meets the criteria of credit financing, and the process is known as credit scoring. This paper mainly focuses on the comparative assessment of the performances of five popular classifiers involved in machine learning used for credit scoring: Naive Bayesian Model, Logistic Regression Analysis, Random Forest, Decision Tree, and K-Nearest Neighbor Classifier. Each classifier has its own strength and weakness, it is assertive to say which one is the best. However, the results of this experiment pinpoint that Random Forest performs better than others in terms of precision, recall, AUC (area under curve) and accuracy.
How Do Machine Learning and Non-Traditional Data Affect Credit Scoring? New Evidence from a Chinese Fintech Firm

Leonardo Gambacorta,Yiping Huang,Han Qiu,Jingyi Wang

DOI: https://doi.org/10.1016/j.jfs.2024.101284

IF: 3.554

2024-01-01

Journal of Financial Stability

Abstract:This paper compares the predictive power of credit scoring models based on machine learning techniques with that of traditional loss and default models. Using proprietary transaction-level data from a leading fintech company in China, we test the performance of different models to predict losses and defaults both in normal times and when the economy is subject to a shock. In particular, we analyse the case of an (exogenous) change in regulation policy on shadow banking in China that caused credit conditions to deteriorate. We find that the model based on machine learning and non-traditional data is better able to predict losses and defaults than traditional models in the presence of a negative shock to the aggregate credit supply. This result reflects a higher capacity of non-traditional data to capture relevant borrower characteristics and of machine learning techniques to better mine the non-linear relationship between variables in a period of stress.
Machine learning in internet financial risk management: A systematic literature review

Xu Tian,ZongYi Tian,Saleh F. A. Khatib,Yan Wang

DOI: https://doi.org/10.1371/journal.pone.0300195

IF: 3.7

2024-04-16

PLoS ONE

Abstract:Internet finance has permeated into myriad households, bringing about lifestyle convenience alongside potential risks. Presently, internet finance enterprises are progressively adopting machine learning and other artificial intelligence methods for risk alertness. What is the current status of the application of various machine learning models and algorithms across different institutions? Is there an optimal machine learning algorithm suited for the majority of internet finance platforms and application scenarios? Scholars have embarked on a series of studies addressing these questions; however, the focus predominantly lies in comparing different algorithms within specific platforms and contexts, lacking a comprehensive discourse and summary on the utilization of machine learning in this domain. Thus, based on the data from Web of Science and Scopus databases, this paper conducts a systematic literature review on all aspects of machine learning in internet finance risk in recent years, based on publications trends, geographical distribution, literature focus, machine learning models and algorithms, and evaluations. The research reveals that machine learning, as a nascent technology, whether through basic algorithms or intricate algorithmic combinations, has made significant strides compared to traditional credit scoring methods in predicting accuracy, time efficiency, and robustness in internet finance risk management. Nonetheless, there exist noticeable disparities among different algorithms, and factors such as model structure, sample data, and parameter settings also influence prediction accuracy, although generally, updated algorithms tend to achieve higher accuracy. Consequently, there is no one-size-fits-all approach applicable to all platforms; each platform should enhance its machine learning models and algorithms based on its unique characteristics, data, and the development of AI technology, starting from key evaluation indicators to mitigate internet finance risks.

multidisciplinary sciences

A survey of machine learning in credit risk

Survey of Machine Learning in Credit Risk

Machine Learning for Enhanced Credit Risk Assessment: An Empirical Approach

Machine Learning for Financial Risk Management: A Survey

Machine learning techniques for credit risk evaluation: a systematic literature review

Machine Learning for Credit Risk Assessment in Banking: An Overview

Machine learning-driven credit risk: a systemic review

Statistical and machine learning models in credit scoring: A systematic literature survey

Machine Learning in Banking Risk Management: A Literature Review

Application Analysis of Machine Learning Models in Credit Risk

Data Driven Credit Risk Management Process: a Machine Learning Approach

Machine Learning in Financial Crisis Prediction: A Survey

Advancing credit risk assessment and financial decision-making: Integrating modern techniques and insights

How artificial intelligence and machine learning are transforming credit risk prediction in the financial sector

An Empirical Comparison of Machine-Learning Methods on Bank Client Credit Assessments

Application of Machine Learning in Credit Risk Scorecard

Credit Risk Analysis Using Machine and Deep Learning Models

A Comparative Assessment of Credit Risk Model Based on Machine Learning ——a case study of bank loan data

How Do Machine Learning and Non-Traditional Data Affect Credit Scoring? New Evidence from a Chinese Fintech Firm

Machine learning in internet financial risk management: A systematic literature review