Abstract:The use of machine learning (ML) and its applications is one of the leading research areas nowadays. Neural networks have recently gained enormous popularity and many works in various fields use them in the hope of improving previous results. The application of the artificial intelligence (AI) methods and the rationale for this decision is one issue, but the assessment of such a model is a completely different matter. People mostly use mean square error or less often mean absolute error in the absolute or percentage versions. One should remember that an error does not equal an error and a single value does not provide enough knowledge about the causes of some behavior. Proper interpretation of the results is crucial. It leads to further model improvement. It might be challenging, but allows us to obtain better and more robust solutions, which ultimately solve real-life problems. The ML model assessment is the multicriteria task. A single measure delivers only a fraction of the picture. This paper aims at filling that research gap. Commonly used integral measures are compared with alternative measures like factors of the Gaussian and non-Gaussian statistics, robust statistical estimators, tail index and the fractional order. The proposed methodology delivers new single-criteria indexes or the multicriteria approach, which extend the statistical concept of the moment ratio diagram (MRD) into the index ratio diagram (IRD). The proposed approach is validated using real data from the Full Truck Load cost estimation example. It compares 35 different ML regression algorithms applied to that task. The analysis gives an insight into the properties of the selected methods, enables their comparison and homogeneity analysis and ultimately leads towards constructive suggestions for their eventual proper use. The paper proposes new indexes and concludes that correct selection of the residuum analysis methodology makes the assessment and the ML regression credible.

Machine learning classification model comparison

Fairer and more accurate, but for whom?

Reinforcement of the Bank Loan Model using the Feature Selection Method of Machine Learning

An Empirical Comparison of Machine-Learning Methods on Bank Client Credit Assessments

Analyzing Machine Learning Models for Credit Scoring with Explainable AI and Optimizing Investment Decisions

Accuracy Comparison between Five Machine Learning Algorithms for Financial Risk Evaluation

A comparative study of forecasting corporate credit ratings using neural networks, support vector machines, and decision trees

SAFE Artificial Intelligence in Finance

How fair is machine learning in credit lending?

Machine Learning for an Enhanced Credit Risk Analysis: A Comparative Study of Loan Approval Prediction Models Integrating Mental Health Data

A Comparison between Explainable Machine Learning Methods for Classification and Regression Problems in the Actuarial Context

Model Selection Via Automated Machine Learning

SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk

Application of Machine Learning in Credit Risk Scorecard

Look Who's Talking: Interpretable Machine Learning for Assessing Italian SMEs Credit Default

Multicriteria Machine Learning Model Assessment—Residuum Analysis Review

Optimal Credit Scorecard Model Selection Using Costs Arising from Both False Positives and False Negatives

Machine Learning Classification Methods and Portfolio Allocation: An Examination of Market Efficiency

Enabling Machine Learning Algorithms for Credit Scoring -- Explainable Artificial Intelligence (XAI) methods for clear understanding complex predictive models

Assessment of Deep Neural Network and Gradient Boosting Machines for Credit Risk Prediction Accuracy

Transparency, Auditability and eXplainability of Machine Learning Models in Credit Scoring