Abstract:The use of machine learning (ML) and its applications is one of the leading research areas nowadays. Neural networks have recently gained enormous popularity and many works in various fields use them in the hope of improving previous results. The application of the artificial intelligence (AI) methods and the rationale for this decision is one issue, but the assessment of such a model is a completely different matter. People mostly use mean square error or less often mean absolute error in the absolute or percentage versions. One should remember that an error does not equal an error and a single value does not provide enough knowledge about the causes of some behavior. Proper interpretation of the results is crucial. It leads to further model improvement. It might be challenging, but allows us to obtain better and more robust solutions, which ultimately solve real-life problems. The ML model assessment is the multicriteria task. A single measure delivers only a fraction of the picture. This paper aims at filling that research gap. Commonly used integral measures are compared with alternative measures like factors of the Gaussian and non-Gaussian statistics, robust statistical estimators, tail index and the fractional order. The proposed methodology delivers new single-criteria indexes or the multicriteria approach, which extend the statistical concept of the moment ratio diagram (MRD) into the index ratio diagram (IRD). The proposed approach is validated using real data from the Full Truck Load cost estimation example. It compares 35 different ML regression algorithms applied to that task. The analysis gives an insight into the properties of the selected methods, enables their comparison and homogeneity analysis and ultimately leads towards constructive suggestions for their eventual proper use. The paper proposes new indexes and concludes that correct selection of the residuum analysis methodology makes the assessment and the ML regression credible.

RELARM: A rating model based on relative PCA attributes and k-means clustering

Cares: A Ranking-Oriented Cadal Recommender System

Research on 3D Object Recognition Algorithm Based on PCA and Moment Invariant

Radar Hrrp Target Recognition Based On The Improved Kernel Distance Fuzzy C-Means Clustering Method

Application of the Ranking Relative Principal Component Attributes Network Model (REL-PCANet) for the Inclusive Development Index Estimation

Principal Ellipsoid Analysis (PEA): Efficient non-linear dimension reduction & clustering

Multicriteria Machine Learning Model Assessment—Residuum Analysis Review

A New One-Class Classifier: Relevant Component Analysis Data Description

Feature Selection For Identifying Critical Variables Of Principal Components Based On K-Nearest Neighbor Rule

Rating models: emerging market distinctions

PCA-KL: a parametric dimensionality reduction approach for unsupervised metric learning

A Rational Model of Dimension-reduced Human Categorization

RP-LGMC: Rating prediction based on local and global information with matrix clustering

Image Clustering Based On Graph Regularized Robust Principal Component Analysis

Reassessing Relationality for Bipolar Data

PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors

EMOTIF – A system for modeling 3D environment evaluation based on 7D emotional vectors

Ensemble Principal Component Analysis

Cross-Domain Object Representation Via Robust Low-Rank Correlation Analysis.

Multivariate curve resolution-soft independent modelling of class analogy (MCR-SIMCA)

Improving Associative Classification by Incorporating Novel Interestingness Measures