Abstract:Dataset scaling, a.k.a. normalization, is an essential preprocessing step in a machine learning (ML) pipeline. It aims to adjust the scale of attributes in a way that they all vary within the same range. This transformation is known to improve the performance of classification models. Still, there are several scaling techniques (STs) to choose from, and no ST is guaranteed to be the best for a dataset regardless of the classifier chosen. It is thus a problem-and classifier-dependent decision. Furthermore, there can be a huge difference in performance when selecting the wrong technique; hence, it should not be neglected. That said, the trial-and-error process of finding the most suitable technique for a particular dataset can be unfeasible. As an alternative, we propose the Meta-scaler, which uses meta-learning (MtL) to build meta-models to automatically select the best ST for a given dataset and classification algorithm. The meta-models learn to represent the relationship between meta-features extracted from the datasets and the performance of specific classification algorithms on these datasets when scaled with different techniques. Our experiments using 12 base classifiers, 300 datasets, and five STs demonstrate the feasibility and effectiveness of the approach. When using the ST selected by the Meta-scaler for each dataset, 10 of 12 base models tested achieved statistically significantly better classification performance than any fixed choice of a single ST. The Meta-scaler also outperforms state-of-the-art MtL approaches for ST selection. The source code, data, and results from the experiments in this article are available at a GitHub repository (http://github.com/amorimlb/meta_scaler).

Machine learning using Stata/Python

pystacked: Stacking generalization and machine learning in Stata

ddml: Double/debiased machine learning in Stata

Scikit-learn: Machine Learning in Python

An Introduction to Machine Learning for Panel Data

Machine Learning Estimators: Implementation and Comparison in Python

Machine Learning Automation Toolbox (MLaut)

Machine Learning for Two-Sample Testing under Right-Censored Data: A Simulation Study

Efficient and Accurate In-Database Machine Learning with SQL Code Generation in Python

A refined approach for evaluating small datasets via binary classification using machine learning

Super learning in the SAS system

A Comprehensive Guide to Combining R and Python code for Data Science, Machine Learning and Reinforcement Learning

A Responsible Machine Learning Workflow with Focus on Interpretable Models, Post-hoc Explanation, and Discrimination Testing

Automated machine learning with R: AutoML tools for beginners in clinical research

PMLBmini: A Tabular Classification Benchmark Suite for Data-Scarce Applications

Reinforcement Learning in R

StockFormer: Learning Hybrid Trading Machines with Predictive Coding

MRCpy: A Library for Minimax Risk Classifiers

The Art of Natural Language Processing: Classical, Modern and Contemporary Approaches to Text Document Classification

Meta-Scaler: A Meta-Learning Framework for the Selection of Scaling Techniques

Machine Learning: An Applied Econometric Approach