Abstract:With computational evolution, there has been a growth in the number of machine learning algorithms and they became more complex and robust. A greater challenge is upon faster and more practical ways to find hyperparameters that will set up each algorithm individually. This article aims to use meta‐learning as a practicable solution for recommending hyperparameters from similar datasets, through their meta‐features structures, than to adopt the already trained XGBoost parameters for a new database. This reduced computational costs and also aimed to make real‐time decision‐making feasible or reduce any extra costs for companies for new information. The experimental results, adopting 198 data sets, attested to the success of the heuristics application using meta‐learning to compare datasets structure analysis. Initially, a characterization of the datasets was performed by combining three groups of meta‐features (general, statistical, and info‐theory), so that there would be a way to compare the similarity between sets and, thus, apply meta‐learning to recommend the hyperparameters. Later, the appropriate number of sets to characterize the XGBoost turning was tested. The obtained results were promising, showing an improved performance in the accuracy of the XGBoost, k = {4 − 6}, using the average of the hyperparameters values and, comparing to the standard grid‐search hyperparameters set by default, it was obtained that, in 78.28% of the datasets, the meta‐learning methodology performed better. This study, therefore, shows that the adoption of meta‐learning is a competitive alternative to generalize the XGBoost model, expecting better statistics performance (accuracy etc.) rather than adjusting to a single/particular model.

Asymptotic Meta Learning for Cross Validation of Models for Financial Data

Best investment strategy selection using asymptotic meta learning

Model-Agnostic Meta-Learning for Natural Language Understanding Tasks in Finance

Model-Agnostic Meta-Learning with Optimal Alternative Scaling Value and Its Application to Industrial Soft Sensing

Model Selection Via Automated Machine Learning

Meta weight learning via model-agnostic meta-learning

To Learn Effective Features: Understanding the Task-Specific Adaptation of MAML

MetaSelector: Meta-Learning for Recommendation with User-Level Adaptive Model Selection

Optimization on selecting XGBoost hyperparameters using meta‐learning

META-ANOVA: Screening interactions for interpretable machine learning

Boosting Moving Average Reversion Strategy for Online Portfolio Selection: A Meta-learning Approach.

Adaptive model-agnostic meta-learning network for cross-machine fault diagnosis with limited samples

Cross-lingual Adaption Model-Agnostic Meta-Learning for Natural Language Understanding

Successive model-agnostic meta-learning for few-shot fault time series prognosis

Fast Leave-One-Out Cross-Validation Algorithm for Extreme Learning Machine

Adaptive Bayesian Linear Regression for Automated Machine Learning

Fast Adaptation with Kernel and Gradient based Meta Leaning

On the Global Optimality of Model-Agnostic Meta-Learning

Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated Learning

Making Scalable Meta Learning Practical