Abstract:In the area of renewable energy including wind, solar, and electricity, Machine Learning has established a farreaching conceptual and algorithmic design framework. However, the design of Machine Learning architectures typically relies on substantial amounts of data. The data acquisition process often involves complex tasks of gathering, cleaning, and labeling data. This challenge is exacerbated in the energy sector due to concerns related to data security and the uniqueness of development initiatives, leading to a potential scarcity of available data. Quite commonly, researchers encounter a vast array of innovative projects that have not been studied in the past and therefore only limited data become available. Therefore, there is an urgent and highly motivated need to develop machine learning strategies that can construct reliable models in the presence of limited data. In this study, three machine learning models tailored for small-scale data scenarios are developed and analyzed. The first model, a fuzzy cluster ensemble approach, focuses on utilizing small training samples treated as the core of clustering. By applying clustering algorithms, one derives membership functions reflecting the structure of data that facilitate accurate predictions. The second model, a kernel integration framework, combines kernel functions with limited training data to calculate activation levels, enabling accurate prediction outputs. For both models, the final predictions are generated by applying weighted aggregations, where the weights are derived from the respective membership grades and activation levels of the data. Additionally, a neural network contrastive learning model is introduced, which enhances the training process by employing pairwise comparisons among data points. This method effectively increases the amount of useable training data, improving the model's ability to make accurate predictions. Together, these approaches provide a robust solution for making reliable predictions even in data-scarce scenarios within renewable energy research. Moreover, the predictive performance of these models is quantified using the Root Mean Square Error criterion. This study also assesses the performance of the developed models by forming a granular characterization of results delivered by the designed models. A comprehensive suite of experimental studies is included, accompanied by an exhaustive comparative analysis. Compared to conventional machine learning models, especially neural networks, the designed models offer reliable results even with limited training data, showing an improvement of around 20 %, thus laying the groundwork for digitization processes in the realm of sustainable energy.

72 Developing Machine Learning Models When Data is Limiting

On How Data Are Partitioned in Model Development and Evaluation: Confronting the Elephant in the Room to Enhance Model Generalization.

When not to use machine learning: A perspective on potential and limitations

Frequent Errors in Modeling by Machine Learning: A Prototype Case of Predicting the Timely Evolution of COVID-19 Pandemic

Robust Machine Learning by Transforming and Augmenting Imperfect Training Data

Interpretable and predictive models based on high-dimensional data in ecology and evolution

Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations

Synthetic data at scale: a development model to efficiently leverage machine learning in agriculture

SlimML: Removing Non-Critical Input Data in Large-Scale Iterative Machine Learning

Machine Learning in Environmental Research: Common Pitfalls and Best Practices.

Quality of Data in Machine Learning

Human-like machine learning: limitations and suggestions

A novel algorithm can generate data to train machine learning models in conditions of extreme scarcity of real world data

Strategies for Designing Machine Learning Models in Renewable Energy with Insufficient Data

Clinical prediction models and the multiverse of madness

Strategies for overcoming data scarcity, imbalance, and feature selection challenges in machine learning models for predictive maintenance

Developing a Dataset-Adaptive, Normalized Metric for Machine Learning Model Assessment: Integrating Size, Complexity, and Class Imbalance

Learning from Limited and Imperfect Data

Toward Generalizable Machine Learning Models in Speech, Language, and Hearing Sciences: Estimating Sample Size and Reducing Overfitting

Machine learning models and over-fitting considerations

The challenges of using machine learning models in psychiatric research and clinical practice