Abstract:The uncertainty of wind power as the main obstacle of its integration into the power grid can be addressed by an accurate and efficient wind power forecast. Among the various wind power forecasting methods, machine learning (ML) algorithms, are recognized as a powerful wind power forecasting tool, however, their performance is highly dependent on the proper tuning of their hyperparameters. Common hyperparameter tuning methods such as grid search or random search are time-consuming, computationally expensive, and unreliable for complex models such as deep learning neural networks. Therefore, there is an urgent need for automatic methods to discover optimal hyperparameters for higher accuracy and efficiency of prediction models. In this study, a novel investigation is contributed to the field of wind power forecasting by a comprehensive comparison of three advanced techniques – Scikit-opt, Optuna, and Hyperopt – for hyperparameter optimisation of Convolutional Neural Network (CNN) and Long Short-Term Memory Network (LSTM) models, a facet that, to our knowledge, has not been systematically explored in existing literature. The impact of these optimisation techniques on the accuracy and efficiency of the CNN and LSTM models are assessed by comparing the root mean square error (RMSE) of the predictions and the required time to tune the models. The results show that the Optuna algorithm, using a Tree-structured Parzen Estimator (TPE) search method and Expected Improvement (EI) acquisition function, has the best efficiency for both CNN and LSTM models. In terms of accuracy, it is demonstrated that while for the CNN model all the optimisation methods achieve similar performances, the LSTM model optimised by the Hyperopt algorithm, based on the annealing search method, results in the highest accuracy. In addition, for the first time in this research, the impact of the random initialization features on the performance of the forecasting models with neural networks is investigated. The proposed structures for deep learning models were examined to determine the most robust structure with the minimal sensitivity to the randomness. What we have discovered from the comparison of advanced hyperparameter optimization methods can be used by researchers to tune the time series-based forecasting models.

How to predict and optimise with asymmetric error metrics

State-of-the-art predictive and prescriptive analytics for IEEE CIS 3rd Technical Challenge

Comparison and Evaluation of Methods for a Predict+Optimize Problem in Renewable Energy

Predict. Optimize. Revise. On Forecast and Policy Stability in Energy Management Systems

Methodology for forecasting and optimization in IEEE-CIS 3rd Technical Challenge

Proposing hybrid prediction approaches with the integration of machine learning models and metaheuristic algorithms to forecast the cooling and heating load of buildings

The intersection of machine learning with forecasting and optimisation: theory and applications

AI-based forecasting for optimised solar energy management and smart grid efficiency

Optimising Building Energy and Comfort Predictions with Intelligent Computational Model

An Asymmetric Loss with Anomaly Detection LSTM Framework for Power Consumption Prediction

Simulating long-term energy consumption prediction in campus buildings through enhanced data augmentation and metaheuristic-optimized artificial intelligence

Optimal activity and battery scheduling algorithm using load and solar generation forecast

Cost-oriented load forecasting

Enhanced Short-Term Load Forecasting: Error-Weighted and Hybrid Model Approach

Improving the prediction of asset returns with machine learning by using a custom loss function

Building energy consumption prediction and optimization using different neural network-assisted models; comparison of different networks and optimization algorithms

Improving the Efficiency of Renewable Energy Assets by Optimizing the Matching of Supply and Demand Using a Smart Battery Scheduling Algorithm

Predict-then-optimize or predict-and-optimize? An empirical evaluation of cost-sensitive learning strategies

Towards Resilient Energy Forecasting: A Robust Optimization Approach

Advanced hyperparameter optimization of deep learning models for wind power prediction

Adaptive Decision-Objective Loss for Forecast-then-Optimize in Power Systems