Abstract:Electrical load forecasting is one of the critical tasks that helps power utility companies in planning and operation as well as the energy managementsystem (EMS) in controlling and optimizing the power grids performance. It guarantees system adequacy and reliability by reducing the gap between supply and demand, and it bolsters cybersecurity by enabling false data detection and system security by predicting system peak load. This article aims to build an accurate long-term load forecasting model based on deep learning (DL) algorithms. Initially, big-data analytics and feature engineering are applied to the power load and weather historical data. Next, three different load forecasting models are developed based on three corresponding deep neural network models (DNN): the simple RNN, the long short term memory (LSTM), and the gated recurrent unit (GRU), respectively. To find an accurate DNN model, a two-step hyperparameter optimization is performed consisting of cross-validation. In the first step, the random search (RS) algorithm is employed to narrow the parameter search space to a smaller local one. In the second step, the grid search (GS) algorithm is used to find the best hyperparameters in the local area located by RS. However, the computational burden of the DNN training process is too high and may lead to out-of-memory (OOM) issues, especially when we are dealing with a big volume of data. To overcome this problem, we developed our Python program based on Tensorflow framework and implemented the framework on a high-performance computer cluster (HPCC). Then, different jobs are defined to employ parallel distributed computing (PDC) capability on the SIU BigDawg HPCC. To this end, all DNN hyperparameters (e.g., number of layers, neurons, dropout, batch size, epoch, learning rate, etc.) can be optimized and result in a comprehensive and accurate load forecasting model. Our proposed method, along with the programming framework, is evaluated on a real-world dataset. Among the three models developed and tested, the GRU, with load and weather as features, has demonstrated excellent performance and outperformed the other two models for long-term forecasting with the best metrics (i.e., MSE, MAPE, $R^2$) and daily error almost less than 1. Also, our best model (optimized GRU) is compared with the other reported state-of-the-art models such as DBN, SVR, RM-LSTM, DM-GCNN, TCMS-CNN. It is demonstrated that the proposed framework yields a superior performance than the others.

Deep Learning Hyperparameter Optimization: Application to Electricity and Heat Demand Prediction for Buildings

Deep Learning Hyperparameter Optimization: Application to Electricity and Heat Demand Prediction for Buildings

Advancements in Household Load Forecasting: Deep Learning Model with Hyperparameter Optimization

Deep Learning Algorithms and Parallel Distributed Computing Techniques for High-Resolution Load Forecasting Applying Hyperparameter Optimization

Building energy consumption prediction and optimization using different neural network-assisted models; comparison of different networks and optimization algorithms

A study of deep learning-based multi-horizon building energy forecasting

Energy Consumption Optimization for Heating, Ventilation and Air Conditioning Systems Based on Deep Reinforcement Learning

On the Benefits of Using Metaheuristics in the Hyperparameter Tuning of Deep Learning Models for Energy Load Forecasting

A deep learning model for short-term power load and probability density forecasting

Prediction and optimization of heating and cooling loads in a residential building based on multi-layer perceptron neural network and different optimization algorithms

Building energy consumption prediction using multilayer perceptron neural network-assisted models; comparison of different optimization algorithms

A comparative study of machine learning and deep learning methods for energy balance prediction in a hybrid building-renewable energy system

Deep learning-based forecasting of electricity consumption

Load Forecasting with Machine Learning and Deep Learning Methods

Deep learning–based urban energy forecasting model for residential building energy efficiency

Deep Learning Approaches with Optimum Alpha for Energy Usage Forecasting

Electrical Energy Prediction in Residential Buildings for Short-Term Horizons Using Hybrid Deep Learning Strategy

Data-driven short term load forecasting with deep neural networks: Unlocking insights for sustainable energy management

A hybrid deep learning-based method for short-term building energy load prediction combined with an interpretation process

Advanced hyperparameter optimization of deep learning models for wind power prediction

Short-Term Load Forecasting of Integrated Energy Systems Based on Deep Learning