Abstract:Electrical load forecasting is one of the critical tasks that helps power utility companies in planning and operation as well as the energy managementsystem (EMS) in controlling and optimizing the power grids performance. It guarantees system adequacy and reliability by reducing the gap between supply and demand, and it bolsters cybersecurity by enabling false data detection and system security by predicting system peak load. This article aims to build an accurate long-term load forecasting model based on deep learning (DL) algorithms. Initially, big-data analytics and feature engineering are applied to the power load and weather historical data. Next, three different load forecasting models are developed based on three corresponding deep neural network models (DNN): the simple RNN, the long short term memory (LSTM), and the gated recurrent unit (GRU), respectively. To find an accurate DNN model, a two-step hyperparameter optimization is performed consisting of cross-validation. In the first step, the random search (RS) algorithm is employed to narrow the parameter search space to a smaller local one. In the second step, the grid search (GS) algorithm is used to find the best hyperparameters in the local area located by RS. However, the computational burden of the DNN training process is too high and may lead to out-of-memory (OOM) issues, especially when we are dealing with a big volume of data. To overcome this problem, we developed our Python program based on Tensorflow framework and implemented the framework on a high-performance computer cluster (HPCC). Then, different jobs are defined to employ parallel distributed computing (PDC) capability on the SIU BigDawg HPCC. To this end, all DNN hyperparameters (e.g., number of layers, neurons, dropout, batch size, epoch, learning rate, etc.) can be optimized and result in a comprehensive and accurate load forecasting model. Our proposed method, along with the programming framework, is evaluated on a real-world dataset. Among the three models developed and tested, the GRU, with load and weather as features, has demonstrated excellent performance and outperformed the other two models for long-term forecasting with the best metrics (i.e., MSE, MAPE, $R^2$) and daily error almost less than 1. Also, our best model (optimized GRU) is compared with the other reported state-of-the-art models such as DBN, SVR, RM-LSTM, DM-GCNN, TCMS-CNN. It is demonstrated that the proposed framework yields a superior performance than the others.

A novel gated dual convolutional neural network model with autoregressive method and attention mechanism for probabilistic load forecasting

A Novel Sequence-to-Sequence-Based Deep Learning Model for Multistep Load Forecasting.

A Time-Series Model of Gated Recurrent Units Based on Attention Mechanism for Short-Term Load Forecasting

Short-Term Load Forecasting via a Multi-Layer Network Based on Feature Weight Optimization

Multi-area short-term load forecasting based on spatiotemporal graph neural network

Short-Term Load Forecasting Based on Deep Learning Bidirectional LSTM Neural Network

Deep Learning Based Densely Connected Network for Load Forecasting

A Unifying Framework of Attention-based Neural Load Forecasting

Short-Term Load Forecasting with Multi-Source Data Using Gated Recurrent Unit Neural Networks

Short-Term Load Forecasting Based on Adabelief Optimized Temporal Convolutional Network and Gated Recurrent Unit Hybrid Neural Network

Pre-Attention Mechanism and Convolutional Neural Network Based Multivariate Load Prediction for Demand Response

Multi-Convolution Feature Extraction and Recurrent Neural Network Dependent Model for Short-Term Load Forecasting

Deep-Learning Forecasting Method for Electric Power Load via Attention-Based Encoder-Decoder with Bayesian Optimization

A multi-source data power load forecasting method using attention mechanism-based parallel cnn-gru

Energy Load Forecasting Using a Dual-Stage Attention-Based Recurrent Neural Network

Deep Learning Algorithms and Parallel Distributed Computing Techniques for High-Resolution Load Forecasting Applying Hyperparameter Optimization

A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems

Short-term load forecasting based on LSTM networks considering attention mechanism

Deep learning-driven hybrid model for short-term load forecasting and smart grid information management

A power load forecasting model based on a combined neural network