Abstract:Electrical energy is essential in today's society. Accurate electrical load forecasting is beneficial for better scheduling of electricity generation and saving electrical energy. In this paper, we propose an adaptive deep-learning load forecasting framework by integrating Transformer and domain knowledge (Adaptive-TgDLF). Adaptive-TgDLF introduces the deep-learning model Transformer and adaptive learning methods (including transfer learning for different locations and online learning for different time periods), which captures the long-term dependency of the load series, and is more appropriate for realistic scenarios with scarce samples and variable data distributions. Under the theory-guided framework, the electrical load is divided into dimensionless trends and local fluctuations. The dimensionless trends are considered as the inherent pattern of the load, and the local fluctuations are considered to be determined by the external driving forces. Adaptive learning can cope with the change of load in location and time, and can make full use of load data at different locations and times to train a more efficient model. Cross-validation experiments on different districts show that Adaptive-TgDLF is approximately 16% more accurate than the previous TgDLF model and saves more than half of the training time. Adaptive-TgDLF with 50% weather noise has the same accuracy as the previous TgDLF model without noise, which proves its robustness. We also preliminarily mine the interpretability of Transformer in Adaptive-TgDLF, which may provide future potential for better theory guidance. Furthermore, experiments demonstrate that transfer learning can accelerate convergence of the model in half the number of training epochs and achieve better performance, and online learning enables the model to achieve better results on the changing load.

A Transformer Based Method with Wide Attention Range for Enhanced Short-term Load Forecasting

A Hybrid Short-Term Load Forecasting Method Based on Improved Ensemble Empirical Mode Decomposition and Back Propagation Neural Network

Short-Term Electric Load Forecasting Based on Wavelet Neural Network, Particle Swarm Optimization and Ensemble Empirical Mode Decomposition

Short-term Load Forecasting Utilizing Wavelet Transform and Time Series Considering Accuracy Feedback

Dynamic Temporal Dependency Model for Multiple Steps Ahead Short-term Load Forecasting of Power System

Two-Stage Short-Term Load Forecasting for Power Transformers under Different Substation Operating Conditions

A Method for Short-Term Electric Load Forecasting Based on the FMLP-iTransformer Model

LFLLM: A Large Language Model for Load Forecasting

An efficient approach for short term load forecasting

Novel Approach Considering Load-Relative Factors in Short-Term Load Forecasting

Combining fuzzy clustering and improved long short-term memory neural networks for short-term load forecasting

A New Strategy for Short-Term Load Forecasting

An Adaptive Deep-Learning Load Forecasting Framework by Integrating Transformer and Domain Knowledge

Enhancing Multivariate, Multi-Step Residential Load Forecasting with Spatiotemporal Graph Attention-Enabled Transformer

Multi-Step Ahead Short-Term Load Forecasting Using Hybrid Feature Selection and Improved Long Short-Term Memory Network

Short-Term Electrical Load Forecasting Based on Attention-GRU Networks

Fast and Accurate Short-Term Load Forecasting with a Hybrid Model

Novel short-term low-voltage load forecasting method based on residual stacking frequency attention network

Electric Load Forecasting with Fast Fourier Transform-Optimized Transformers

Short-Term Load Forecasting for Regional Smart Energy Systems Based on Two-Stage Feature Extraction and Hybrid Inverted Transformer

Short-term Load Forecasting Method Based on LSTM-Attention Mechanism