Reinforcement Learning based Dynamic Model Selection for Short-Term Load Forecasting

Cong Feng,Jie Zhang
DOI: https://doi.org/10.48550/arXiv.1811.01846
2018-11-06
Abstract:With the growing prevalence of smart grid technology, short-term load forecasting (STLF) becomes particularly important in power system operations. There is a large collection of methods developed for STLF, but selecting a suitable method under varying conditions is still challenging. This paper develops a novel reinforcement learning based dynamic model selection (DMS) method for STLF. A forecasting model pool is first built, including ten state-of-the-art machine learning based forecasting models. Then a Q-learning agent learns the optimal policy of selecting the best forecasting model for the next time step, based on the model performance. The optimal DMS policy is applied to select the best model at each time step with a moving window. Numerical simulations on two-year load and weather data show that the Q-learning algorithm converges fast, resulting in effective and efficient DMS. The developed STLF model with Q-learning based DMS improves the forecasting accuracy by approximately 50%, compared to the state-of-the-art machine learning based STLF models.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to effectively conduct short - term load forecasting (STLF) in power system operations. Although many methods have been developed for STLF, it is still challenging to select the most appropriate method under different conditions. This paper proposes a dynamic model selection (DMS) method based on reinforcement learning, aiming to select the best prediction model for each time step from a series of state - of - the - art machine - learning models. By using the Q - learning algorithm, this method can converge quickly according to the model performance, thereby achieving efficient and accurate dynamic model selection and significantly improving the prediction accuracy. Compared with the existing state - of - the - art machine - learning methods, the prediction accuracy is improved by approximately 50%.