A Self-Attention Based Method for Wind Speed Forecasting in High-Speed Railway System

Chen Liu,Jiming Chen,Haoyu Liu,Haodong Jiang,Shibo He
DOI: https://doi.org/10.1109/dtpi52967.2021.9540068
2021-01-01
Abstract:Strong wind alongside the railway poses a great challenge for High-Speed Railway (HSR) system. It is necessary for trains to run below the maximum permitted speed. Knowing strong wind in advance encourages dispatchers to give instructions in time and thus can improve the safety. To predict wind speed, physical and statistic methods are proposed previously. Recently, their performances are greatly surpassed by deep learning based methods, e.g., the widely used Recurrent Neural Network (RNN) and its variants, which employ long history memory for future forecasting. However, effectiveness of such methods can be degraded under absence of attention mechanism. Also, due to that the new prediction is always based on previous modeled memory, thus the accumulated model error can result in negative performance. Therefore, we bring the idea from Transformer and devise a Spatial-Temporal Self-Attention (STSA) model to thoroughly estimate dependencies for current wind prediction. The model is in two folds. The Spatial Self-Attention part is responsible for capturing correlation among multiple wind sensors, while Temporal Self-Attention generates predictions directly according to historical values. Experiments are conducted on two real-world dataset and the superiority is demonstrated by comparing with multiple baselines.
What problem does this paper attempt to address?