The Prediction of Storm‐Time Thermospheric Mass Density by LSTM‐based Ensemble Learning

Peian Wang,Zhou Chen,Xiaohua Deng,Jingsong Wang,Rongxing Tang,Haimeng Li,Sheng Hong,Zhiping Wu

DOI: https://doi.org/10.1029/2021SW002950

2022-03-06

Space Weather

Abstract:Space Weather, Accepted Article.

What problem does this paper attempt to address?

The Short-Time Prediction of Thermospheric Mass Density Based on Ensemble-Transfer Learning

Peian Wang,Zhou Chen,Xiaohua Deng,Jing-Song Wang,Rongxing Tang,Haimeng Li,Sheng Hong,Zhiping Wu

DOI: https://doi.org/10.1029/2023sw003576

2023-01-01

Abstract:Reliable short-time prediction of thermospheric mass density along the satellite orbit is always essential but challenging for the operation of Low-Earth orbit satellites. In this paper, three machine-learning prediction algorithms are investigated, including the Bidirectional Long Short-Term Memory, the Transformer, and the Light Gradient Boosting Machine (LightGBM) ensemble model of the above models. We use satellite data from CHAMP, GOCE, and SWARM-C to evaluate the robustness and accuracy of different density variations. The comparison demonstrates that all models achieve compelling predictions and are much better than NRLMSISE-00. The LightGBM ensemble model (LE-model) consistently outperforms others in accuracy and stability. Furthermore, when the obtained density data from the newly launched satellites are limited, the trained LE-model can provide a valid prediction for the new satellite orbit by transfer learning. This study offers a promising insight into the short-time prediction of thermospheric mass density using ensemble-transfer learning and may be advantageous to future research on space whether. Low-Earth orbit (LEO) satellites play an important role in many aspects, such as navigation, aerospace, military industry, and so on. The LEO satellites suffer atmospheric drag caused by thermospheric mass density. Therefore, we present three different machine-learning algorithms to achieve a robust short-time prediction for thermospheric mass density. All models can provide effective results from testing with three satellite data, and the ensemble model always outperforms others. Then, when the obtained density data from the newly launched satellites are very limited, the pre-trained ensemble model is also useful for the new satellite orbit by transfer learning. We offer a good insight into the short-time prediction of thermospheric mass density and assistance for aerospace digitization and intellectualization. Based on three different machine-learning algorithms, we present a robust short-time prediction for thermospheric mass densityWe evaluate the model performances using data from CHAMP, GOCE, and SWARM-C with NRLMSISE-00 as the referenceThe LightGBM ensemble model of Bidirectional Long Short-Term Memory and Transformer outperforms others and can provide reliable transfer predictions for new satellites
Multimodel Ensemble Prediction System For Space Weather Applications

R. W. Schunk,L. Scherliess,V. Eccles,L. C. Gardner,J. J. Sojka,L. Zhu,X. Pi,A. J. Mannucci,Mark Butala,B. D. Wilson,A. Komjathy,C. Wang,G. Rosen

2014-01-01

Abstract:The Earth's Ionosphere-Thermosphere-Electrodynamics (I-T-E) system is highly nonlinear and varies markedly on a range of spatial and temporal scales. Recently, we have created a Multimodel Ensemble Prediction System (MEP S) that is based on data assimilation models, with the goal being to specify and forecast the global I-T-E system (Schunk et al., 2012). Our team has 7 first-principles-based data assimilation models for the ionosphere, ionosphere-plasmasphere, thermosphere, high-latitude ionosphere-electrodynamics, and mid-low latitude ionosphere-electrodynamics. Hence, we can conduct ensemble modeling of the I-T-E system with different data assimilation models and then compare model reconstructions, which should help distinguish between the underlying physics and model artifacts.
TE-LSTM: A Prediction Model for Temperature Based on Multivariate Time Series Data

Kang Zhou,Chunju Zhang,Bing Xu,Jianwei Huang,Chenxi Li,Yifan Pei

DOI: https://doi.org/10.3390/rs16193666

IF: 5

2024-10-01

Remote Sensing

Abstract:In the era of big data, prediction has become a fundamental capability. Current prediction methods primarily focus on sequence elements; however, in multivariate time series forecasting, time is a critical factor that must not be overlooked. While some methods consider time, they often neglect the temporal distance between sequence elements and the predicted target time, a relationship essential for identifying patterns such as periodicity, trends, and other temporal dynamics. Moreover, the extraction of temporal features is often inadequate, and discussions on how to comprehensively leverage temporal data are limited. As a result, model performance can suffer, particularly in prediction tasks with specific time requirements. To address these challenges, we propose a new model, TE-LSTM, based on LSTM, which employs a temporal encoding method to fully extract temporal features. A temporal weighting strategy is also used to optimize the integration of temporal information, capturing the temporal relationship of each element relative to the target element, and integrating it into the LSTM. Additionally, this study examines the impact of different time granularities on the model. Using the Beijing International Airport station as the study area, we applied our method to temperature prediction. Compared to the baseline model, our model showed an improvement of 0.7552% without time granularity, 1.2047% with a time granularity of 3, and 0.0953% when addressing prediction tasks with specific time requirements. The final results demonstrate the superiority of the proposed method and highlight its effectiveness in overcoming the limitations of existing approaches.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Weather Forecasting Using Ensemble of Spatial-Temporal Attention Network and Multi-Layer Perceptron

Yuanpeng Li,Junwei Lang,Lei Ji,Jiqin Zhong,Zaiwen Wang,Yang Guo,Sailing He

DOI: https://doi.org/10.1007/s13143-020-00212-3

IF: 6.6235

2020-01-01

Asia-Pacific Journal of Atmospheric Sciences

Abstract:Weather forecasting is a challenging task, which is especially suited for artificial intelligence due to the large amount of data involved. This paper proposed an end-to-end hybrid regression model, called E nsemble of S patial- T emporal A ttention N etwork and M ulti- L ayer P erceptron ( E-STAN-MLP ), to forecast surface temperature, humidity, wind speed, and wind direction at 24 automatic weather stations in Beijing. Combining the data from historical observations with the data from the numerical weather prediction (NWP) system, our proposed model give better results than the NWP system or previously reported algorithms. Our E-STAN-MLP model consists of two parts. One is to use the spatial-temporal attention based recurrent neural network to model the time series of meteorological elements. The other is a simple but efficient multi-layer perceptron architecture forecasts the regression value while ignoring time dependence. Results at each time stamp are integrated together using a step-wise fusion strategy. Moreover, we use a joint loss step integrating both the regression loss function and the classification loss function to simultaneously forecast the wind speed and direction. Experiments demonstrate that our proposed E-STAN-MLP model achieves state-of-the-art results in weather forecasting.
Atmospheric Temperature Prediction Based on a BiLSTM-Attention Model

Xueli Hao,Ying Liu,Lili Pei,Wei Li,Yaohui Du

DOI: https://doi.org/10.3390/sym14112470

2022-11-21

Symmetry

Abstract:To address the problem that traditional models are not effective in predicting atmospheric temperature, this paper proposes an atmospheric temperature prediction model based on symmetric BiLSTM (bidirectional long short-term memory)-Attention model. Firstly, the meteorological data from five major stations in Beijing were integrated, cleaned, and normalized to build an atmospheric temperature prediction dataset containing multiple feature dimensions; then, a BiLSTM memory network was used to construct with forward and backward information in the time dimension. And the limitations of the traditional LSTM method in long-term time series analysis were solved by introducing the attention mechanism to achieve the prediction analysis of atmospheric temperature. Finally, by comparing the prediction results with those of BiLSTM, LSTM-Attention, and LSTM, it is revealed that the proposed model has the best prediction effect, with a MAE value of 0.013, which is 0.72%, 0.41%, and 1.24% lower than those of BiLSTM, LSTM-Attention, and LSTM, respectively; the R2 value reaches 0.9618, which is 2.73%, 1.23%, and 4.98% higher than BiLSTM, LSTM-Attention, and LSTM, respectively. The results show that the symmetrical BiLSTM-Attention atmospheric temperature prediction model can effectively improve the prediction accuracy of temperature data, and the model can also be used to predict other time series data.
Multistep Ahead Atmospheric Optical Turbulence Forecasting for Free-Space Optical Communication Using Empirical Mode Decomposition and LSTM-based Sequence-to-sequence Learning

Yalin Li,Hongqun Zhang,Lang Li,Lu Shi,Yan Huang,Shiyao Fu

DOI: https://doi.org/10.3389/fphy.2023.1070762

IF: 3.718

2023-01-01

Frontiers in Physics

Abstract:Although free-space optical communication (FSOC) is a promising means of high data rate satellite-to-ground communication, beam distortion caused by atmospheric optical turbulence remains a major challenge for its engineering applications. Accurate prediction of atmospheric optical turbulence to optimize communication plans and equipment parameters, such as adaptive optics (AO), is an effective means to address this problem. In this research, a hybrid multi-step prediction model for atmospheric optical turbulence, EMD-Seq2Seq-LSTM, is proposed by combining empirical mode decomposition (EMD), sequence-to-sequence (Seq2Seq), and long short-term memory (LSTM) network. First, using empirical mode decomposition to decompose the non-linear and non-stationary atmospheric optical turbulence dataset into a set of stationary components for which internal feature information can be easily extracted significantly reduces the training difficulty and improves the forecast accuracy of the model. Second, sequence-to-sequence is combined with LSTM networks to build a prediction model that can eliminate time delay and make full use of long-term information and then use the model to predict each component separately. Finally, the prediction results of each component are combined to obtain the final atmospheric turbulence forecasting results. To validate the performance of the proposed method, three comparative models, including WRF, LSTM, and sequence-to-sequence-LSTM, are demonstrated in this study. The forecasting results reveal that the proposed model outperforms all other models both qualitatively and quantitatively and thus can be a powerful method for atmospheric optical turbulence forecasting.
A Regional Ionospheric Storm Forecasting Method Using a Deep Learning Algorithm: LSTM

Panpan Ban,Lixin Guo,Zhenwei Zhao,Shuji Sun,Tong Xu,Zhengwen Xu,Fengjuan Sun

DOI: https://doi.org/10.1029/2022sw003061

2023-01-01

Space Weather

Abstract:An ionospheric storm forecasting method was proposed using a deep learning algorithm, LSTM (long short-term memory). We used the perturbation index to denote the level of an ionospheric storm, deduced from foF2 data, and helped to remove most of the local time and seasonal variations in the ionosphere. In constructing the model, a number of correlated factors were used as inputs, including the properties of coronal mass ejections, solar flare bursts, interplanetary conditions, and geomagnetic and ionospheric states, and the output was whether an ionospheric storm occurred locally in the next 24 hr. Data sets from 2007 to 2014 were used to train the model, and those from 2015 to 2016 were used for validation. The results showed that the model behaved well in most events. The mean precision rate, recall rate, accuracy, and F1 score of the model were 71.7%, 59.7%, 92.7%, and 65.0% in northern China and 78.9%, 56.3%, 96.3% and 65.0% in southern China, respectively. The LSTM forecasting model performed better than other models such as persistence, multiple-layer perceptron and support vector machine models. Case studies also showed good performance during geomagnetic storms of different strengths. We believe that this model can be beneficial for functional ionospheric storm operation.
A Deep Spatial-Temporal Ensemble Model for Air Quality Prediction

Junshan Wang,Guojie Song

DOI: https://doi.org/10.1016/j.neucom.2018.06.049

IF: 6

2018-01-01

Neurocomputing

Abstract:Air quality has drawn much attention in the recent years because it seriously affects people’s health. Nowadays, monitoring stations in a city can provide real-time air quality, but people also strongly desire air quality prediction, which is a challenging problem as it depends on several complicated factors, such as weather patterns and spatial-temporal dependencies of air quality. In this paper, we design a data-driven approach that utilizes historical air quality and meteorological data to predict air quality in the future. We propose a deep spatial-temporal ensemble(STE) model which is comprised of three components. The first component is an ensemble method with a weather-pattern-based partitioning strategy. It trains multiple individual models and combines them dynamically. The second one is to discover spatial correlation by analyzing Granger causalities among stations and generating spatial data as relative stations and relative areas. The last one is a temporal predictor based on deep LSTM to learn both long-term and short-term dependencies of air quality. We evaluate our model with data from 35 monitoring stations in Beijing, China. The experiments show that each component of our model makes contribution to the improvement in prediction accuracy and the model is superior to baselines.
Global Ionospheric TEC Forecasting for Geomagnetic Storm Time Using a Deep Learning‐Based Multi‐Model Ensemble Method

Xiaodong Ren,Pengxin Yang,Dengkui Mei,Hang Liu,Guozhen Xu,Yue Dong

DOI: https://doi.org/10.1029/2022SW003231

2023-03-02

Space Weather

Abstract:In recent years, deep learning has been extensively used for ionospheric total electron content (TEC) prediction, and many models can yield promising prediction results, particularly under quiet conditions. Owing to the ionosphere's intricate and dramatic changes during geomagnetic storms, the high‐reliable prediction of the storm‐time ionospheric TEC remains a challenging problem. In this study, we developed a new deep learning‐based multi‐model ensemble method (DLMEM) to forecast geomagnetic storm‐time ionospheric TEC that combines the Random Forest (RF) model, the Extreme Gradient Boosting (XGBoost) algorithm, and the Gated Recurrent Unit (GRU) network with the attention mechanism. Seven features in 170 geomagnetic storm events, including the three components Bx, By and Bz of interplanetary magnetic field (IMF), the Kp and Dst indices of geomagnetic activity data, the F10.7 index of solar activity data and global TEC data, were used for modeling. The test set results showed that the DLMEM model can reduce the root mean square errors (RMSE) by an average of 43.6% in comparison to our previously presented model Ion‐LSTM, especially during the recovery period of geomagnetic storms. Furthermore, compared to Ion‐LSTM, the RMSE values of the low‐, middle‐ and high‐latitude single‐station forecast TEC can be greatly decreased by 33%, 53% and 59%, respectively. It was shown that the new model allows for more precise short‐term global ionospheric forecasting during geomagnetic storms, enabling real‐time monitoring of ionospheric changes.

meteorology & atmospheric sciences,geochemistry & geophysics,astronomy & astrophysics
Deep Learning‐Based Prediction of Global Ionospheric TEC During Storm Periods: Mixed CNN‐BiLSTM Method

Xiaochen Ren,Biqiang Zhao,Zhipeng Ren,Yan Wang,Bo Xiong

DOI: https://doi.org/10.1029/2024sw003877

2024-07-12

Space Weather

Abstract:The application of deep learning in high‐precision ionospheric parameter prediction has become one of the focus in space weather research. In this study, an improved model called Mixed Convolutional Neural Networks (CNN)—Bi‐Long Short Term Memory is proposed for predicting future ionospheric Total Electron Content (TEC). The model is trained using the longest available (25 years) Global Ionospheric Maps‐TEC and evaluated the accuracy of ionospheric storm predictions. The results indicate that using historical TEC in the solar‐geographical reference frame as input driving data achieves higher prediction accuracy compared to that in the geocentric coordinate system. Additionally, by comparing different input parameters, it is found that incorporating the Kp, ap, and Dst indices as inputs to the model effectively improves its accuracy, especially in long‐term forecasting where R2 increased by 3.49% and Root Mean Square Error decreased by 13.48%. Compared with BiLSTM‐Deep Neural Networks (DNN) and CNN‐BiLSTM, the Mixed CNN‐BiLSTM model has the highest prediction accuracy. It suggests that the utilization of CNN modules for processing spatial information, along with the incorporation of DNN modules to incorporate geomagnetic indices for result correction. Moreover, in short‐term predictions, the model accurately forecasts the evolution process of ionospheric storms. When extending the predicted length, although there are cases of prediction errors, the model still captures the entire process of ionospheric storms. Furthermore, the predicted results are significantly influenced by longitude, magnetic latitude, and local time.

meteorology & atmospheric sciences,geochemistry & geophysics,astronomy & astrophysics
A Short-Term Forecasting Method for Ionospheric TEC Combining Local Attention Mechanism and LSTM Model

Jun Tang,Lang Xu,Xuequn Wu,Ke Chen

DOI: https://doi.org/10.1109/lgrs.2024.3373457

IF: 5.343

2024-03-15

IEEE Geoscience and Remote Sensing Letters

Abstract:Total electron content (TEC) is an important parameter for studying ionospheric variations and space weather. Short-term prediction of the ionosphere plays a significant role in near-Earth space environment monitoring. This study proposes a model that combines a long short-term memory (LSTM) neural network with a local attention mechanism (LAM), which weights the features using attention weights and connects them to a fully connected output layer. The model is constructed using TEC data from 16 global navigation satellite system (GNSS) observation stations provided by the crustal movement observation network of China (CMONOC), along with six parameters: Bz, Kp, disturbance storm time (Dst), F10.7 indices, and hour of the day. The LAM-LSTM model is compared with the LSTM model and the BP model. Experimental results show that the LAM-LSTM model achieves a root mean square error (RMSE) of 1.35 TECU on average for the test dataset, while the LSTM model has an RMSE of 1.54 TECU, and the BP model has an RMSE of 1.74 TECU. The proposed model exhibits good stability in different geomagnetic conditions and different months.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
TLS-MWP: A Tensor-based Long- and Short-range Convolution for Multiple Weather Prediction

Guangning Xu,Michael K. Ng,Yunming Ye,Xutao Li,Ge Song,Bowen Zhang,Zhichao Huang

DOI: https://doi.org/10.1109/tcsvt.2024.3379291

IF: 5.859

2024-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Weather prediction plays a crucial role in human development. Recently, deep learning has demonstrated promising prospects in weather forecasting by integrating convolutional neural networks (CNNs) and recurrent neural networks (RNNs). However, two main challenges still exist in multiple weather condition prediction. The first challenge considers multiple weather condition correlations in predictions. The second challenge is how to model long- and short-range spatial dependencies under multiple weather conditions. A novel operator named as tensor-based long- and short-range convolution (TLS-Conv) is proposed to address these challenges. Within this operator, the node & relation attention is utilized to identify the contributions of spatial grid points and weather conditions for prediction. Additionally, the adaptive tensor graph convolution (ATGCN) is tailored to dynamically capture long-range spatial dependencies within multiple weather conditions. Finally, the traditional convolution is integrated with the ATGCN to model both long- and short-range spatial dependencies and weather condition correlations. Building upon the TLS-Conv, the tensor-based long- and short-range convolution for multiple weather prediction (TLS-MWP) model is proposed to predict multiple weather conditions. Extensive experiments are conducted under real-world weather conditions to evaluate its performance. These results unequivocally demonstrate that TLS-MWP surpasses previous methods. The code is available on GitHub at: https://github.com/xuguangning1218/TLS_MWP.

engineering, electrical & electronic
ED‐AttConvLSTM: An Ionospheric TEC Map Prediction Model Using Adaptive Weighted Spatiotemporal Features

Liangchao Li,Haijun Liu,Huijun Le,Jing Yuan,Haoran Wang,Yi Chen,Weifeng Shan,Li Ma,Chunjie Cui

DOI: https://doi.org/10.1029/2023sw003740

2024-03-08

Space Weather

Abstract:In this paper, we propose a novel Total Electron Content (TEC) map prediction model, named ED‐AttConvLSTM, using a Convolutional Long Short‐Term Memory (ConvLSTM) network and attention mechanism based on encoder‐decoder structure. The inclusion of the attention mechanism enhances the efficient utilization of spatiotemporal features extracted by the ConvLSTM, emphasizing the significance of crucial spatiotemporal features in the prediction process and, as a result, leading to an enhancement in predictive performance. We conducted experiments in East Asia (10°N–45°N, 90°E−130°E). The ED‐AttConvLSTM was trained and evaluated using the International GNSS Service TEC maps over a period of six years from 2013 to 2015 (high solar activity years) and 2017 to 2019 (low solar activity years). We compared our ED‐AttConvLSTM with IRI‐2016, COPG, LSTM, GRU, ED‐ConvLSTM and ED‐ConvGRU. The results indicate that our model surpasses the comparison models in forecasting both high and low solar activity years, across most months and UT moments in a day. Moreover, our model exhibits notably superior prediction performance during the most severe phases of a magnetic storm when compared to the comparison models. Subsequently, we then also discuss how the prediction performance of our model is affected by latitude. Finally, we discuss the diminishing performance of our model in multi‐day predictions, demonstrating that its reliability for forecasts ranging from one to 4 days in advance. Beyond the fifth day, there is a pronounced decline in the model's performance.

meteorology & atmospheric sciences,geochemistry & geophysics,astronomy & astrophysics
Prediction and Analysis of Sea Surface Temperature Based on LSTM-Transformer Model

Yu Fu,Jun Song,Junru Guo,Yanzhao Fu,Yu Cai

DOI: https://doi.org/10.1016/j.rsma.2024.103726

IF: 2.166

2024-07-01

Regional Studies in Marine Science

Abstract:This paper introduces a novel method for predicting sea surface temperature (SST) using a hybrid LSTM-Transformer model. The study utilizes the ERA5 dataset for SST prediction at six specific locations near China. The LSTM-Transformer model combines the temporal processing capability of LSTM with the efficient data processing power of Transformer, showing superior performance in reducing Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE), as well as improving the R-squared (R²) value, compared to standalone LSTM, Transformer, and traditional Logistic Regression (LR) models. This is particularly evident in spring and autumn, indicating its robustness to seasonal changes. The model's performance varies across different geographic locations, with lower prediction errors in low-latitude and open sea areas, attributed to the less complex environmental dynamics compared to continental shelf areas. Overall, the LSTM-Transformer hybrid model presents a significant advancement in SST prediction, providing important implications for fisheries, meteorology, and climate change research.

ecology,marine & freshwater biology
Conv‐ELSTM: an Ensemble Deep Learning Approach for Predicting Short‐term Wind Power

Guibin Wang,Xinlong Huang,Yiqun Li,Hong Wang,Xian Zhang,Jing Qiu

DOI: https://doi.org/10.1049/rpg2.13159

IF: 3.034

2024-01-01

IET Renewable Power Generation

Abstract:AbstractAccurate and reliable forecasting of wind power is essential for the stable integration of wind energy into the electrical grid. However, the chaotic nature of wind power presents a significant challenge in utilizing data for effective short‐term forecasting, such as 60‐min predictions. This article introduces a hybrid data‐driven framework that employs an ensemble deep learning model to provide highly precise short‐term wind power predictions. The framework leverages a data‐driven approach to identify the intrinsic components of wind power data, including high‐frequency and low‐frequency components. A convolutional layer‐based feature fusion network is then established to properly extract important information from irrelevant wind energy features. Subsequently, an ensemble of long short‐term memory (LSTM) networks is developed to forecast wind power using the fused features, thereby mitigating the disadvantage of a single prediction model. The numerical experiment is carried out based on two different real‐life datasets. The results demonstrate the effectiveness of the proposed method in forecasting short‐term wind power compared to five benchmarks.
A Dual-Attention-Mechanism Multi-Channel Convolutional LSTM for Short-Term Wind Speed Prediction

Jinhui He,Hao Yang,Shijie Zhou,Jing Chen,Min Chen

DOI: https://doi.org/10.3390/atmos14010071

IF: 3.11

2022-12-31

Atmosphere

Abstract:Accurate wind speed prediction plays a crucial role in wind power generation and disaster avoidance. However, stochasticity and instability increase the difficulty of wind speed prediction. In this study, we proposed a dual-attention mechanism multi-channel convolutional LSTM (DACLSTM), collected European Centre for Medium-Range Weather Forecasts (ECMWF) Reanalysis v5 (ERA5) near-ground element-grid data from some parts of North China, and selected elements with high correlations with wind speed to form multiple channels. We used a convolutional network for the feature extraction of spatial information, a Long Short-Term Memory (LSTM) network for the feature extraction of time-series information, and used channel attention with spatial attention for feature extraction. The experimental results show that the DACLSTM model can improve the accuracy of six-hour lead time wind speed prediction relative to the traditional ConvLSTM model and fully connected network long short-term memory (FC_LSTM).

environmental sciences,meteorology & atmospheric sciences
Precipitation Prediction Using an Ensemble of Lightweight Learners

Xinzhe Li,Sun Rui,Yiming Niu,Yao Liu

2023-11-30

Abstract:Precipitation prediction plays a crucial role in modern agriculture and industry. However, it poses significant challenges due to the diverse patterns and dynamics in time and space, as well as the scarcity of high precipitation events.

Atmospheric and Oceanic Physics,Artificial Intelligence,Computer Vision and Pattern Recognition,Machine Learning
Wind speed prediction model using ensemble empirical mode decomposition, least squares support vector machine and long short-term memory

Xueyi Ai,Shijia Li,Haoxuan Xu

DOI: https://doi.org/10.3389/fenrg.2022.1043867

IF: 3.4

2023-01-10

Frontiers in Energy Research

Abstract:Due to the randomness and intermittency of wind, accurate and reliable wind speed prediction is of great importance to the safe and stable operation of power grid. In this paper, a novel hybrid wind speed forecasting model based on EEMD (Ensemble Empirical Mode Decomposition), LSSVM (Least Squares Support Vector Machine), and LSTM (Long Short-Term Memory) is proposed, aiming at enhancing the forecasting accuracy of wind speed. The original data series is firstly processed by EEMD and SE into a series of components with different frequencies. Subsequently, a combined mechanism composed of LSSVM and LSTM is presented to train and predict the high-frequency and low-frequency sequences, respectively. Finally, the predicted values of all the data sequences are superimposed to obtain the ultimate wind speed forecasting results. In order to respectively illustrate the superiority of data feature processing and combined prediction mechanism in the proposed model, two experiments are performed on the two wind speed datasets. In accordance with the four performance metrics of the forecasting results, the EEMD-LSTM-LSSVM model obtains a higher accuracy in wind speed prediction task.

energy & fuels
Ensemble Learning for Bias Correction of Station Temperature Forecast Based on ECMWF Products

Chen Yuwen,Huang Xiaomeng,Li Yi,Chen Yue,Tsui Chi Yan,Huang Xing

DOI: https://doi.org/10.11898/1001-7313.20200411

2020-01-01

Abstract:To improve the accuracy of numerical weather prediction (NWP) and its ability for extreme weather event forecast, a hybrid model based on ensemble learning is proposed and tested by post-processing one of the most successfully predicted variables, temperature at 2 m height. The NWP dataset used is provided by The International Grand Global Ensemble (TIGGE) project in the European Centre from Medium-Range Weather Forecasts (ECMWF), with a horizontal resolution of 0.125°×0.125° and lead times from 6 to 168 h (with a 6 h increment, 28 lead times totally). The observation is collected from 301 stations covering China expect for Xizang and Qinghai, including 4 variables, temperature, pressure, relative humidity and wind speed every 3 hours. The ECMWF product and observation span a period of 6 years ranging from 1 January 2013 to 31 December 2018. Data from 2013 to 2017 are used for machine learning and model training, and data in 2018 are used for testing. The hybrid model named ALS consists of 2 stages. Stage 1 trains two separate models, a long short-term memory combined with a fully connected neural network (LSTM-FCN) and an artificial neural network (ANN). Stage 2 blends the output of LSTM-FCN and ANN using a linear regression (LR) model. The correction result is the output of LR. ALS model is then applied to correct the station temperature forecast with lead time from 6 to 168 h. Outcomes are verified by observations from stations, while LR model is used as control model. ALS model reduces the average root mean square error (RMSE) of the station temperature forecast by 0.61℃ (19.6%), and by 0.23℃ (8.4%) compared with the LR model. ALS model reduces RMSE at more stations compared with LR model (252 vs. 186). ALS model is particularly effective in areas where the accuracy of station temperature forecast is low, such as Guizhou and Yunnan. Forecasts for stations in these areas are significantly improved with an average RMSE reduction over 40%. Moreover, case analysis of high temperature show that ALS model improves the forecast accuracy of high temperature events significantly, with a RMSE reduction of 30.5% at 4 stations compared to station temperature forecast. It demonstrates that ensemble learning can be used to supplement weather forecast.
Prediction of the Transit Time of Coronal Mass Ejections with an Ensemble Machine-learning Method

Y. Yang,J. J. Liu,X. S. Feng,P. F. Chen,B. Zhang

DOI: https://doi.org/10.3847/1538-4365/acf218

2023-01-01

Abstract:Coronal mass ejections (CMEs), a kind of violent solar eruptive activity, can exert a significant impact on space weather. When arriving at the Earth, they interact with the geomagnetic field, which can boost the energy supply to the geomagnetic field and may further result in geomagnetic storms, thus having potentially catastrophic effects on human activities. Therefore, accurate forecasting of the transit time of CMEs from the Sun to the Earth is vital for mitigating the relevant losses brought by them. XGBoost, an ensemble model that has better performance in some other fields, is applied to the space weather forecast for the first time. During multiple tests with random data splits, the best mean absolute error (MAE) of similar to 5.72 hr was obtained, and in this test, 62% of the test CMEs had absolute arrival time error of less than 5.72 hr. The average MAE over all random tests was similar to 10 hr. It indicates that our method has a better predictive potential and baseline. Moreover, we introduce two effective feature importance ranking methods. One is the information gain method, a built-in method of ensemble models. The other is the permutation method. These two methods combine the learning process of the model and its performance to rank the CME features, respectively. Compared with the direct correlation analysis on the sample data set, they can help select the important features that closely match the model. These two methods can assist researchers to process large sample data sets, which often require feature selection in advance.

The Prediction of Storm‐Time Thermospheric Mass Density by LSTM‐based Ensemble Learning

The Short-Time Prediction of Thermospheric Mass Density Based on Ensemble-Transfer Learning

Multimodel Ensemble Prediction System For Space Weather Applications

TE-LSTM: A Prediction Model for Temperature Based on Multivariate Time Series Data

Weather Forecasting Using Ensemble of Spatial-Temporal Attention Network and Multi-Layer Perceptron

Atmospheric Temperature Prediction Based on a BiLSTM-Attention Model

Multistep Ahead Atmospheric Optical Turbulence Forecasting for Free-Space Optical Communication Using Empirical Mode Decomposition and LSTM-based Sequence-to-sequence Learning

A Regional Ionospheric Storm Forecasting Method Using a Deep Learning Algorithm: LSTM

A Deep Spatial-Temporal Ensemble Model for Air Quality Prediction

Global Ionospheric TEC Forecasting for Geomagnetic Storm Time Using a Deep Learning‐Based Multi‐Model Ensemble Method

Deep Learning‐Based Prediction of Global Ionospheric TEC During Storm Periods: Mixed CNN‐BiLSTM Method

A Short-Term Forecasting Method for Ionospheric TEC Combining Local Attention Mechanism and LSTM Model

TLS-MWP: A Tensor-based Long- and Short-range Convolution for Multiple Weather Prediction

ED‐AttConvLSTM: An Ionospheric TEC Map Prediction Model Using Adaptive Weighted Spatiotemporal Features

Prediction and Analysis of Sea Surface Temperature Based on LSTM-Transformer Model

Conv‐ELSTM: an Ensemble Deep Learning Approach for Predicting Short‐term Wind Power

A Dual-Attention-Mechanism Multi-Channel Convolutional LSTM for Short-Term Wind Speed Prediction

Precipitation Prediction Using an Ensemble of Lightweight Learners

Wind speed prediction model using ensemble empirical mode decomposition, least squares support vector machine and long short-term memory

Ensemble Learning for Bias Correction of Station Temperature Forecast Based on ECMWF Products

Prediction of the Transit Time of Coronal Mass Ejections with an Ensemble Machine-learning Method