[Cardiac symptomatology of stress].

P. Collignon

1982-12-01

Abstract:

What problem does this paper attempt to address?

Multi-lead-time short-term runoff forecasting based on Ensemble Attention Temporal Convolutional Network

Chunxiao Zhang,Ziyu Sheng,Chunlei Zhang,Shiping Wen

DOI: https://doi.org/10.1016/j.eswa.2023.122935

IF: 8.5

2023-12-17

Expert Systems with Applications

Abstract:In the realm of ecological management and human activities within river basins, short-term runoff forecasting plays a pivotal role. Addressing this need, this paper introduces an innovative framework for short-term runoff forecasting: the Ensemble Attention Temporal Convolutional Network (EA-TCN). The cornerstone of this innovation lies in the effective amalgamation of Temporal Convolutional Network (TCN), lightweight attention mechanism , and ensemble learning strategy. This integration synergistically enhances the model's overall performance in terms of accuracy, efficiency, and robustness. TCN forms the foundation of this framework, where its efficient architecture, characterized by shared parameters and parallel computation, significantly boosts computational efficiency. Its employment of causal and dilated convolutions adeptly captures long-term dependencies within time series inputs. The incorporated lightweight attention mechanism further augments the TCN, enabling EA-TCN to precisely discern complex relationship in temporal data, particularly exhibiting remarkable temporal robustness across various forecasting horizons—a feat challenging for conventional forecasting approaches. Additionally, the integration of the Snapshot ensemble method within the framework allows for simulating the effect of training multiple models through one single training process, thus further elevating the model's accuracy and robustness. Rigorous ablation and comparative experiments conducted on the US Columbia River dataset substantiate our claims. The results not only validate the individual merits of each component within EA-TCN but also illuminate the significant advantages of their collective application. Our comprehensive assessment unequivocally demonstrates the framework's exceptional performance in short-term runoff forecasting, positioning it as a state-of-the-art solution in this field. We will further discuss its impact of vocation education in this industry.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Enhanced Rainfall Nowcasting of Tropical Cyclone by an Interpretable Deep Learning Model and Its Application in Real-Time Flood Forecasting

Li Liu,Xiao Liang,Yue-Ping Xu,Yuxue Guo,Quan J. Wang,Haiting Gu

DOI: https://doi.org/10.1016/j.jhydrol.2024.131993

IF: 6.4

2024-01-01

Journal of Hydrology

Abstract:Reliable Tropical Cyclone (TC) rainfall and flood forecasts play an important role in disaster prevention and mitigation. Numerous studies have demonstrated the promising performance of deep learning in hydrometeorological forecasts. However, few studies have investigated the potential enhancement of advanced TC track forecasts in predicting rainfall and induced flood. In this study, a novel rainfall nowcasting model (TCRainNet) is developed by fusing TC track characteristics with antecedent rainfall in a Convolution LSTM to predict hourly rainfall with a lead time of 6 h. The nowcasts are subsequently used to drive an event-based Xin'anjiang hydrological model for real-time flood forecasting. The model performance is interpretated by the occlusion sensitivity approach, and the propagation of errors from TC track forecasts to flood forecasts is quantified. The results underscore the superiority of TC track characteristics as input features for rainfall nowcasts, as indicated by a Mutual Information value of up to 0.51. The generated nowcasts are found to have averaged Probability of Detection (POD) and Critical Success Index (CSI) greater than 0.27 and 0.2 respectively. The Mean Absolute Error (MAE) of the nowcasts falls below 2.6 mm, which is only 46 % of the ECMWF operational high- resolution forecasts. The rainfall-driven flood forecasts have NSE greater than 0.7 and PBIAS smaller than 20 % with lead time up to + 4 h. It is shown that the position error of 0.45 degrees degrees and intensity error of 10 hPa&7.8 &7.8 m/s in TC track forecasts generally result in 0.9 mm degradation in rainfall forecasts and 10% decline in the accuracy of rainfall-driven flood forecasts. The effectiveness of our method presents favorable applicability in advancing disaster mitigation efforts.
Runoff Forecasting using Convolutional Neural Networks and optimized Bi-directional Long Short-term Memory

Junhao Wu,Zhaocai Wang,Yuan Hu,Sen Tao,Jinghan Dong

DOI: https://doi.org/10.1007/s11269-022-03414-8

IF: 4.426

2023-01-11

Water Resources Management

Abstract:Water resources matters considerably in maintaining the biological survival and sustainable socio-economic development of a region. Affected by a combination of factors such as geographic characteristics of the basin and climate change, runoff variability is non-linear and non-stationary. Runoff forecasting is one of the important engineering measures to prevent flood disasters. The improvement of its accuracy is also a difficult problem in the research of water resources management. To this end, an ensemble deep learning model was hereby developed to forecast daily river runoff. First, variational mode decomposition (VMD) was used to decompose the original daily runoff series data set into discrete internal model function (IMF) and distinguish signals with different frequencies. Then, for each IMF, a convolutional neural network (CNN) was introduced to extract the features of each IMF component. Subsequently, a bi-directional long short-term memory network (BiLSTM) based on an attention mechanism (AM) was used for prediction. A Bayesian optimization algorithm (BOA) was also introduced to optimize the hyperparameters of the BiLSTM, thereby further improving the estimation precision of the VMD-CNN-AM-BOA-BiLSTM model. The model was applied to the daily runoff data from January 1, 2010 to November 30, 2021 at the Wushan and Weijiabao Hydrological Stations in the Wei River Basin, and the RMSEs of 3.54 and 15.23 were obtained for the test set data at the two stations respectively, which were much better than those of EEMD-VMD-SVM and CNN-BiLSTM-AM models. Additionally, the hereby proposed model is proven to have better peak flood prediction capability and adaptability under different hydrological environments. Based on this sound performance, the model becomes an effective data-driven tool in hydrological forecasting practice, and can also provide some reference and practical application guidance for water resources management and flood warning.

water resources,engineering, civil
A compound approach for ten-day runoff prediction by coupling wavelet denoising, attention mechanism, and LSTM based on GPU parallel acceleration technology

Yi-yang Wang,Wen-chuan Wang,Dong-mei Xu,Yan-wei Zhao,Hong-fei Zang

DOI: https://doi.org/10.1007/s12145-023-01212-3

2024-01-12

Earth Science Informatics

Abstract:Deep learning models have a high application value in runoff forecasting, but their prediction mechanism is difficult to interpret and their computational cost is high when dealing with complex hydrological relationships, limiting their feasibility in hydrological process mechanism analysis. To address these concerns, the paper first introduces an attention mechanism (AM) for building a long short-term memory network (LSTM) model with AM in the hidden layer (AM-LSTM). The AM-LSTM model employs attention layers to improve information extraction from hidden layers, resulting in a more accurate representation of the relationships between runoff-related elements. Furthermore, in the hidden layers of the AM-LSTM model, interpretable spatiotemporal attention units are established, which not only improves the model's prediction accuracy but also provides interpretability to the forecasting process. Furthermore, parallelization techniques are used in the paper to address the issue of model runtime cost. Simultaneously, to address the accuracy degradation caused by parallelization, the paper employs wavelet denoising (WD) techniques and builds the WD-AM-LSTM model. This accomplishment enables the runoff forecasting model to predict runoff in real time and with high accuracy. Based on validation using ten-day runoff data from the Huanren Reservoir in the Hun River's middle reaches, the results show that, with two layers and an eight-batch size, the AM-LSTM model outperforms the LSTM model in capturing spatiotemporal runoff features. During the model testing phase, the AM-LSTM model improves the MAE, RMSE, and NSE performance metrics by 8.46%, 13%, and 3.82%, respectively. The WD-AM-LSTM model effectively mitigates the noise impact caused by data parallelization under the conditions of two layers and a batch size of 512, achieving the same level of prediction performance while reducing computational cost by 92.01%. By incorporating attention mechanisms and wavelet denoising techniques, this study obtains high-speed and accurate predictions with interpretable results. It expands the deep learning models' applicability in ten-day runoff forecasting work.

geosciences, multidisciplinary,computer science, interdisciplinary applications
Monthly-scale hydro-climatic forecasting and climate change impact evaluation based on a novel DCNN-Transformer network

Haitao Yang,Zhizheng Zhang,Xi Liu,Pengxu Jing

DOI: https://doi.org/10.1016/j.envres.2023.116821

2023-11-01

Abstract:Climate change has emerged as one of the foremost global challenges confronting humanity today, leading to a heightened frequency and intensity of extreme weather phenomena, including droughts, floods, and erratic rainfall patterns. Accurately predicting changes in runoff patterns under future climate conditions holds significant importance for effective regional water resource planning and management. Recent research on runoff forecast has centered on optimizing hyperparameters of ELM, RNN, LSTM models using PSO, GWO, SSA, and other algorithms. Additionally, key features are extracted through input variable decomposition and preprocessing methods like EMD, EEMD, and VMD. However, these approaches have difficulties in extracting the long-term dependencies information of sequence units, parallel computing, and hyperparameter sensitivity. To address these shortcomings, this study proposes a novel end-to-end deep runoff prediction model based on deep convolutional neural network and Transformer (DCTN). The deep convolutional modules of DCTN employs the deep convolutional operation to extract local features of climate data while the Transformer of DCTN makes full use of self-attention to capture the long-term dependencies, which can achieve more accurate runoff predictions. Experiments on historical runoff forecasting at the Shanjiaodi hydrology station in the Dagu River Basin show that the proposed DCTN obtains a notable improvement of approximately 30.9% compared to traditional models. Based on the prediction results of three shared socioeconomic pathways, the potential impacts of climate change on runoff in Dagu River Basin were evaluated using the DCTN model. The results reveal that the likelihood of spring floods is substantially amplified in the mid-century and late-century, while the probability of extreme summer runoff diminishes. This study advances the understanding of runoff prediction and its implications under changing climate scenarios, paving the way for more informed decision-making and effective water resource management strategies.
Exploration of dual-attention mechanism-based deep learning for multi-step-ahead flood probabilistic forecasting

Zhen Cui,Shenglian Guo,Yanlai Zhou,Jun Wang

DOI: https://doi.org/10.1016/j.jhydrol.2023.129688

IF: 6.4

2023-05-20

Journal of Hydrology

Abstract:In order to improve the flood forecasting accuracy and reflect the forecast uncertainty information in the Three Gorges Reservoir (TGR) interval-basin in China, this study integrates the feature and temporal dual-attention (DA) mechanism and recursive encoder-decoder (RED) structure into the long short-term memory (LSTM) neural network to develop a DA-LSTM-RED model. The feature attention acts on the input variables of the encoder, and the temporal attention mechanism acts on the hidden layer states extracted by the LSTM neural network during encoding process, prompting the proposed model to extract critical input information among different types and moments of input variables to improve the multi-step-ahead flood forecasting accuracy. Second, the copula-based Hydrological Uncertainty Processor (copula-HUP) is used to quantify the forecast uncertainty of the proposed model meanwhile creating multi-step-ahead flood probabilistic forecasts. Combining the long-term 6h hydrologic data series of the Xiangjiaba-TGR interval-basin and the forecasted precipitation from the European Centre for Medium-Range Weather Forecasts (ECMWF), the effectiveness of the proposed model, the effect of forecast precipitation on multi-step-ahead flood forecasting, and the effect of different copula functions on the probabilistic forecast of copula-HUP are investigated, respectively. The results show that the DA-LSTM-RED model can effectively improve the forecasting accuracy for long forecast horizons (3-7d) compared to the LSTM-RED model, and the average absolute error metrics are reduced by 10%-17%. Meanwhile, the proposed model can identify input variables with a high correlation with the target output variables, which improves the interpretability of deep learning to a certain extent. The Student copula-HUP has the lowest RB and CRPS metrics than the Frank and Gaussian copula-HUP, which can better quantify the DA-LSTM-RED model's forecast uncertainty. Therefore, combining the proposed model with the Student copula-HUP can effectively reduce the forecasting uncertainty, enhance the forecasting reliability and accuracy for future horizons, and provide reliable risk information for the TGR flood control scheduling decision.

geosciences, multidisciplinary,water resources,engineering, civil
Daily runoff forecasting based on data-augmented neural network model

Xiao-ying Bi,Bo Li,Wen-long Lu,Xin-zhi Zhou

DOI: https://doi.org/10.2166/hydro.2020.017

IF: 3.058

2020-05-16

Journal of Hydroinformatics

Abstract:Abstract Accurate daily runoff prediction plays an important role in the management and utilization of water resources. In order to improve the accuracy of prediction, this paper proposes a deep neural network (CAGANet) composed of a convolutional layer, an attention mechanism, a gated recurrent unit (GRU) neural network, and an autoregressive (AR) model. Given that the daily runoff sequence is abrupt and unstable, it is difficult for a single model and combined model to obtain high-precision daily runoff predictions directly. Therefore, this paper uses a linear interpolation method to enhance the stability of hydrological data and apply the augmented data to the CAGANet model, the support vector machine (SVM) model, the long short-term memory (LSTM) neural network and the attention-mechanism-based LSTM model (AM-LSTM). The comparison results show that among the four models based on data augmentation, the CAGANet model proposed in this paper has the best prediction accuracy. Its Nash–Sutcliffe efficiency can reach 0.993. Therefore, the CAGANet model based on data augmentation is a feasible daily runoff forecasting scheme.

environmental sciences,computer science, interdisciplinary applications,engineering, civil,water resources
A Novel Runoff Forecasting Model Based on the Decomposition-Integration-Prediction Framework

Zhanxing Xu,Jianzhong Zhou,Li Mo,Benjun Jia,Yuqi Yang,Wei Fang,Zhou Qin

DOI: https://doi.org/10.3390/w13233390

IF: 3.53

2021-12-01

Water

Abstract:Runoff forecasting is of great importance for flood mitigation and power generation plan preparation. To explore the better application of time-frequency decomposition technology in runoff forecasting and improve the prediction accuracy, this research has developed a framework of runoff forecasting named Decomposition-Integration-Prediction (DIP) using parallel-input neural network, and proposed a novel runoff forecasting model with Variational Mode Decomposition (VMD), Gated Recurrent Unit (GRU), and Stochastic Fractal Search (SFS) algorithm under this framework. In this model, the observed runoff series is first decomposed into several sub-series via the VMD method to extract different frequency information. Secondly, the parallel layers in the parallel-input neural network based on GRU are trained to receive the input samples of each subcomponent and integrate their output adaptively through the concatenation layers. Finally, the output of concatenation layers is treated as the final runoff forecasting result. In this process, the SFS algorithm was adopted to optimize the structure of the neural network. The prediction performance of the proposed model was evaluated using the historical monthly runoff data at Pingshan and Yichang hydrological stations in the Upper Yangtze River Basin of China, and seven various single and decomposition-based hybrid models were developed for comparison. The results show that the proposed model has obvious advantages in overall prediction performance, model training time, and multi-step-ahead prediction compared to several comparative methods, which is a reasonable and more efficient monthly runoff forecasting method based on time series decomposition and neural networks.

environmental sciences,water resources
A novel feature attention mechanism for improving the accuracy and robustness of runoff forecasting

Hao Wang,Hui Qin,Guanjun Liu,Shuai Liu,Yuhua Qu,Kang Wang,Jianzhong Zhou

DOI: https://doi.org/10.1016/j.jhydrol.2023.129200

IF: 6.4

2023-02-16

Journal of Hydrology

Abstract:The interaction between hydrological factors is complex and the correlation effects cannot be quantitatively explained from a mechanistic perspective. The extraction of effective features from several hydrological and meteorological data and quantifying their correlation effects to make runoff prediction more accurate and stable is an urgent problem to be solved. In this study, we introduce a structural paradigm for hydrological time series to handle the entire feature space composed of some feature sequences based on deep learning methods, namely, the feature attention mechanism. This method transforms the problem of feature-target association into multiple parallel binary classification problems and assigns attention units to each specific feature in the network. The attention distribution was adjusted by updating the neural network parameters in a supervised manner to generate feature weightings. In addition, two extensions were proposed based on the initial network structure. The three methods were used in a practical study of the upper Yangtze River Basin using three evaluation metrics compared with five benchmark methods. The mean metric values were improved by up to 9.43, 10.05, and 2.65%, respectively. Meanwhile, with the characteristics of hydrological data, the rationality of the method is corroborated in hydrological feature discovery and time-series dependence extraction. Moreover, we tested the performance of the model on two constructed noise datasets to demonstrate its robustness. The results of all the above experiments show that the attention module significantly improves the learning and generalization ability, enhances noise resistance, and strengthens the robustness of the model compared with the traditional method.

geosciences, multidisciplinary,water resources,engineering, civil
A novel multi-step ahead forecasting model for flood based on time residual LSTM

Yongsong Zou,Jin Wang,Peng Lei,Yi Li

DOI: https://doi.org/10.1016/j.jhydrol.2023.129521

IF: 6.4

2023-04-29

Journal of Hydrology

Abstract:Climate change has significantly impacted hydrology, including extreme precipitation, and changing precipitation patterns that could lead to an increase in flooding. Life and property benefit from accurate and reliable multi-step flood forecasting. Recently, Recurrent Neural Network (RNN) have become increasingly popular among hydrology researchers for their ability to capture historical dependencies, simplify computations by ignoring intermediate hydrological processes, and provide higher prediction accuracy than traditional models. However, RNN-based flood prediction models face two significant challenges. Firstly, due to their strict time-serial, RNN suffer from gradient issues such as vanishing and exploding gradients, which can make training RNN models difficult. To address this issue, we propose a Residual Long Short-Term Memory (ResLSTM) model that incorporates time residual connections into the time connections of LSTM. Secondly, most flood prediction models output a deterministic value, but the natural hydrological characteristics of the basin are a nonlinear and complex system with many influencing factors that have some randomness. This requires the use of probabilistic methods to modeling. Thus, we introduce the probabilistic forecasting model Autoregressive Recurrent Networks (DeepAR) into our flood prediction model, which outputs a prediction interval rather than a deterministic value. Then, we build four flood probability prediction models by combining DeepAR and four enhanced RNN, including ResLSTM (ours), Long Short-Term Memory (LSTM), Gate Recurrent Unit (GRU), and Time Feedforward Connections Simple Gate Recurrent Unit (TFC-SGRU). The performance of these models is evaluated by the long-term hydrologic data of the Passaic and Ramapo River basins in the United States. The results demonstrate that the prediction interval of the four models is more adaptive to flood uncertainties. And the accuracy of peak flow prediction is nearly 100% within a 90% prediction probability interval. The temporal residual-based model is more accurate and robust than the original LSTM and GRU. We believe this study fills a research gap in multi-step-ahead flood probability prediction and improves the accuracy and reliability of flood prediction models.

geosciences, multidisciplinary,water resources,engineering, civil
An attention-based LSTM model for long-term runoff forecasting and factor recognition

Dongyang Han,Pan Liu,Kang Xie,He Li,Qian Xia,Qian Cheng,Yibo Wang,Zhikai Yang,Yanjun Zhang,Jun Xia

DOI: https://doi.org/10.1088/1748-9326/acaedd

IF: 6.7

2022-12-29

Environmental Research Letters

Abstract:With advances in artificial intelligence, machine learning (ML)-based models such as long short-term memory (LSTM) models have shown much promise in forecasting long-term runoff by mapping pathways between large-scale climate patterns and catchment runoff responses without considering physical processes. The recognition of key factors plays a vital role and thus affects the performance of the model. However, there is no conclusion on which recognition algorithm is the most suitable. To address this issue, an LSTM model combined with two attention mechanisms both in the input and hidden layers, namely AT-LSTM, is proposed for long-term runoff forecasting at Yichang and Pingshan stations in China. The added attention mechanisms automatically assign weights to 130 climate phenomenon indexes, avoiding the use of subjectively set recognition algorithms. Results show that the AT-LSTM model outperforms the Pearson's correlation based LSTM model in terms of four evaluation metrics for monthly runoff forecasting. Further, the set indirect runoff prediction method verifies that the AT-LSTM model also performs effectively in precipitation and potential evapotranspiration forecasting, and the indirect runoff prediction is inferior to the AT-LSTM model to establish a direct link between climate factors and runoff. Finally, four key factors related to runoff are identified by the attention mechanism and their impacts on runoff are analyzed on intra- and inter-annual scales. The proposed AT-LSTM model can effectively improve the accuracy of long-term forecasting and identify the dynamic influence of input factors.

environmental sciences,meteorology & atmospheric sciences
Research on Runoff Prediction Based on Time2Vec-TCN-Transformer Driven by Multi-Source Data

Yang Liu,Yize Wang,Xuemei Liu,Xingzhi Wang,Zehong Ren,Songlin Wu

DOI: https://doi.org/10.3390/electronics13142681

IF: 2.9

2024-07-10

Electronics

Abstract:Due to the frequent occurrence of extreme weather in recent years, accurate runoff prediction is crucial for the rational planning and management of water resources. Addressing the high uncertainty and multiple influencing factors in runoff prediction, this paper proposes a runoff prediction method driven by multi-source data. Based on multivariate observed data of runoff, water level, temperature, and precipitation, a Time2Vec-TCN-Transformer model is proposed for runoff prediction research and compared with LSTM, TCN, and TCN-Transformer models. The results show that the Time2Vec-TCN-Transformer model outperforms other models in metrics including MAE, RRMSE, MAPE, and NSE, demonstrating higher prediction accuracy and reliability. By effectively combining Time2Vec, TCN, and Transformer, the proposed model improves the MAPE for forecasting 1–4 days in the future by approximately 7% compared to the traditional LSTM model and 4% compared to the standalone TCN model, while maintaining NSE consistently between 0.9 and 1. This model can better capture the periodicity, long-term scale information, and relationships among multiple variables of runoff data, providing reliable predictive support for flood forecasting and water resources management.

engineering, electrical & electronic,computer science, information systems,physics, applied
Daily runoff forecasting by deep recursive neural network

Jiangwei Zhang,Xiaohui Chen,Amirul Khan,You-kuan Zhang,Xingxing Kuang,Xiuyu Liang,Maria L. Taccari,Jonathan Nuttall

DOI: https://doi.org/10.1016/j.jhydrol.2021.126067

IF: 6.4

2021-05-01

Journal of Hydrology

Abstract:<p>In recent years, deep Recurrent Neural Network (RNN) has been applied to predict daily runoff, as its wonderful ability of dealing with the high nonlinear interactions among the complex hydrology factors. However, most of the existing studies focused on the model structure and the computational load, without considering the impact from the selection of multiple input variables on the model prediction. This article presents a study to evaluate this influence and provides a method of identifying the best meteorological input variables for a run off model. Rainfall data and multiple meteorological data have been considered as input to the model. Principal Component Analysis (PCA) has been applied to the data as a contrast, to reduce dimensionality and redundancy within this input data. Two different deep RNN models, a long-short term memory (LSTM) model and a gated recurrent unit (GRU) model, were comparatively applied to predict runoff with these inputs. In this study, the Muskegon river and the Pearl river were taken as examples. The results demonstrate that the selection of input variables have a great influence on the predictions made using the RNN while the RNN model with multiple meteorological input data is shown to achieve higher accuracy than rainfall data alone. PCA method can improve the accuracy of deep RNN model effectively as it can reflect core information by classifying the original data information into several comprehensive variables.</p>

geosciences, multidisciplinary,water resources,engineering, civil
Improving forecasting accuracy of medium and long-term runoff using artificial neural network based on EEMD decomposition

Wen-chuan Wang,Kwok-wing Chau,Lin Qiu,Yang-bo Chen

DOI: https://doi.org/10.1016/j.envres.2015.02.002

Abstract:Hydrological time series forecasting is one of the most important applications in modern hydrology, especially for the effective reservoir management. In this research, an artificial neural network (ANN) model coupled with the ensemble empirical mode decomposition (EEMD) is presented for forecasting medium and long-term runoff time series. First, the original runoff time series is decomposed into a finite and often small number of intrinsic mode functions (IMFs) and a residual series using EEMD technique for attaining deeper insight into the data characteristics. Then all IMF components and residue are predicted, respectively, through appropriate ANN models. Finally, the forecasted results of the modeled IMFs and residual series are summed to formulate an ensemble forecast for the original annual runoff series. Two annual reservoir runoff time series from Biuliuhe and Mopanshan in China, are investigated using the developed model based on four performance evaluation measures (RMSE, MAPE, R and NSEC). The results obtained in this work indicate that EEMD can effectively enhance forecasting accuracy and the proposed EEMD-ANN model can attain significant improvement over ANN approach in medium and long-term runoff time series forecasting.
A Hybrid Model of Ensemble Empirical Mode Decomposition and Sparrow Search Algorithm-Based Long Short-Term Memory Neural Networks for Monthly Runoff Forecasting

Bao-Jian Li,Jing-Xin Yang,Qing-Yuan Luo,Wen-Chuan Wang,Tai-Heng Zhang,Ling Zhong,Guo-Liang Sun

DOI: https://doi.org/10.3389/fenvs.2022.909682

IF: 5.411

2022-07-19

Frontiers in Environmental Science

Abstract:Monthly runoff forecasting plays a vital role in reservoir ecological operation, which can reduce the negative impact of dam construction and operation on the river ecosystem. Numerous studies have been conducted to improve monthly runoff forecast accuracy, of which machine learning methods have been paid much attention due to their unique advantages. In this study, a conjunction model, EEMD-SSA-LSTM for short, which comprises ensemble empirical mode decomposition (EEMD) and sparrow search algorithm (SSA)–based long short-term neural networks (LSTM), has been proposed to improve monthly runoff forecasting. The EEMD-SSA-LSTM model is mainly carried out in three steps. First, the original time series data is decomposed into several sub-sequences. Second, each sub-sequence is simulated by LSTM, of which the hyperparameters are optimized by SSA. Finally, the simulated results for each sub-sequence are summarized as the final results. The data obtained from two reservoirs located in China are used to validate the proposed model performance. Meanwhile, four commonly used statistical evaluation indexes are utilized to evaluate model performance. The results demonstrate that compared to several benchmark models, the proposed model can yield satisfactory forecast results and can be conducive to improving monthly runoff forecast accuracy.

environmental sciences
Application of a Multi-Model Fusion Forecasting Approach in Runoff Prediction: A Case Study of the Yangtze River Source Region

Tingqi Wang,Yuting Guo,Mazina Svetlana Evgenievna,Zhenjiang Wu

DOI: https://doi.org/10.3390/su16145964

IF: 3.9

2024-07-13

Sustainability

Abstract:Runoff forecasting is crucial for sustainable water resource management. Despite the widespread application of deep learning methods in this field, there is still a need for improvement in the modeling and utilization of multi-scale information. For the first time, we introduce the Neural Basis Expansion Analysis with Exogenous Variable (NBEATSx) model to perform runoff prediction for a full exploration in rich temporal characteristics of runoff sequences. To harness wavelet transform (WT) multi-scale information capabilities, we developed the WT-NBEATSx forecasting model, integrating WT and NBEATSx. This model was further enhanced by incorporating a Long Short-Term Memory (LSTM) model for superior long-term dependency detection and a Random Forest (RF) model as a meta-model. The result is the advanced multi-model fusion forecasting model WT-NBEATSx-LSTM-RF (WNLR). This approach significantly enhances performance in runoff prediction. Utilizing a daily scale runoff and meteorological dataset from the Yangtze River Source region in China from 2006 to 2018, we systematically evaluated the performance of the WNLR model in runoff prediction tasks. Compared with LSTM, Gated Recurrent Units (GRUs), and NBEATSx models, the WNLR model not only significantly outperforms the original NBEATSx model but also surpasses other comparison models, particularly in accurately extracting cyclical change patterns, with NSE scores of 0.986, 0.974, and 0.973 for 5-, 10-, and 15-day forecasts, respectively. Additionally, compared to the standalone LSTM and GRU models, the introduction of wavelet transforms to form WT-LSTM and WT-GRU notably improved prediction performance and robustness, especially in long-term forecasts, where NSE increased by 32% and 1.5%, respectively. This study preliminarily proves the effectiveness of combining the cyclical characteristics of NBEATSx and wavelet transforms and creatively proposes a new deep learning model integrating LSTM and RF, providing new insights for further considering multi-scale features of complex runoff time series, thereby enhancing runoff prediction effectiveness.

environmental sciences,environmental studies,green & sustainable science & technology
Marching in a new parade: family medicine and health care reform.

M. Rivo

American family physician

Abstract:
Improving flood forecasting using time-distributed CNN-LSTM model: a time-distributed spatiotemporal method

DOI: https://doi.org/10.1007/s12145-024-01354-y

2024-06-11

Earth Science Informatics

Abstract:The rapid and devastating nature of flood events in small and medium basins presents considerable challenges to flood forecasting. Developing a robust and accurate flood forecasting method is crucial to mitigating flood effects. To this end, we propose the Time-distributed CNN-LSTM model (TD-CNN-LSTM), a hybrid deep learning framework based on a Time Distribution layer (TD), Convolutional Neural Networks (CNNs), and Long-Short Term Memory Networks (LSTMs). The TD-CNN-LSTM model efficiently captures spatiotemporal hydrological features within spatial dimensions using the Time-distributed local Features extractor, while the LSTM focuses on extracting spatiotemporal features in temporal dimensions. Our model effectively captures complex spatial and temporal relationship patterns within hydrological data from flood time series. Experimental results on the Tunxi and Changhua basins show the superior predictive capabilities of our model, particularly in forecasting flood occurrence time and peak. When compared with baseline models LSTM, CNN, ConvLSTM, STA-LSTM, and CNN-LSTM at the moment T + 9, TD-CNN-LSTM achieved a 6.7%, 10.14%, 8.5%, 6.3%, and 6.6% decreased in Root-Mean-Square Error (RMSE), respectively, a 6.5%, 9.8%, 10.9%, 6.8%, and 10.6% decreased in Mean Absolute Error (MAE), respectively, and a 7.4%, 31.6%, 23.5%, 18.8%, and 27.8% decreased in Mean Absolute Percentage Error (MAPE), respectively. In addition, the determination Coefficient (R 2 ) increased by 3.6% and Nash-Sutcliffe Efficiency (NSE) increased by 4.8% .

geosciences, multidisciplinary,computer science, interdisciplinary applications
An Ensemble Hybrid Forecasting Model for Annual Runoff Based on Sample Entropy, Secondary Decomposition, and Long Short-Term Memory Neural Network

Wen-chuan Wang,Yu-jin Du,Kwok-wing Chau,Dong-mei Xu,Chang-jun Liu,Qiang Ma

DOI: https://doi.org/10.1007/s11269-021-02920-5

IF: 4.426

2021-10-05

Water Resources Management

Abstract:Accurate and consistent annual runoff prediction in a region is a hot topic in management, optimization, and monitoring of water resources. A novel prediction model (ESMD-SE-WPD-LSTM) is presented in this study. Firstly, extreme-point symmetric mode decomposition (ESMD) is used to produce several intrinsic mode functions (IMF) and a residual (Res) by decomposing the original runoff series. Secondly, sample entropy (SE) method is employed to measure the complexity of each IMF. Thirdly, wavelet packet decomposition (WPD) is adopted to further decompose the IMF with the maximum SE into several appropriate components. Then long short-term memory (LSTM) model, a deep learning algorithm based recurrent approach, is employed to predict all components. Finally, forecasting results of all components are aggregated to generate the final prediction. The proposed model, which is applied to seven annual series from different areas in China, is evaluated based on four evaluation indexes (R, MAE, MAPE and RMSE). Results indicate that ESMD-SE-WPD-LSTM outperforms other benchmark models in terms of four evaluation indexes. Hence the proposed model can provide higher accuracy and consistency for annual runoff prediction, rendering it an efficient instrument for scientific management and planning of water resources.

water resources,engineering, civil
Deep insight into daily runoff forecasting based on a CNN-LSTM model

Huiqi Deng,Wenjie Chen,Guoru Huang

DOI: https://doi.org/10.1007/s11069-022-05363-2

IF: 3.158

2022-05-08

Natural Hazards

Abstract:Rainfall-runoff forecasting is expected to play a crucial role in hydrology. In recent years, machine learning models have been found to be effective in runoff simulation, and convolutional neural network (CNN) and long short-term memory (LSTM) in particular have been applied widely in hydrology. However, there are few studies investigating the applicability of the combination of CNN and LSTM (CNN-LSTM) to runoff simulation and the influence of its input parameters on the prediction performance of the model. This paper thus proposes a daily runoff forecasting model based on a CNN-LSTM model and investigates the influence of various input parameters, including the characteristics of input variables, input time step, dataset size, and lead time. The proposed model is then applied in the Feilaixia catchment. Results show that the CNN-LSTM model for runoff forecasting outperforms the LSTM model. Sensitivity analyses suggest that the settings of four input parameters have a strong influence on the prediction performance, and the degree of influence of each parameter differs. The model with runoff and rainfall data inputs yielded the best performance compared to models with other input variables. Increasing excessive input time step will lead to performance degradation and overfitting problem. As for the dataset size, both the length and the stationarity of the time series should be taken into consideration. Current case is 32-year dataset with a segmentation ratio of 0.85:0.15. Lead time is a critical factor in runoff prediction and over 3-day-ahead predictions are of low accuracy. Some discussions are also depicted to translate the recommended values into something interpretable in hydrology. This study enhances the understanding of linkage between hydrological mechanisms and runoff forecasting based on deep learning.

geosciences, multidisciplinary,water resources,meteorology & atmospheric sciences

[Cardiac symptomatology of stress].

Multi-lead-time short-term runoff forecasting based on Ensemble Attention Temporal Convolutional Network

Enhanced Rainfall Nowcasting of Tropical Cyclone by an Interpretable Deep Learning Model and Its Application in Real-Time Flood Forecasting

Runoff Forecasting using Convolutional Neural Networks and optimized Bi-directional Long Short-term Memory

A compound approach for ten-day runoff prediction by coupling wavelet denoising, attention mechanism, and LSTM based on GPU parallel acceleration technology

Monthly-scale hydro-climatic forecasting and climate change impact evaluation based on a novel DCNN-Transformer network

Exploration of dual-attention mechanism-based deep learning for multi-step-ahead flood probabilistic forecasting

Daily runoff forecasting based on data-augmented neural network model

A Novel Runoff Forecasting Model Based on the Decomposition-Integration-Prediction Framework

A novel feature attention mechanism for improving the accuracy and robustness of runoff forecasting

A novel multi-step ahead forecasting model for flood based on time residual LSTM

An attention-based LSTM model for long-term runoff forecasting and factor recognition

Research on Runoff Prediction Based on Time2Vec-TCN-Transformer Driven by Multi-Source Data

Daily runoff forecasting by deep recursive neural network

Improving forecasting accuracy of medium and long-term runoff using artificial neural network based on EEMD decomposition

A Hybrid Model of Ensemble Empirical Mode Decomposition and Sparrow Search Algorithm-Based Long Short-Term Memory Neural Networks for Monthly Runoff Forecasting

Application of a Multi-Model Fusion Forecasting Approach in Runoff Prediction: A Case Study of the Yangtze River Source Region

Marching in a new parade: family medicine and health care reform.

Improving flood forecasting using time-distributed CNN-LSTM model: a time-distributed spatiotemporal method

An Ensemble Hybrid Forecasting Model for Annual Runoff Based on Sample Entropy, Secondary Decomposition, and Long Short-Term Memory Neural Network

Deep insight into daily runoff forecasting based on a CNN-LSTM model