A Study on Long-Term Forecasting of Water Quality Data Using Self-Attention with Correlation

Zhi Xue,Xinghan Xu,Lei Hu,Jianwei Liu,Xiaohui Yan,Min Han
DOI: https://doi.org/10.1016/j.jhydrol.2024.132390
IF: 6.4
2024-01-01
Journal of Hydrology
Abstract:Long-term water quality forecasting is a crucial component of pollution prevention and control, providing essential support for water resource protection and early warning of water quality deterioration. However, predicting water quality data over extended periods remains a significant challenge due to the inherent temporal dependencies, pronounced long-term periodicity, and frequent data gaps. Existing methods, such as Transformer, often struggle with capturing long-term periodic patterns and are sensitive to missing data. To solve these problems, this paper proposes a Transformer-based long-term water quality prediction model, called LWQformer, by combining the basic characteristics of missing water quality data. Specifically, a date-driven positional embedding layer is employed to incorporate temporal information into the modeling process, enabling the model to effectively learn trends and patterns over time. Meanwhile, LWQformer replaces the self-attention mechanism with a correlation self-attention mechanism, enhancing the model’s ability to capture the long-term periodicity of water quality data. To validate the effectiveness of the proposed model, we use the water quality data DO, pH and CODMN of Dahuofang Reservoir in Liaoning, China as the research object. Our model outperforms the other five algorithms in terms of three evaluation metrics, demonstrating its effectiveness in improving long-term prediction accuracy.
What problem does this paper attempt to address?