Abstract:For the purpose of improving the scientific nature, reliability, and accuracy of flood forecasting, it is an effective and practical way to construct a flood forecasting scheme and carry out real-time forecasting with consideration of different rain patterns. The technique for rain pattern classification is of great significance in the above-mentioned technical roadmap. With the rapid development of artificial intelligence technologies such as machine learning, it is possible and necessary to apply these new methods to assist rain classification applications. In this research, multiple machine learning methods were adopted to study the time-history distribution characteristics and conduct rain pattern classification from observed rainfall time series data. Firstly, the hourly rainfall data between 2003 and 2021 of 37 rain gauge stations in the Pi River Basin were collected to classify rain patterns based on the universally acknowledged dynamic time warping (DTW) algorithm, and the classifications were treated as the benchmark result. After that, four other machine learning methods, including the Decision Tree (DT), Long- and Short-Term Memory (LSTM) neural network, Light Gradient Boosting Machine (LightGBM), and Support Vector Machine (SVM), were specifically selected to establish classification models and the model performances were compared. By adjusting the sampling size, the influence of different sizes on the classification was analyzed. Intercomparison results indicated that LightGBM achieved the highest accuracy and the fastest training speed, the accuracy and F-1 score were 98.95% and 98.58%, respectively, and the loss function and accuracy converged quickly after only 20 iterations. LSTM and SVM have satisfactory accuracy but relatively low training efficiency, and DT has fast classification speed but relatively low accuracy. With the increase in the sampling size, classification results became stable and more accurate. Besides the higher accuracy, the training efficiency of the four methods was also improved.

Forest Cover Types Classification Based on Online Machine Learning on Distributed Cloud Computing Platforms of Storm and SAMOA

Self-Adaptive Framework for Efficient Stream Data Classification on Storm

RESEARCH ON ROUGH SET AND BAYES-BASED METEOROLOGICAL DATA MINING ON HADOOP PLATFORM

Analysis and Prediction of Big Stream Data in Real-Time Water Quality Monitoring System.

Big Data Real-Time Processing Based on Storm

Automated Analysis of the US Drought Monitor Maps With Machine Learning and Multiple Drought Indicators

A Review of Application of Machine Learning in Storm Surge Problems

Large-Scale Text Clustering Based on Improved K-Means Algorithm in the Storm Platform

Extremely Fast Decision Tree Mining for Evolving Data Streams

Towards Online Anomaly Detection by Combining Multiple Detection Methods and Storm

HDSVM: A High Efficiency Distributed SVM Framework over Data Stream.

Adaptive Topology Decomposition for Storm

Research on Rain Pattern Classification Based on Machine Learning: A Case Study in Pi River Basin

An Online Prediction Algorithm of Traffic in Big Data Based on the Storm

Sports performance prediction model based on integrated learning algorithm and cloud computing Hadoop platform

CLASSIFICATION ALGORITHMS FOR BIG DATA ANALYSIS, A MAP REDUCE APPROACH

Forest Cover Classification from Multi-temporal MODIS Images in Southeast Asia Using Decision Tree

Forest Cover Classification from Multi-temporal MODIS Images in Southeast Asia Using Decision Tree.

Statistical and Machine Learning Methods Applied to the Prediction of Different Tropical Rainfall Types

Healthcare4VideoStorm: Making Smart Decisions Based on Storm Metrics

Dominant Tree Species Mapping Using Machine Learning Based on Multi-Temporal and Multi-Source Data