Abstract:In the era of big data, missing data imputation remains a delicate topic for both the analysis of natural processes and to provide input data for physical models. We propose here a comparative study for missing data imputation on daily rainfall, a variable that can exhibit a complex structure composed of a dry/wet pattern and anisotropic sharp variations.The seven algorithms considered can be grouped in two families: geostatistical interpolation techniques based on inverse-distance weighting and Kriging, widely used in gap-filling [1], and data-driven techniques based on the analysis of historical data patterns. This latter family of algorithms has been already applied to rainfall generation [2, 3], but it is not originally suitable to historical datasets presenting many data gaps. This happens because they usually operate in a rigid framework where, when a rainfall value is estimated for a station, the others are considered as predictor variables and require to be informed. To overcome this limitation, we propose here i) an adaptation of k-nearest neighbor (KNN) and ii) a new algorithm called Vector Sampling (VS), that combines concepts of multiple-point statistics and resampling. These data-driven algorithms can draw estimations from largely and variably incomplete data patterns, allowing the target dataset to be at the same time the training dataset.Tested on different case studies from Denmark, Australia, and Switzerland, the algorithms show a different performance that seems to be related to the terrain type: on flat terrains with spatially uniform rain events, geostatistical interpolation tends to minimize the error, while, in mountainous regions with non-stationary rainfall statistics, data mining can recover better the complex rainfall patterns. The VS algorithm, being faster than KNN and requiring minimal parametrization, turns out to be a convenient option for routine application if a representative historical dataset is available. VS is open-source and freely available at .&#160;REFERENCES:org/org/

Combining commercial microwave link and rain gauge observations to estimate countrywide precipitation: A stochastic reconstruction and pattern analysis approach

Stochastic Generation of Daily Rainfall Events: A Single-Site Rainfall Model with Copula-based Joint Simulation of Rainfall Characteristics and Classification and Simulation of Rainfall Patterns

Conditional simulation of spatial rainfall fields using random mixing: a study that implements full control over the stochastic process

Radar based rainfall nowcasting and its characteristic prediction based on spatially correlated random field, normalized duration line and Kalman filter algorithm

Merging weather radar data and opportunistic rainfall sensor data to enhance rainfall estimates

Combining Geostatistics and Remote Sensing Data to Improve Spatiotemporal Analysis of Precipitation

Missing data imputation for multisite rainfall networks: a comparison between geostatistical interpolation and data-mining estimation on different terrain types

Regional centennial precipitation variability over Germany from extended observation records

Temporal Super-Resolution, Ground Adjustment, and Advection Correction of Radar Rainfall Using 3-D-Convolutional Neural Networks

Merging with crowdsourced rain gauge data improves pan-European radar precipitation estimates

On the potential of commercial microwave link networks for high spatial resolution rainfall monitoring in urban areas

Simulating sub-hourly rainfall data for current and future periods using two statistical disaggregation models: case studies from Germany and South Korea

Application of commercial microwave links (CMLs) attenuation for quantitative estimation of precipitation

High-resolution global precipitation downscaling with latent Gaussian models and non-stationary stochastic partial differential equation structure

Classifying microwave radiometer observations over The Netherlands into dry, shallow-, and non-shallow precipitation using a random forest model

Precipitation Monitoring Using Commercial Microwave Links: Current Status, Challenges and Prospectives

On the Propagation of Satellite Precipitation Estimation Errors: From Passive Microwave to Infrared Estimates

Distance in spatial interpolation of daily rain gauge data

Relevance of merging radar and rainfall gauge data for rainfall nowcasting in urban hydrology

Spatial--temporal mesoscale modeling of rainfall intensity using gage and radar data

Integration of Satellite-Derived and Ground-Based Soil Moisture Observations for a Precipitation Product over the Upper Heihe River Basin, China