Abstract:Accurate information on surface soil moisture (SSM) content at a global scale under different climatic conditions is important for hydrological and climatological applications. Machine-learning-based systematic integration of in situ hydrological measurements, complex environmental and climate data, and satellite observation facilitate the generation of reliable data products to monitor and analyse the exchange of water, energy, and carbon in the Earth system at a proper space–time resolution. This study investigates the estimation of daily SSM using 8 optimised machine learning (ML) algorithms and 10 ensemble models (constructed via model bootstrap aggregating techniques and five-fold cross-validation). The algorithmic implementations were trained and tested using International Soil Moisture Network (ISMN) data collected from 1722 stations distributed across the world. The result showed that the K-neighbours Regressor (KNR) had the lowest root-mean-square error (0.0379 cm 3 cm −3 ) on the "test_random" set (for testing the performance of randomly split data during training), the Random Forest Regressor (RFR) had the lowest RMSE (0.0599 cm 3 cm −3 ) on the "test_temporal" set (for testing the performance on the period that was not used in training), and AdaBoost (AB) had the lowest RMSE (0.0786 cm 3 cm −3 ) on the "test_independent-stations" set (for testing the performance on the stations that were not used in training). Independent evaluation on novel stations across different climate zones was conducted. For the optimised ML algorithms, the median RMSE values were below 0.1 cm 3 cm −3 . GradientBoosting (GB), Multi-layer Perceptron Regressor (MLPR), Stochastic Gradient Descent Regressor (SGDR), and RFR achieved a median r score of 0.6 in 12, 11, 9, and 9 climate zones, respectively, out of 15 climate zones. The performance of ensemble models improved significantly, with the median RMSE value below 0.075 cm 3 cm −3 for all climate zones. All voting regressors achieved r scores of above 0.6 in 13 climate zones; BSh (hot semi-arid climate) and BWh (hot desert climate) were the exceptions because of the sparse distribution of training stations. The metric evaluation showed that ensemble models can improve the performance of single ML algorithms and achieve more stable results. Based on the results computed for three different test sets, the ensemble model with KNR, RFR and Extreme Gradient Boosting (XB) performed the best. Overall, our investigation shows that ensemble machine learning algorithms have a greater capability with respect to predicting SSM compared with the optimised or base ML algorithms; this indicates their huge potential applicability in estimating water cycle budgets, managing irrigation, and predicting crop yields.

A novel self-adjusting weight approximation procedure to minimize non-identical seasonal effects in multimodel ensemble for accurate twenty-first century drought assessment

Using ensemble-mean climate scenarios for future crop yield projections: a stochastic weather generator approach

Effectiveness of Using Representative Subsets of Global Climate Models in Future Crop Yield Projections

A novel statistical framework of drought projection by improving ensemble future climate model simulations under various climate change scenarios

Improving drought monitoring using climate models with bias‐corrected under Gaussian mixture probability models

Development of maximum relevant prior feature ensemble (MRPFE) index to characterize future drought using global climate models

Improving future drought predictions – a novel multi-method framework based on mutual information for subset selection and spatial aggregation of global climate models of precipitation

A New Weighting Scheme in Weighted Markov Model for Predicting the Probability of Drought Episodes

Reduction of Errors in Hydrological Drought Monitoring – A Novel Statistical Framework for Spatio-Temporal Assessment of Drought

A New Bayesian Network-Based Generalized Weighting Scheme for the Amalgamation of Multiple Drought Indices

Investigating Whether the Ensemble Average of Multi-Global-Climate-Models Can Necessarily Better Project Seasonal Drought Conditions in China

Quantifying the uncertainty of internal variability in future projections of seasonal soil moisture droughts over China

Measuring and restructuring the risk in forecasting drought classes: an application of weighted Markov chain based model for standardised precipitation evapotranspiration index (SPEI) at one-month time scale

Ensemble of optimised machine learning algorithms for predicting surface soil moisture content at a global scale

Development of Ridge Ensemble Standardized Drought Index (RESDI) for improving drought characterization and future assessment

Projection of future drought and its impact on simulated crop yield over South Asia using ensemble machine learning approach

On The Reduction of Inaccuracies in Drought Monitoring - A Novel Blended Procedure for Standardized Type Drought Indicators

A New Comprehensive Framework for Identifying and Monitoring the Interseasonal Characteristics of Meteorological Drought

Multi-model ensemble bias-corrected precipitation dataset and its application in identification of drought-flood abrupt alternation in China

Evaluation and prediction of future droughts with multi-model ensembling of four models under CMIP6 scenarios over Iraq

Forecasting of meteorological drought using ensemble and machine learning models