Abstract:Short-term fecal pollution events are a major challenge for managing microbial safety at recreational waters. Long turn-over times of current laboratory methods for analyzing fecal indicator bacteria (FIB) delay water quality assessments. Data-driven models have been shown to be valuable approaches to enable fast water quality assessments. However, a major barrier towards the wider use of such models is the prevalent data scarcity at existing bathing waters, which questions the representativeness and thus usefulness of such datasets for model training. The present study explores the ability of five data-driven modelling approaches to predict short-term fecal pollution episodes at recreational bathing locations under data scarce situations and imbalanced datasets. The study explicitly focuses on the potential benefits of adopting an innovative modeling and risk-based assessment approach, based on state/cluster-based Bayesian updating of FIB distributions in relation to different hydrological states. The models are benchmarked against commonly applied supervised learning approaches, particularly linear regression, and random forests, as well as to a zero-model which closely resembles the current way of classifying bathing water quality in the European Union. For model-based clustering we apply a non-parametric Bayesian approach based on a Dirichlet Process Mixture Model. The study tests and demonstrates the proposed approaches at three river bathing locations in Germany, known to be influenced by short-term pollution events. At each river two modelling experiments ("longest dry period", "sequential model training") are performed to explore how the different modelling approaches react and adapt to scarce and uninformative training data, i.e., datasets that do not include event pollution information in terms of elevated FIB concentrations. We demonstrate that it is especially the proposed Bayesian approaches that are able to raise correct warnings in such situations (> 90 % true positive rate). The zero-model and random forest are shown to be unable to predict contamination episodes if pollution episodes are not present in the training data. Our research shows that the investigated Bayesian approaches reduce the risk of missed pollution events, thereby improving bathing water safety management. Additionally, the approaches provide a transparent solution for setting minimum data quality requirements under various conditions. The proposed approaches open the way for developing data-driven models for bathing water quality prediction against the reality that data scarcity is common problem at existing and prospective bathing waters.

A comprehensive approach to analyzing environmental data with non-detects

Introduction to the Methods of Parameter Estimation for Environmental Monitoring Data Set with Truncated Data below a Detection Limit

Significance of Nondetects in the Mapping of Soil Contaminants.

Compare the marginal effects for environmental exposure and biomonitoring data with repeated measurements and values below the limit of detection

Detection and removal of emerging contaminants from water bodies: A statistical approach

Modelling environmental DNA data; Bayesian variable selection accounting for false positive and false negative errors

Bayesian Non-Parametric Detection Heterogeneity in Ecological Models

Nonparametric Analysis of Multivariate Data in Factorial Designs with Nondetects: A Case Study with Microbiome Data

An Rshiny app for modelling environmental DNA data: accounting for false positive and false negative observation error

PRECISION AND BIAS OF METHODS FOR ESTIMATING POINT SURVEY DETECTION PROBABILITIES

Evaluating the Benefits of Bayesian Hierarchical Methods for Analyzing Heterogeneous Environmental Datasets: A Case Study of Marine Organic Carbon Fluxes

Statistical Issues on Analysis of Censored Data Due to Detection Limit

Assessing Space, Time, and Remediation Contribution to Soil Pollutant Variation near the Detection Limit Using Hurdle Models to Account for a Large Proportion of Nondetectable Results

Absent or undetected? Effects of non-detection of species occurrence on wildlife–habitat models

Non-detection during excursions by citizen scientists modeled as a function of weather, season, list length, and individual preferences

A new Bayesian approach for managing bathing water quality at river bathing locations vulnerable to short-term pollution

Accommodating detection limits of multiple exposures in environmental mixture analyses: an overview of statistical approaches

Improved state-space models for inference about spatial and temporal variation in abundance from count data

Efficient Detection of Environmental Violators: A Big Data Approach

Integrated distance sampling models for simple point counts

A mechanistic modeling and estimation framework for environmental pathogen surveillance