Abstract:Objective Syndromic data are created by processes that operate on different time scales (daily, weekly, or even yearly) and can include events of different durations from a 1-2 day outbreak of foodborne illness to a more gradual, protracted flu season. The duration of an outbreak caused by a new pathogenic strain or a bioterrorist attack is indeterminate. Wavelets are well suited for detecting signals of uncertain duration because they decompose data at multiple time and frequency scales. This study evaluates the use of several wavelet-based algorithms for both time series forecasting and anomaly detection using real-world syndromic data from multiple data sources and geographic locations. Background While several authors have advocated wavelets for biosurveillance, there are few published wavelet method evaluations using real syndromic data. Goldenberg et al performed an analysis using wavelet predictions as a way of detecting a simulated anthrax outbreak [1]. The commercial RODS application uses averaged wavelet levels to normalize for longterm trends and negative singularities [2]. In line with the implementation in [1] and in contrast to [2], we introduce two preconditioning steps to account for the strong day-of-week effect and holidays, and then use all levels of the wavelets to predict or alarm. Methods The wavelet algorithms used here expand upon [1] in two key aspects. First, we replace the initial cosinetransform smoothing with a preconditioning scheme that directly treats the day-of-week effect and holidays. Second, the wavelet decomposition uses a Haar basis with “backward shifted” coefficients to minimize edge problems and to enable prospective operation rather than retrospective analysis. In the first part of this study, numerous configurations for this family of wavelet algorithms were studied to yield the optimal performance. Variations on the length of the training window (including “infinite”, using all previous data), the order of the AR model used for predicting each level’s coefficients (or using a simple EWMA), and the forms of preprocessing (day-of-week, holiday, or neither) were examined to determine which yielded the best performance, when predicting next day and 7-day ahead forecasts. Performance was evaluated by examining the median absolute percent deviation of the forecast errors. In the second part of this study, the algorithm family was used to detect simulated single-day spike and lognormal outbreaks in a wide range of authentic syndromic data from a geographically diverse set of metropolitan areas. Detection performance was evaluated using Receiver Operating Characteristic (ROC) curves. Results A wavelet algorithm implemented with a 128-day sliding window, with a 7-day AR, combined with day-of-week and holiday preconditioning, proved most effective for both data prediction and outbreak detection. Overall, the detection probability is high for spike outbreaks, but the performance varies by event day of week, indicating residual serial correlation in the preconditioned data.

Simulating Multivariate Syndromic Time Series and Outbreak Signatures

Statistical Challenges Facing Early Outbreak Detection in Biosurveillance.

Correlation-Based Discovery of Disease Patterns for Syndromic Surveillance

An integer-valued time series model for multivariate surveillance

Revisiting Non-Specific Syndromic Surveillance

Evaluating the Performance of Syndromic Surveillance System using High-fidelity Outbreak Simulations

Evaluation of Outbreak Detection Performance Using Multi-Stream Syndromic Surveillance for Influenza-Like Illness in Rural Hubei Province, China: A Temporal Simulation Model Based on Healthcare-Seeking Behaviors

A concept for routine emergency-care data-based syndromic surveillance in Europe

Establishing a Web-Based Integrated Surveillance System for Early Detection of Infectious Disease Epidemic in Rural China: a Field Experimental Study

Surveillance of Disease Outbreaks Using Unsupervised Uni-Multivariate Anomaly Detection of Time-Series Symptoms

Content and sentiment surveillance (CSI): A critical component for modeling modern epidemics

Combining Digital and Molecular Approaches Using Health and Alternate Data Sources in a Next-Generation Surveillance System for Anticipating Outbreaks of Pandemic Potential

An Evaluation of Wavelet-Based Techniques for Prediction and Anomaly Detection in Univariate Syndromic Data

Algorithm Combination For Improved Performance In Biosurveillance Systems

Monitoring and prediction of an epidemic outbreak using syndromic observations

First Prototype of the Infectious Diseases Seeker (IDS) Software for Prompt Identification of Infectious Diseases

Challenges in the case-based surveillance of infectious diseases

Observing the Spread of Common Illnesses Through a Community: Using Geographic Information Systems (GIS) for Surveillance

Prospective Detection of Outbreaks

Spatio-Temporal Analysis of Epidemic Phenomena Using the R Package surveillance

A Spatio-Temporal Modeling Framework for Surveillance Data of Multiple Infectious Pathogens with Small Laboratory Validation Sets