Abstract:Despite the success of deep neural networks (DNNs) for real-world applications over time-series data such as mobile health, little is known about how to train robust DNNs for time-series domain due to its unique characteristics compared to images and text data. In this paper, we propose a novel algorithmic framework referred as RObust Training for Time-Series (RO-TS) to create robust DNNs for time-series classification tasks. Specifically, we formulate a min-max optimization problem over the model parameters by explicitly reasoning about the robustness criteria in terms of additive perturbations to time-series inputs measured by the global alignment kernel (GAK) based distance. We also show the generality and advantages of our formulation using the summation structure over time-series alignments by relating both GAK and dynamic time warping (DTW). This problem is an instance of a family of compositional min-max optimization problems, which are challenging and open with unclear theoretical guarantee. We propose a principled stochastic compositional alternating gradient descent ascent (SCAGDA) algorithm for this family of optimization problems. Unlike traditional methods for time-series that require approximate computation of distance measures, SCAGDA approximates the GAK based distance on-the-fly using a moving average approach. We theoretically analyze the convergence rate of SCAGDA and provide strong theoretical support for the estimation of GAK based distance. Our experiments on real-world benchmarks demonstrate that RO-TS creates more robust DNNs when compared to adversarial training using prior methods that rely on data augmentation or new definitions of loss functions. We also demonstrate the importance of GAK for time-series data over the Euclidean distance. The source code of RO-TS algorithms is available at <a class="link-external link-https" href="https://github.com/tahabelkhouja/Robust-Training-for-Time-Series" rel="external noopener nofollow">this https URL</a>

Robust Scale-Invariant Normalization and Similarity Measurement for Time Series Data

A Novel Similarity Measure Model for Multivariate Time Series Based on LMNN and DTW

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

A Large Comparison of Normalization Methods on Time Series

A Novel Similarity Measure Approach for Time Series Based on PLA and DTW

A fast and accurate similarity measure for long time series classification based on local extrema and dynamic time warping

Order-Preserving Metric Learning for Mining Multivariate Time Series

Time Series Data Mining Algorithms Towards Scalable and Real-Time Behavior Monitoring

Time Scale Network: A Shallow Neural Network For Time Series Data

Learning the feature distribution similarities for online time series anomaly detection

Fidelitous Augmentation of Human Accelerometric Data for Deep Learning

Detecting Anomalies within Time Series using Local Neural Transformations

Elastic distances for time-series classification: Itakura versus Sakoe-Chiba constraints

Multiscale Dubuc: A New Similarity Measure for Time Series

LB-SimTSC: An Efficient Similarity-Aware Graph Neural Network for Semi-Supervised Time Series Classification

A novel similarity measure framework on financial data mining

Adaptive Normalization for Non-stationary Time Series Forecasting: A Temporal Slice Perspective

Training Robust Deep Models for Time-Series Domain: Novel Algorithms and Theoretical Analysis

A method for measuring similarity of time series based on series decomposition and dynamic time warping

Segment-Based Features for Time Series Classification

Time Series Prediction via Similarity Search: Exploring Invariances, Distance Measures and Ensemble Functions