Abstract:Self-supervised contrastive learning has become a key technique in deep learning, particularly in time series analysis, due to its ability to learn meaningful representations without explicit supervision. Augmentation is a critical component in contrastive learning, where different augmentations can dramatically impact performance, sometimes influencing accuracy by over 30%. However, the selection of augmentations is predominantly empirical which can be suboptimal, or grid searching that is time-consuming. In this paper, we establish a principled framework for selecting augmentations based on dataset characteristics such as trend and seasonality. Specifically, we construct 12 synthetic datasets incorporating trend, seasonality, and integration weights. We then evaluate the effectiveness of 8 different augmentations across these synthetic datasets, thereby inducing generalizable associations between time series characteristics and augmentation efficiency. Additionally, we evaluated the induced associations across 6 real-world datasets encompassing domains such as activity recognition, disease diagnosis, traffic monitoring, electricity usage, mechanical fault prognosis, and finance. These real-world datasets are diverse, covering a range from 1 to 12 channels, 2 to 10 classes, sequence lengths of 14 to 1280, and data frequencies from 250 Hz to daily intervals. The experimental results show that our proposed trend-seasonality-based augmentation recommendation algorithm can accurately identify the effective augmentations for a given time series dataset, achieving an average Recall@3 of 0.667, outperforming baselines. Our work provides guidance for studies employing contrastive learning in time series analysis, with wide-ranging applications. All the code, datasets, and analysis results will be released at <a class="link-external link-https" href="https://github.com/DL4mHealth/TS-Contrastive-Augmentation-Recommendation" rel="external noopener nofollow">this https URL</a>.

Iterative Stepwise Selection and Threshold for Learning Causes in Time Series

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Towards Unsupervised Time Series Representation Learning: A Decomposition Perspective

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

Longitudinal LASSO: Jointly Learning Features and Temporal Contingency for Outcome Prediction

Variable Step Algorithm for Sub-Trend Sequence Searching

Curricular and Cyclical Loss for Time Series Learning Strategy

Multivariate Time Series Prediction Based on Temporal Change Information Learning Method

TimeSieve: Extracting Temporal Dynamics through Information Bottlenecks

Confidence-Guided Learning Process for Continuous Classification of Time Series

Guidelines for Augmentation Selection in Contrastive Learning for Time Series Classification

CausalTime: Realistically Generated Time-series for Benchmarking of Causal Discovery

Learning Temporal Causal Sequence Relationships from Real-Time Time-Series

Deep Learning in Multiple Multistep Time Series Prediction

Outlier Detection as Instance Selection Method for Feature Selection in Time Series Classification

Class-incremental Learning for Time Series: Benchmark and Evaluation

A Shapelet Learning Method for Time Series Classification

Selecting Robust Features for Machine Learning Applications using Multidata Causal Discovery

Variable Selection for Comparing High-dimensional Time-Series Data

Causality-based Feature Selection

Is Single Enough? A Joint Spatiotemporal Feature Learning Framework for Multivariate Time Series Prediction