Abstract:Data Augmentation (DA) has become a critical approach in Time Series Classification (TSC), primarily for its capacity to expand training datasets, enhance model robustness, introduce diversity, and reduce overfitting. However, the current landscape of DA in TSC is plagued with fragmented literature reviews, nebulous methodological taxonomies, inadequate evaluative measures, and a dearth of accessible and user-oriented tools. This study addresses these challenges through a comprehensive examination of DA methodologies within the TSC domain.Our research began with an extensive literature review spanning a decade, revealing significant gaps in existing surveys and necessitating a detailed analysis of over 100 scholarly articles to identify more than 60 distinct DA techniques. This rigorous review led to the development of a novel taxonomy tailored to the specific needs of DA in TSC, categorizing techniques into five primary categories: Transformation-Based, Pattern-Based, Generative, Decomposition-Based, and Automated Data Augmentation. This taxonomy is intended to guide researchers in selecting appropriate methods with greater clarity. In response to the lack of comprehensive evaluations of foundational DA techniques, we conducted a thorough empirical study, testing nearly 20 DA strategies across 15 diverse datasets representing all types within the UCR time-series repository. Using ResNet and LSTM architectures, we employed a multifaceted evaluation approach, including metrics such as Accuracy, Method Ranking, and Residual Analysis, resulting in a benchmark accuracy of 84.98 +- 16.41% in ResNet and 82.41 +- 18.71% in LSTM. Our investigation underscored the inconsistent efficacies of DA techniques, for instance, methods like RGWs and Random Permutation significantly improved model performance, whereas others, like EMD, were less effective.

Should we Reload Time Series Classification Performance Evaluation ? (a position paper)

Early Classification of Time Series: Taxonomy and Benchmark

Less is more: Selecting the right benchmarking set of data for time series classification

Automatic Feature Engineering for Time Series Classification: Evaluation and Discussion

Fast, Accurate and Interpretable Time Series Classification Through Randomization

Fast, accurate and explainable time series classification through randomization

Bake off redux: a review and experimental evaluation of recent time series classification algorithms

The great multivariate time series classification bake off: a review and experimental evaluation of recent algorithmic advances

Improving the Evaluation and Actionability of Explanation Methods for Multivariate Time Series Classification

The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances

An Experimental Evaluation of Nearest Neighbour Time Series Classification

On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration

Prediction and model evaluation for space-time data

Rethinking Attention Mechanism in Time Series Classification

Attention-Based Deep Gated Fully Convolutional End-to-End Architectures for Time Series Classification

Exploring Hierarchical Classification Performance for Time Series Data: Dissimilarity Measures and Classifier Comparisons

A fast and accurate similarity measure for long time series classification based on local extrema and dynamic time warping

A Comparative Study on Time Series Classification

Performance Evaluation in Machine Learning: The Good, the Bad, the Ugly, and the Way Forward

Data Augmentation for Time-Series Classification: An Extensive Empirical Study and Comprehensive Survey

Benchmarking Counterfactual Interpretability in Deep Learning Models for Time Series Classification