Abstract:Time series analysis remains a major challenge due to its sparse characteristics, high dimensionality, and inconsistent data quality. Recent advancements in transformer-based techniques have enhanced capabilities in forecasting and imputation; however, these methods are still resource-heavy, lack adaptability, and face difficulties in integrating both local and global attributes of time series. To tackle these challenges, we propose a new architectural concept for time series analysis based on introspection. Central to this concept is the self-supervised pretraining of Time Series Representation Models (TSRMs), which once learned can be easily tailored and fine-tuned for specific tasks, such as forecasting and imputation, in an automated and resource-efficient manner. Our architecture is equipped with a flexible and hierarchical representation learning process, which is robust against missing data and outliers. It can capture and learn both local and global features of the structure, semantics, and crucial patterns of a given time series category, such as heart rate data. Our learned time series representation models can be efficiently adapted to a specific task, such as forecasting or imputation, without manual intervention. Furthermore, our architecture's design supports explainability by highlighting the significance of each input value for the task at hand. Our empirical study using four benchmark datasets shows that, compared to investigated state-of-the-art baseline methods, our architecture improves imputation and forecasting errors by up to 90.34% and 71.54%, respectively, while reducing the required trainable parameters by up to 92.43%. The source code is available at <a class="link-external link-https" href="https://github.com/RobertLeppich/TSRM" rel="external noopener nofollow">this https URL</a>.

A Fuzzy-Probabilistic Representation Learning Method for Time Series Classification

Fuzzy Time Series Analysis Method Based on Least Squares Support Vector Machines

Multilevel Dynamic Time Warping: A Parameter-Light Method for Fast Time Series Classification

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

Fast, Accurate and Interpretable Time Series Classification Through Randomization

A Tutorial on Fuzzy Time Series Forecasting Models: Recent Advances and Challenges

Fast, accurate and explainable time series classification through randomization

Fast Classification of Large Time Series Datasets

A novel high-order weighted fuzzy time series model and its application in nonlinear time series prediction

Interval type-2 fuzzy set based time series forecasting using a data-driven partitioning approach

A Deep Multi-Task Representation Learning Method for Time Series Classification and Retrieval.

Particle swarm optimization and intuitionistic fuzzy set-based novel method for fuzzy time series forecasting

Time Series Representation Models

The Canonical Interval Forest (CIF) Classifier for Time Series Classification

Is Single Enough? A Joint Spatiotemporal Feature Learning Framework for Multivariate Time Series Prediction

TS2Vec: Towards Universal Representation of Time Series

TSec: an Efficient and Effective Framework for Time Series Classification

Bag of Recurrence Patterns Representation for Time-Series Classification

A Time Series Forest for Classification and Feature Extraction

A new multi-process collaborative architecture for time series classification

Bayesian network based probabilistic weighted high-order fuzzy time series forecasting