Abstract:The multivariate time series classification (MTSC) task aims to predict a class label for a given time series. Recently, modern deep learning-based approaches have achieved promising performance over traditional methods for MTSC tasks. The success of these approaches relies on access to the massive amount of labeled data (i.e., annotating or assigning tags to each sample that shows its corresponding category). However, obtaining a massive amount of labeled data is usually very time-consuming and expensive in many real-world applications such as medicine, because it requires domain experts' knowledge to annotate data. Insufficient labeled data prevents these models from learning discriminative features, resulting in poor margins that reduce generalization performance. To address this challenge, we propose a novel approach: supervised contrastive learning for time series classification (SupCon-TSC). This approach improves the classification performance by learning the discriminative low-dimensional representations of multivariate time series, and its end-to-end structure allows for interpretable outcomes. It is based on supervised contrastive (SupCon) loss to learn the inherent structure of multivariate time series. First, two separate augmentation families, including strong and weak augmentation methods, are utilized to generate augmented data for the source and target networks, respectively. Second, we propose the instance-level, and cluster-level SupCon learning approaches to capture contextual information to learn the discriminative and universal representation for multivariate time series datasets. In the instance-level SupCon learning approach, for each given anchor instance that comes from the source network, the low-variance output encodings from the target network are sampled as positive and negative instances based on their labels. However, the cluster-level approach is performed between each instance and cluster centers among batches, as opposed to the instance-level approach. The cluster-level SupCon loss attempts to maximize the similarities between each instance and cluster centers among batches. We tested this novel approach on two small cardiopulmonary exercise testing (CPET) datasets and the real-world UEA Multivariate time series archive. The results of the SupCon-TSC model on CPET datasets indicate its capability to learn more discriminative features than existing approaches in situations where the size of the dataset is small. Moreover, the results on the UEA archive show that training a classifier on top of the universal representation features learned by our proposed method outperforms the state-of-the-art approaches.

Con4m: Context-aware Consistency Learning Framework for Segmented Time Series Classification

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Multi-view Self-Supervised Contrastive Learning for Multivariate Time Series

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

Interpretable and Generalizable Spatiotemporal Predictive Learning with Disentangled Consistency

A new multi-process collaborative architecture for time series classification

Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentation

Learning Local and Global Temporal Contexts for Video Semantic Segmentation

PFC: A Novel Perceptual Features-Based Framework for Time Series Classification.

STC: Spatio-Temporal Contrastive Learning for Video Instance Segmentation.

Confidence-Guided Learning Process for Continuous Classification of Time Series

Combining contextual neural networks for time series classification

Learning Context-aware Classifier for Semantic Segmentation

TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification

Universal representation learning for multivariate time series using the instance-level and cluster-level supervised contrastive learning

Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification

Finding Discriminative Subsequences Via a Coverage Measure and Mutual Information Selection Strategy for Multi-Class Time Series Classification

DC2T: Disentanglement-Guided Consolidation and Consistency Training for Semi-Supervised Cross-Site Continual Segmentation

Self-supervised Contrastive Representation Learning for Semi-supervised Time-Series Classification

Time-Series Representation Learning via Temporal and Contextual Contrasting

TMCFN: Text-Supervised Multidimensional Contrastive Fusion Network for Hyperspectral and LiDAR Classification