Abstract:For the advancements of time series classification, scrutinizing previous studies, most existing methods adopt a common learning-to-classify paradigm - a time series classifier model tries to learn the relation between sequence inputs and target label encoded by one-hot distribution. Although effective, this paradigm conceals two inherent limitations: (1) encoding target categories with one-hot distribution fails to reflect the comparability and similarity between labels, and (2) it is very difficult to learn transferable model across domains, which greatly hinder the development of universal serving paradigm. In this work, we propose InstructTime, a novel attempt to reshape time series classification as a learning-to-generate paradigm. Relying on the powerful generative capacity of the pre-trained language model, the core idea is to formulate the classification of time series as a multimodal understanding task, in which both task-specific instructions and raw time series are treated as multimodal inputs while the label information is represented by texts. To accomplish this goal, three distinct designs are developed in the InstructTime. Firstly, a time series discretization module is designed to convert continuous time series into a sequence of hard tokens to solve the inconsistency issue across modal inputs. To solve the modality representation gap issue, for one thing, we introduce an alignment projected layer before feeding the transformed token of time series into language models. For another, we highlight the necessity of auto-regressive pre-training across domains, which can facilitate the transferability of the language model and boost the generalization performance. Extensive experiments are conducted over benchmark datasets, whose results uncover the superior performance of InstructTime and the potential for a universal foundation model in time series classification.

Dsco: A Language Modeling Approach For Time Series Classification

Towards Unsupervised Time Series Representation Learning: A Decomposition Perspective

Disentangling Domain and General Representations for Time Series Classification

A Language Model-Guided Framework for Mining Time Series with Distributional Shifts

Large Language Models for Time Series: A Survey

Advancing Time Series Classification with Multimodal Language Modeling

Time Series Classification Based on Dictionary Learning and Sparse Representation

Deep learning for time series classification: a review

Dense Bag-of-Temporal-SIFT-Words for Time Series Classification

Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmark

Empowering Time Series Analysis with Large Language Models: A Survey

Deep Time Series Models for Scarce Data

UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting

PyDTS: A Python Toolkit for Deep Learning Time Series Modelling

Deep Time Series Models: A Comprehensive Survey and Benchmark

DualTime: A Dual-Adapter Multimodal Language Model for Time Series Representation

Domain-Independent Automatic Generation of Descriptive Texts for Time-Series Data

Effectively Modeling Time Series with Simple Discrete State Spaces

Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification

TimeDRL: Disentangled Representation Learning for Multivariate Time-Series