Deep Learning for Time Series Classification and Extrinsic Regression: A Current Survey

Navid Mohammadi Foumani,Lynn Miller,Chang Wei Tan,Geoffrey I. Webb,Germain Forestier,Mahsa Salehi

DOI: https://doi.org/10.1145/3649448

IF: 16.6

2024-02-27

ACM Computing Surveys

Abstract:Time Series Classification and Extrinsic Regression are important and challenging machine learning tasks. Deep learning has revolutionized natural language processing and computer vision and holds great promise in other fields such as time series analysis where the relevant features must often be abstracted from the raw data but are not known a priori. This paper surveys the current state of the art in the fast-moving field of deep learning for time series classification and extrinsic regression. We review different network architectures and training methods used for these tasks and discuss the challenges and opportunities when applying deep learning to time series data. We also summarize two critical applications of time series classification and extrinsic regression, human activity recognition and satellite earth observation.

computer science, theory & methods

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper primarily focuses on Time Series Classification (TSC) and Time Series Extrinsic Regression (TSER) tasks, and explores how deep learning techniques can be utilized to solve these problems. Specifically:

1. **Time Series Classification (TSC)**:
- The TSC task aims to predict the class labels of data composed of ordered real-valued attribute sets.
- Application scenarios include, but are not limited to, human activity recognition, diagnosis based on electronic health records, and system monitoring issues.

2. **Time Series Extrinsic Regression (TSER)**:
- The TSER task is similar to TSC, but the output is numerical rather than categorical.
- The goal of TSER is to understand the relationship between the time series and its external variables, rather than making predictions.

3. **Application of Deep Learning in Time Series Analysis**:
- Deep learning methods can autonomously learn useful feature representations from raw data without the need for manual feature engineering.
- The paper reviews the latest advancements in deep learning for time series classification and extrinsic regression, covering different network architectures and training methods.

4. **Challenges and Opportunities**:
- Despite the significant success of deep learning in computer vision and natural language processing, its application in time series analysis still faces some challenges, such as the issue of small data volumes.
- The paper also discusses emerging methods such as attention mechanisms and self-supervised learning, and proposes new classification methods to address these challenges.

Through these studies, the paper aims to provide a comprehensive review of deep learning methods for the time series analysis community and to point out future research directions.