Abstract:Time series classification problems exist in many fields and have been explored for a couple of decades. However, they still remain challenging, and their solutions need to be further improved for real-world applications in terms of both accuracy and efficiency. In this paper, we propose a hybrid neural architecture, called Self-Attentive Recurrent Convolutional Networks (SARCoN), to learn multi-faceted representations for univariate time series. SARCoN is the synthesis of long short-term memory networks with self-attentive mechanisms and Fully Convolutional Networks, which work in parallel to learn the representations of univariate time series from different perspectives. The component modules of the proposed architecture are trained jointly in an end-to-end manner and they classify the input time series in a cooperative way. Due to its domain-agnostic nature, SARCoN is able to generalize a diversity of domain tasks. Our experimental results show that, compared to the state-of-the-art approaches for time series classification, the proposed architecture can achieve remarkable improvements for a set of univariate time series benchmarks from the UCR repository. Moreover, the self-attention and the global average pooling in the proposed architecture enable visible interpretability by facilitating the identification of the contribution regions of the original time series. An overall analysis confirms that multi-faceted representations of time series aid in capturing deep temporal corrections within complex time series, which is essential for the improvement of time series classification performance. Our work provides a novel angle that deepens the understanding of time series classification, qualifying our proposed model as an ideal choice for real-world applications.

Integration of Residual Network and Convolutional Neural Network along with Various Activation Functions and Global Pooling for Time Series Classification.

Causal augmented ConvNet: A temporal memory dilated convolution model for long-sequence time series prediction

Combining contextual neural networks for time series classification

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

Time series classification based on convolutional network with a Gated Linear Units kernel

ConvTimeNet: A Deep Hierarchical Fully Convolutional Model for Multivariate Time Series Analysis

Deep Gated Recurrent and Convolutional Network Hybrid Model for Univariate Time Series Classification

Adaptive Convolutional Forecasting Network Based on Time Series Feature-Driven

Multi-Scale Convolutional Neural Networks for Time Series Classification

Gated Res2Net for Multivariate Time Series Analysis

Multi-Faceted Representation Learning with Hybrid Architecture for Time Series Classification

Time Series Classification from Scratch with Deep Neural Networks: A Strong Baseline

Exploiting Multi-Channels Deep Convolutional Neural Networks for Multivariate Time Series Classification

A Multivariate Time Series Prediction Method Based on Convolution-Residual Gated Recurrent Neural Network and Double-Layer Attention

Probabilistic Forecasting with Temporal Convolutional Neural Network

Self-Attention Causal Dilated Convolutional Neural Network for Multivariate Time Series Classification and Its Application

Hybrid Neural Network Architecture for On-Line Learning

Residual Feature-Reutilization Inception Network

Tightly-coupled Convolutional Neural Network with Spatial-Temporal Memory for Text Classification.

A new multi-process collaborative architecture for time series classification

AdaFSNet: Time Series Classification Based on Convolutional Network with a Adaptive and Effective Kernel Size Configuration