Abstract:Time series classification and forecasting have long been studied with the traditional statistical methods. Recently, deep learning achieved remarkable successes in areas such as image, text, video, audio processing, etc. However, research studies conducted with deep neural networks in these fields are not abundant. Therefore, in this paper, we aim to propose and evaluate several state-of-the-art neural network models in these fields. We first review the basics of representative models, namely long short-term memory and its variants, the temporal convolutional network and the generative adversarial network. Then, long short-term memory with autoencoder and attention-based models, the temporal convolutional network and the generative adversarial model are proposed and applied to time series classification and forecasting. Gaussian sliding window weights are proposed to speed the training process up. Finally, the performances of the proposed methods are assessed using five optimizers and loss functions with the public benchmark datasets, and comparisons between the proposed temporal convolutional network and several classical models are conducted. Experiments show the proposed models’ effectiveness and confirm that the temporal convolutional network is superior to long short-term memory models in sequence modeling. We conclude that the proposed temporal convolutional network reduces time consumption to around 80% compared to others while retaining the same accuracy. The unstable training process for generative adversarial network is circumvented by tuning hyperparameters and carefully choosing the appropriate optimizer of “Adam”. The proposed generative adversarial network also achieves comparable forecasting accuracy with traditional methods.

Classifying motion time series using neural networks

How Deep Neural Networks Understand Motion? Toward Interpretable Motion Modeling by Leveraging the Relative Change in Position

Trajectory Forecasting with Neural Networks: an Empirical Evaluation and A New Hybrid Model

Classify Multivariate Time Series by Deep Neural Network Image Classification

Deep Neural Networks for Time Series Classification in Human Activity Recognition

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

Motion Sequence Recognition with Multi-sensors Using Deep Convolutional Neural Network.

Neural Networks for Pathological Gait Classification Using Wearable Motion Sensors

Sensor Classification Using Convolutional Neural Network by Encoding Multivariate Time Series as Two-Dimensional Colored Images

Multivariate Time Series Classification: A Deep Learning Approach

Exploiting Multi-Channels Deep Convolutional Neural Networks for Multivariate Time Series Classification

TimeNet: Pre-trained deep recurrent neural network for time series classification

Time Series Classification from Scratch with Deep Neural Networks: A Strong Baseline

A Deep Learning Framework for Time Series Classification Using Relative Position Matrix and Convolutional Neural Network.

Deep Temporal Convolution Network for Time Series Classification

Deep learning for classification of time series spectral images using combined multi-temporal and spectral features

Time Series Forecasting and Classification Models Based on Recurrent with Attention Mechanism and Generative Adversarial Networks

Multimodal Sensor Motion Intention Recognition Based on Three-Dimensional Convolutional Neural Network Algorithm

Multi-Scale Convolutional Neural Networks for Time Series Classification

Combining contextual neural networks for time series classification

Real-Time Activity Recognition on Smartphones Using Deep Neural Networks.