Abstract:Time series classification and forecasting have long been studied with the traditional statistical methods. Recently, deep learning achieved remarkable successes in areas such as image, text, video, audio processing, etc. However, research studies conducted with deep neural networks in these fields are not abundant. Therefore, in this paper, we aim to propose and evaluate several state-of-the-art neural network models in these fields. We first review the basics of representative models, namely long short-term memory and its variants, the temporal convolutional network and the generative adversarial network. Then, long short-term memory with autoencoder and attention-based models, the temporal convolutional network and the generative adversarial model are proposed and applied to time series classification and forecasting. Gaussian sliding window weights are proposed to speed the training process up. Finally, the performances of the proposed methods are assessed using five optimizers and loss functions with the public benchmark datasets, and comparisons between the proposed temporal convolutional network and several classical models are conducted. Experiments show the proposed models’ effectiveness and confirm that the temporal convolutional network is superior to long short-term memory models in sequence modeling. We conclude that the proposed temporal convolutional network reduces time consumption to around 80% compared to others while retaining the same accuracy. The unstable training process for generative adversarial network is circumvented by tuning hyperparameters and carefully choosing the appropriate optimizer of “Adam”. The proposed generative adversarial network also achieves comparable forecasting accuracy with traditional methods.

TCN-GAWO: Genetic Algorithm Enhanced Weight Optimization for Temporal Convolutional Network

Optimizing Weights by Genetic Algorithm for Neural Network Ensemble

The Temperature Prediction of Hydro-generating Units based on Temporal Convolutional Network and Recurrent Neural Network

Effective Neural Network Training with a New Weighting Mechanism-Based Optimization Algorithm.

GACNN: Training Deep Convolutional Neural Networks with Genetic Algorithm

Evolving CNN-LSTM Models for Time Series Prediction Using Enhanced Grey Wolf Optimizer

Biased Temporal Convolution Graph Network for Time Series Forecasting with Missing Values.

Temporal Graph Convolutional Network Soft Sensor for Molecular Weight Distribution Prediction

GCN-GAN: A Non-linear Temporal Link Prediction Model for Weighted Dynamic Networks.

Architecture search of accurate and lightweight CNNs using genetic algorithm

Time Series Forecasting and Classification Models Based on Recurrent with Attention Mechanism and Generative Adversarial Networks

Topological optimization of the DenseNet with pretrained-weights inheritance and genetic channel selection

Genetically Modified Wolf Optimization with Stochastic Gradient Descent for Optimising Deep Neural Networks

GTCN: Gated Temporal Convolutional Networks for Controlled-Source Electromagnetic Data Denoising

Evolutionary Neural Architecture Search for Multivariate Time Series Forecasting.

Tigc-Net: Transformer-Improved Graph Convolution Network for Spatio-Temporal Prediction

Prediction of Gas Concentration Evolution with Evolutionary Attention-Based Temporal Graph Convolutional Network

Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting

Trainable Weight Averaging for Fast Convergence and Better Generalization

Auto-STGCN: Autonomous Spatial-Temporal Graph Convolutional Network Search

Temporal Convolutional Networks for Anomaly Detection in Time Series