CNN-FCM: System modeling promotes stability of deep learning in time series prediction

Penghui Liu,Jing Liu,Kai Wu
DOI: https://doi.org/10.1016/j.knosys.2020.106081
2020-09-01
Abstract:<p>Time series data are usually non-stationary and evolve over time. Even if deep learning has been found effective in dealing with sequential data, the stability of deep neural networks in coping with the situations unseen during the training stage is also important. This paper deals with this problem based on a fuzzy cognitive block (FCB) which embeds the learning of high-order fuzzy cognitive maps into the deep learning architecture. Thereafter, computers can automatically model the complex system and produce the observation rather than simply regress the available data. Respectively, we design a deep neural network termed CNN-FCM which has combined the available convolution network with FCB. To validate the advantages of our design and verify the effectiveness of FCB, twelve benchmark datasets are employed and classic deep learning architectures are introduced as the comparison. The experimental results show that the performance of many current popular deep learning architectures declines when handling data deviated from the training set. FCB plays an important role in promoting the performance of CNN-FCM in the corresponding experiments. Thereafter, we conclude that system modeling can promote the stability of deep learning in time series prediction.</p>
computer science, artificial intelligence
What problem does this paper attempt to address?