A Canonical Polyadic Deep Convolutional Computation Model for Big Data Feature Learning in Internet of Things

Peng Li,Zhikui Chen,Laurence Tianruo Yang,Qingchen Zhang,M. Jamal Deen
DOI: https://doi.org/10.1016/j.future.2019.04.048
IF: 7.307
2019-01-01
Future Generation Computer Systems
Abstract:Currently, a large number of industrial data, usually referred to big data, are collected from Internet of Things (IoT). Big data are typically heterogeneous, i.e., each object in big datasets is multimodal, posing a challenging issue on the convolutional neural network (CNN) that is one of the most representative deep learning models. In this paper, a deep convolutional computation model (DCCM) is proposed to learn hierarchical features of big data by using the tensor representation model to extend the CNN from the vector space to the tensor space. To make full use of the local features and topologies contained in the big data, a tensor convolution operation is defined to prevent over-fitting and improve the training efficiency. Furthermore, a high-order backpropagation algorithm is proposed to train the parameters of the deep convolutional computational model in the high-order space. Finally, experiments on three datasets, i.e., CUAVE, SNAE2, and STL-10 are carried out to verify the performance of the DCCM. Experimental results show that the deep convolutional computation model can give higher classification accuracy than the deep computation model or the multimodal model for big data in IoT.
What problem does this paper attempt to address?