A Neural Tensor Decomposition Model for High-Order Sparse Data Recovery

Tianchi Liao,Jinghua Yang,Chuan Chen,Zibin Zheng
DOI: https://doi.org/10.1016/j.ins.2023.120024
IF: 8.1
2024-01-01
Information Sciences
Abstract:Tensor decomposition has attracted wide attention in the low-rank tensor completion (LRTC) problem because of its marvelous recovering ability to missing entries. However, previous LRTC methods are generally based on linear and shallow models, which are prone to overfitting when the data is sparse, resulting in significantly degraded performance. Meanwhile, the models are highly sensitive and suffer from the difficult rank selection problem. To address these issues, we propose an effective and novel tensor-ring (TR) decomposition method based on the convolutional computation (ConvTR), which can be regarded as a natural extension of deep learning models for the LRTC problem. Specifically, ConvTR employs a multi-layer convolutional neural network (CNN) to model the complex interactions between TR factors. Each element in the index vector of the observation tensor can be embedded as a corresponding tensor slice in the factor tensor decomposed by the TR model. These individual slice matrices are then concatenated to get a wider matrix used for extracting the nonlinear features by feeding them into a 2D convolutional layer. A fully-connected layer is utilized to aggregate the final convoluted features to a scalar value, which is the desired missing entry indexed by the original index vector exactly. Extensive experiments on various common datasets verified the effectiveness of the proposed method and demonstrated its superior to the traditional TR-based completion methods and other state-of-the-art network-based methods.
What problem does this paper attempt to address?