Abstract:A nonnegative latent factorization of tensors (NLFT) model precisely represents the temporal patterns hidden in multichannel data emerging from various applications. It often adopts a single latent factor-dependent, nonnegative and multiplicative update on tensor (SLF-NMUT) algorithm. However, learning depth in this algorithm is not adjustable, resulting in frequent training fluctuation or poor model convergence caused by overshooting. To address this issue, this study carefully investigates the connections between the performance of an NLFT model and its learning depth via SLF-NMUT to present a joint learning-depth-adjusting scheme for it. Based on this scheme, a Depth-adjusted Multiplicative Update on tensor algorithm is innovatively proposed, thereby achieving a novel depth-adjusted nonnegative latent-factorization-of-tensors (DNL) model. Empirical studies on two industrial data sets demonstrate that compared with the state-of-the-art NLFT models, a DNL model achieves significant accuracy gain when performing missing data estimation on a high-dimensional and incomplete tensor with high efficiency. Note to Practitioners—Multichannel data are often encountered in various big-data-related applications. It is vital for a data analyzer to correctly capture the temporal patterns hidden in them for efficient knowledge acquisition and representation. This article focuses on analyzing temporal QoS data, which is a representative kind of multichannel data. To correctly extract their temporal patterns, an analyzer should correctly describe their nonnegativity. Such a purpose can be achieved by building a nonnegative latent factorization of tensors (NLFT) model relying on a single latent factor-dependent, nonnegative and multiplicative update on tensor (SLF-NMUT) algorithm. But its learning depth is not adjustable, making an NLFT model frequently suffer from severe fluctuations in its training error or even fail to converge. To address th-s issue, this study carefully investigates the learning rules for an NLFT model's decision parameters using an SLF-NMUT and proposes a joint learning-depth-adjusting scheme. This scheme manipulates the multiplicative terms in SLF-NMUT-based learning rules linearly and exponentially, thereby making the learning depth adjustable. Based on it, this study builds a novel depth-adjusted nonnegative latent-factorization-of-tensors (DNL) model. Compared with the existing NLFT models, a DNL model better represents multichannel data. It meets industrial needs well and can be used to achieve high performance in data analysis tasks like temporal-aware missing data estimation

Sparseness-constrained Nonnegative Tensor Factorization for Detecting Topics at Different Time Scales

Community Specific Temporal Topic Discovery from Social Media

Sparse online topic models

Mitigating Data Sparsity for Short Text Topic Modeling by Topic-Semantic Contrastive Learning

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Parsimonious Topic Models with Salient Word Discovery

Modeling Infinite Topics on Social Behavior Data with Spatio-temporal Dependence.

Topic Diffusion Discovery based on Sparseness-constrained Non-negative Matrix Factorization

Contextual Tensor Decomposition by Projected Alternating Least Squares

Online nonnegative CP-dictionary learning for Markovian data

SliceNStitch: Continuous CP Decomposition of Sparse Tensor Streams

Discovering Topic Time from Web News

Temporal Analysis on Topics Using Word2Vec

Multifactor Sparse Feature Extraction Using Convolutive Nonnegative Tucker Decomposition

A unified model for stable and temporal topic detection from social media data

$S^3$ -- Semantic Signal Separation

Group Sparse Topical Coding

Term-community-based topic detection with variable resolution

Two to Five Truths in Non-Negative Matrix Factorization

News Topic Discovery Through Community Detection

Adjusting Learning Depth in Nonnegative Latent Factorization of Tensors for Accurately Modeling Temporal Patterns in Dynamic QoS Data