Abstract:A nonnegative latent factorization of tensors (NLFT) model precisely represents the temporal patterns hidden in multichannel data emerging from various applications. It often adopts a single latent factor-dependent, nonnegative and multiplicative update on tensor (SLF-NMUT) algorithm. However, learning depth in this algorithm is not adjustable, resulting in frequent training fluctuation or poor model convergence caused by overshooting. To address this issue, this study carefully investigates the connections between the performance of an NLFT model and its learning depth via SLF-NMUT to present a joint learning-depth-adjusting scheme for it. Based on this scheme, a Depth-adjusted Multiplicative Update on tensor algorithm is innovatively proposed, thereby achieving a novel depth-adjusted nonnegative latent-factorization-of-tensors (DNL) model. Empirical studies on two industrial data sets demonstrate that compared with the state-of-the-art NLFT models, a DNL model achieves significant accuracy gain when performing missing data estimation on a high-dimensional and incomplete tensor with high efficiency. Note to Practitioners—Multichannel data are often encountered in various big-data-related applications. It is vital for a data analyzer to correctly capture the temporal patterns hidden in them for efficient knowledge acquisition and representation. This article focuses on analyzing temporal QoS data, which is a representative kind of multichannel data. To correctly extract their temporal patterns, an analyzer should correctly describe their nonnegativity. Such a purpose can be achieved by building a nonnegative latent factorization of tensors (NLFT) model relying on a single latent factor-dependent, nonnegative and multiplicative update on tensor (SLF-NMUT) algorithm. But its learning depth is not adjustable, making an NLFT model frequently suffer from severe fluctuations in its training error or even fail to converge. To address th-s issue, this study carefully investigates the learning rules for an NLFT model's decision parameters using an SLF-NMUT and proposes a joint learning-depth-adjusting scheme. This scheme manipulates the multiplicative terms in SLF-NMUT-based learning rules linearly and exponentially, thereby making the learning depth adjustable. Based on it, this study builds a novel depth-adjusted nonnegative latent-factorization-of-tensors (DNL) model. Compared with the existing NLFT models, a DNL model better represents multichannel data. It meets industrial needs well and can be used to achieve high performance in data analysis tasks like temporal-aware missing data estimation

Accelerated Non-negative Latent Factor Analysis on High-Dimensional and Sparse Matrices Via Generalized Momentum Method.

A Fast Non-Negative Latent Factor Model Based on Generalized Momentum Method

Convergence Analysis of Single Latent Factor-Dependent, Nonnegative, and Multiplicative Update-Based Nonnegative Latent Factor Models

Momentum-Incorporated Symmetric Non-Negative Latent Factor Models

A Generalized and Fast-converging Non-negative Latent Factor Model for Predicting User Preferences in Recommender Systems.

Non-Negativity Constrained Missing Data Estimation For High-Dimensional And Sparse Matrices

An Inherently Nonnegative Latent Factor Model for High-Dimensional and Sparse Matrices from Industrial Applications.

A Multilayered-and-Randomized Latent Factor Model for High-Dimensional and Sparse Matrices

Non-Negativity Constrained Missing Data Estimation for High-Dimensional and Sparse Matrices from Industrial Applications.

Regularizaed Extraction of Non-Negative Latent Factors from High-Dimensional Sparse Matrices.

A Nonnegative Latent Factor Model for Large-Scale Sparse Matrices in Recommender Systems via Alternating Direction Method

Randomized Latent Factor Model for High-dimensional and Sparse Matrices from Industrial Applications

A Momentum-Incorporated Non-Negative Latent Factorization of Tensors Model for Dynamic Network Representation

PI-NLF: A Proportional-Integral Approach for Non-negative Latent Factor Analysis

Non-Negative Latent Factor Model Based on β-Divergence for Recommender Systems

Adaptive Divergence-based Non-negative Latent Factor Analysis

An Alternating-Direction-Method of Multipliers-Incorporated Approach to Symmetric Non-Negative Latent Factor Analysis

A Novel Approach To Extracting Non-Negative Latent Factors From Non-Negative Big Sparse Matrices

An Adaptive Divergence-Based Non-Negative Latent Factor Model

Algorithms of Unconstrained Non-Negative Latent Factor Analysis for Recommender Systems.

Adjusting Learning Depth in Nonnegative Latent Factorization of Tensors for Accurately Modeling Temporal Patterns in Dynamic QoS Data