Abstract:We introduce a unified framework, formulated as general latent space models, to study complex higher-order network interactions among multiple entities. Our framework covers several popular models in recent network analysis literature, including mixture multi-layer latent space model and hypergraph latent space model. We formulate the relationship between the latent positions and the observed data via a generalized multilinear kernel as the link function. While our model enjoys decent generality, its maximum likelihood parameter estimation is also convenient via a generalized tensor decomposition <a class="link-external link-http" href="http://procedure.We" rel="external noopener nofollow">this http URL</a> propose a novel algorithm using projected gradient descent on Grassmannians. We also develop original theoretical guarantees for our algorithm. First, we show its linear convergence under mild conditions. Second, we establish finite-sample statistical error rates of latent position estimation, determined by the signal strength, degrees of freedom and the smoothness of link function, for both general and specific latent space models. We demonstrate the effectiveness of our method on synthetic data. We also showcase the merit of our method on two real-world datasets that are conventionally described by different specific models in producing meaningful and interpretable parameter estimations and accurate link prediction. We demonstrate the effectiveness of our method on synthetic data. We also showcase the merit of our method on two real-world datasets that are conventionally described by different specific models in producing meaningful and interpretable parameter estimations and accurate link prediction.

Latent Structured Perceptrons for Large-Scale Learning with Hidden Information

Latent variable perceptron algorithm for structured classification

Enhancing Interpretability Through Loss-Defined Classification Objective in Structured Latent Spaces

Large-Scale Hierarchical Classification via Stochastic Perceptron.

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Latent Factor Learning under Multiple Rating Patterns for Undirected, Large-Scaled and Sparse Networks

Efficient Latent Structural Perceptron with Hybrid Trees for Semantic Parsing

Discriminative unsupervised learning of structured predictors

A Multilayered-and-Randomized Latent Factor Model for High-Dimensional and Sparse Matrices

Describing and Learning of Related Parts Based on Latent Structural Model in Big Data

Discrete Latent Structure in Neural Networks

Methods and Theories for Large-scale Structured Prediction

Nonsparse learning with latent variables

Guaranteed Scalable Learning of Latent Tree Models

Learning Structures for Deep Neural Networks

Latent Cognizance: What Machine Really Learns

Group Norm for Learning Structured SVMs with Unstructured Latent Variables

Generalized Block-Diagonal Structure Pursuit: Learning Soft Latent Task Assignment Against Negative Transfer.

Sparse Perceptron Decision Tree For Millions Of Dimensions

Probabilistic Structural Latent Representation For Unsupervised Embedding

Latent Space Model for Higher-order Networks and Generalized Tensor Decomposition