Abstract:We introduce a unified framework, formulated as general latent space models, to study complex higher-order network interactions among multiple entities. Our framework covers several popular models in recent network analysis literature, including mixture multi-layer latent space model and hypergraph latent space model. We formulate the relationship between the latent positions and the observed data via a generalized multilinear kernel as the link function. While our model enjoys decent generality, its maximum likelihood parameter estimation is also convenient via a generalized tensor decomposition <a class="link-external link-http" href="http://procedure.We" rel="external noopener nofollow">this http URL</a> propose a novel algorithm using projected gradient descent on Grassmannians. We also develop original theoretical guarantees for our algorithm. First, we show its linear convergence under mild conditions. Second, we establish finite-sample statistical error rates of latent position estimation, determined by the signal strength, degrees of freedom and the smoothness of link function, for both general and specific latent space models. We demonstrate the effectiveness of our method on synthetic data. We also showcase the merit of our method on two real-world datasets that are conventionally described by different specific models in producing meaningful and interpretable parameter estimations and accurate link prediction. We demonstrate the effectiveness of our method on synthetic data. We also showcase the merit of our method on two real-world datasets that are conventionally described by different specific models in producing meaningful and interpretable parameter estimations and accurate link prediction.

A higher-order LQ decomposition for separable covariance models

On Separability of Covariance in Multiway Data Analysis

Separable correlation and maximum likelihood

Decorrelated Empirical Likelihood for Generalized Linear Models with High-Dimensional Longitudinal Data

Large-Dimensional Positive Definite Covariance Estimation for High Frequency Data via Low-rank and Sparse Matrix Decomposition

Covariance Estimation in High Dimensions Via Kronecker Product Expansions

Separable Expansions for Covariance Estimation

High-dimensional Covariance Estimation by Pairwise Likelihood Truncation

Large covariance matrix estimation via penalized log-det heuristics

Adaptive Parallelizable Algorithms for Interpolative Decompositions via Partially Pivoted LU

High-Order Multilinear Discriminant Analysis via Order-$\textit{n}$ Tensor Eigendecomposition

Spectral Decomposition of Real Symmetric Quadratic Λ-Matrices and Its Applications.

Latent Space Model for Higher-order Networks and Generalized Tensor Decomposition

On the probability of linear separability through intrinsic volumes

Diagonal Gaussian Mixture Models and Higher Order Tensor Decompositions

Two‐Stage Estimation for Ultrahigh Dimensional Sparse Quadratic Discriminant Analysis

SQ Lower Bounds for Learning Bounded Covariance GMMs

Multilinear Subspace Regression: an Orthogonal Tensor Decomposition Approach.

Information Geometry and Asymptotics for Kronecker Covariances

Partial separability and functional graphical models for multivariate Gaussian processes

Fast and Positive Definite Estimation of Large Covariance Matrix for High-Dimensional Data Analysis