Abstract:We consider the estimation and inference of graphical models that characterize the dependency structure of high-dimensional tensor-valued data. To facilitate the estimation of the precision matrix corresponding to each way of the tensor, we assume the data follow a tensor normal distribution whose covariance has a Kronecker product structure. A critical challenge in the estimation and inference of this model is the fact that its penalized maximum likelihood estimation involves minimizing a non-convex objective function. To address it, this paper makes two contributions: (i) In spite of the non-convexity of this estimation problem, we prove that an alternating minimization algorithm, which iteratively estimates each sparse precision matrix while fixing the others, attains an estimator with an optimal statistical rate of convergence. (ii) We propose a de-biased statistical inference procedure for testing hypotheses on the true support of the sparse precision matrices, and employ it for testing a growing number of hypothesis with false discovery rate (FDR) control. The asymptotic normality of our test statistic and the consistency of FDR control procedure are established. Our theoretical results are backed up by thorough numerical studies and our real applications on neuroimaging studies of Autism spectrum disorder and users' advertising click analysis bring new scientific findings and business insights. The proposed methods are encoded into a publicly available R package Tlasso.

A Tensor Optimization Algorithm for Computing Lagrangians of Hypergraphs

Graph-structured tensor optimization for nonlinear density control and mean field games

Scalable tensor methods for nonuniform hypergraphs

Escaping from Saddle Points --- Online Stochastic Gradient for Tensor Decomposition

O(log T) Projections for Stochastic Optimization of Smooth and Strongly Convex Functions

Low-rank optimization on Tucker tensor varieties

An augmented Lagrangian trust-region method with inexact gradient evaluations to accelerate constrained optimization problems using model hyperreduction

A first-order optimization algorithm for statistical learning with hierarchical sparsity structure

Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization

Riemannian optimization of isometric tensor networks

Optimization over convex polyhedra via Hadamard parametrizations

Neural Optimal Transport with Lagrangian Costs

Hypergraph Analysis Based on a Compatible Tensor Product Structure

An Augmented Lagrangian Method for Non-Lipschitz Nonconvex Programming

Combinatorial Optimization Neural Nets Based On A Hybrid Of Lagrange And Transformation Approaches

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors

Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, and More

A derivative-free memoryless BFGS hyperplane projection method for solving large-scale nonlinear monotone equations

Tensor Graphical Model: Non-Convex Optimization and Statistical Inference

Global Optimization Algorithm Based on Lagrangian Dual

An efficient Hessian based algorithm for solving large-scale sparse group Lasso problems