Abstract:Hyperbolic neural networks have been popular in the recent past due to their ability to represent hierarchical data sets effectively and efficiently. The challenge in developing these networks lies in the nonlinearity of the embedding space namely, the Hyperbolic space. Hyperbolic space is a homogeneous Riemannian manifold of the Lorentz group which is a semi-Riemannian manifold, i.e. a manifold equipped with an indefinite metric. Most existing methods (with some exceptions) use local linearization to define a variety of operations paralleling those used in traditional deep neural networks in Euclidean spaces. In this paper, we present a novel fully hyperbolic neural network which uses the concept of projections (embeddings) followed by an intrinsic aggregation and a nonlinearity all within the hyperbolic space. The novelty here lies in the projection which is designed to project data on to a lower-dimensional embedded hyperbolic space and hence leads to a nested hyperbolic space representation independently useful for dimensionality reduction. The main theoretical contribution is that the proposed embedding is proved to be isometric and equivariant under the Lorentz transformations, which are the natural isometric transformations in hyperbolic spaces. This projection is computationally efficient since it can be expressed by simple linear operations, and, due to the aforementioned equivariance property, it allows for weight sharing. The nested hyperbolic space representation is the core component of our network and therefore, we first compare this representation - independent of the network - with other dimensionality reduction methods such as tangent PCA, principal geodesic analysis (PGA) and HoroPCA. Based on this equivariant embedding, we develop a novel fully hyperbolic graph convolutional neural network architecture to learn the parameters of the projection. Finally, we present experiments demonstrating comparative performance of our network on several publicly available data sets.

A Hyperbolic Embedding Method for Weighted Networks

Weighted Embeddings for Low-Dimensional Graph Representation

Hypergraph Label Propagation Network.

Community preserving mapping for network hyperbolic embedding

An Asymmetric Popularity-Similarity Optimization Method for Embedding Directed Networks into Hyperbolic Space

Embedding Heterogeneous Information Network in Hyperbolic Spaces

Optimisation of the coalescent hyperbolic embedding of complex networks

A Weighted Symmetric Graph Embedding Approach for Link Prediction in Undirected Graphs

Greedy routing optimisation in hyperbolic networks

Hyperbolic Temporal Network Embedding

Nested Hyperbolic Spaces for Dimensionality Reduction and Hyperbolic NN Design

Structural Deep Embedding for Hyper-Networks

Hyperbolic Embedding of Attributed and Directed Networks

A Geometry-Aware Algorithm to Learn Hierarchical Embeddings in Hyperbolic Space

Predicting hyperlinks via weighted hypernetwork loop structure

Improving Hyperbolic Representations via Gromov-Wasserstein Regularization

Hyperbolic Hierarchical Knowledge Graph Embeddings for Link Prediction in Low Dimensions

Low-rank approximations of hyperbolic embeddings

Neural Embeddings of Graphs in Hyperbolic Space

Machine learning meets network science: dimensionality reduction for fast and efficient embedding of networks in the hyperbolic space