Abstract:Network embedding (NE), which maps nodes into a low-dimensional latent Euclidean space to represent effective features of each node in the network, has obtained considerable attention in recent years. Many popular NE methods, such as DeepWalk, Node2vec, and LINE, are capable of handling homogeneous networks. However, nodes are always fully accompanied by heterogeneous information (e.g., text descriptions, node properties, and hashtags) in the real-world network, which remains a great challenge to jointly project the topological structure and different types of information into the fixed-dimensional embedding space due to heterogeneity. Besides, in the unweighted network, how to quantify the strength of edges (tightness of connections between nodes) accurately is also a difficulty faced by existing methods. To bridge the gap, in this paper, we propose CAHNE (context attention heterogeneous network embedding), a novel network embedding method, to accurately determine the learning result. Specifically, we propose the concept of node importance to measure the strength of edges, which can better preserve the context relations of a node in unweighted networks. Moreover, text information is a widely ubiquitous feature in real-world networks, e.g., online social networks and citation networks. On account of the sophisticated interactions between the network structure and text features of nodes, CAHNE learns context embeddings for nodes by introducing the context node sequence, and the attention mechanism is also integrated into our model to better reflect the impact of context nodes on the current node. To corroborate the efficacy of CAHNE, we apply our method and various baseline methods on several real-world datasets. The experimental results show that CAHNE achieves higher quality compared to a number of state-of-the-art network embedding methods on the tasks of network reconstruction, link prediction, node classification, and visualization.

Learning Network Representations with Neighboring Affinity

Self-Supervised Node Representation Learning Via Node-to-Neighbourhood Alignment.

Universal Network Representation for Heterogeneous Information Networks.

Flexible Attributed Network Embedding.

Associative Learning for Network Embedding

Deep Attributed Network Representation Learning via Attribute Enhanced Neighborhood

AttrHIN: Network Representation Learning Method for Heterogeneous Information Network

Neighbor-enhanced Representation Learning for Link Prediction in Dynamic Heterogeneous Attributed Networks

Attributed Social Network Embedding

A United Approach to Learning Sparse Attributed Network Embedding

Fast Network Embedding Enhancement via High Order Proximity Approximation

Representation Learning in Heterogeneous Information Networks Based on Hyper Adjacency Matrix

Network Representation Learning with Community Awareness and Its Applications in Brain Networks

Node Representation Learning in Graph via Node-to-Neighbourhood Mutual Information Maximization

An Attention-based Collaboration Framework for Multi-View Network Representation Learning

Context Attention Heterogeneous Network Embedding

EPINE: Enhanced Proximity Information Network Embedding

DHNE: Network Representation Learning Method for Dynamic Heterogeneous Networks.

Sparse Attributed Network Embedding Via Adaptively Aggregating Neighborhood Information

TriNE: Network Representation Learning for Tripartite Heterogeneous Networks

Multi-Stage Network Embedding for Exploring Heterogeneous Edges