Abstract:Network embedding (NE), which maps nodes into a low-dimensional latent Euclidean space to represent effective features of each node in the network, has obtained considerable attention in recent years. Many popular NE methods, such as DeepWalk, Node2vec, and LINE, are capable of handling homogeneous networks. However, nodes are always fully accompanied by heterogeneous information (e.g., text descriptions, node properties, and hashtags) in the real-world network, which remains a great challenge to jointly project the topological structure and different types of information into the fixed-dimensional embedding space due to heterogeneity. Besides, in the unweighted network, how to quantify the strength of edges (tightness of connections between nodes) accurately is also a difficulty faced by existing methods. To bridge the gap, in this paper, we propose CAHNE (context attention heterogeneous network embedding), a novel network embedding method, to accurately determine the learning result. Specifically, we propose the concept of node importance to measure the strength of edges, which can better preserve the context relations of a node in unweighted networks. Moreover, text information is a widely ubiquitous feature in real-world networks, e.g., online social networks and citation networks. On account of the sophisticated interactions between the network structure and text features of nodes, CAHNE learns context embeddings for nodes by introducing the context node sequence, and the attention mechanism is also integrated into our model to better reflect the impact of context nodes on the current node. To corroborate the efficacy of CAHNE, we apply our method and various baseline methods on several real-world datasets. The experimental results show that CAHNE achieves higher quality compared to a number of state-of-the-art network embedding methods on the tasks of network reconstruction, link prediction, node classification, and visualization.

Learning Regularized Noise Contrastive Estimation for Robust Network Embedding.

Auditing Network Embedding: an Edge Influence Based Approach

Deep Recursive Network Embedding With Regular Equivalence

SCE: Scalable Network Embedding from Sparsest Cut

Contrastive Multi-View Multiplex Network Embedding with Applications to Robust Network Alignment

Cross-Network Skip-Gram Embedding for Joint Network Alignment and Link Prediction

Enhanced contrastive representation in network

Multi-Stage Network Embedding for Exploring Heterogeneous Edges

Context Attention Heterogeneous Network Embedding

Enhanced Remote Sensing Image Compression Method Using Large Network with Sparse Extracting Strategy

Bayesian Robust Graph Contrastive Learning

Neural Embedding Propagation on Heterogeneous Networks

Dynamic Network Embedding : an Extended Approach for Skip-gram Based Network Embedding

Discerning Edge Influence for Network Embedding

Calibrating and Improving Graph Contrastive Learning

A Noise-resistant Graph Neural Network by Semi-supervised Contrastive Learning

Contrastive learning of graphs under label noise

Adversarial Contrastive Estimation

Enhancing the Network Embedding Quality with Structural Similarity

CE-Net: A Coordinate Embedding Network for Mismatching Removal

Noise Contrastive Estimation for Scalable Linear Models for One-Class Collaborative Filtering