Abstract:Network embedding (NE), which maps nodes into a low-dimensional latent Euclidean space to represent effective features of each node in the network, has obtained considerable attention in recent years. Many popular NE methods, such as DeepWalk, Node2vec, and LINE, are capable of handling homogeneous networks. However, nodes are always fully accompanied by heterogeneous information (e.g., text descriptions, node properties, and hashtags) in the real-world network, which remains a great challenge to jointly project the topological structure and different types of information into the fixed-dimensional embedding space due to heterogeneity. Besides, in the unweighted network, how to quantify the strength of edges (tightness of connections between nodes) accurately is also a difficulty faced by existing methods. To bridge the gap, in this paper, we propose CAHNE (context attention heterogeneous network embedding), a novel network embedding method, to accurately determine the learning result. Specifically, we propose the concept of node importance to measure the strength of edges, which can better preserve the context relations of a node in unweighted networks. Moreover, text information is a widely ubiquitous feature in real-world networks, e.g., online social networks and citation networks. On account of the sophisticated interactions between the network structure and text features of nodes, CAHNE learns context embeddings for nodes by introducing the context node sequence, and the attention mechanism is also integrated into our model to better reflect the impact of context nodes on the current node. To corroborate the efficacy of CAHNE, we apply our method and various baseline methods on several real-world datasets. The experimental results show that CAHNE achieves higher quality compared to a number of state-of-the-art network embedding methods on the tasks of network reconstruction, link prediction, node classification, and visualization.

NECA: Network-Embedded Deep Representation Learning for Categorical Data

Neighborhood Commonality-aware Evolution Network for Continuous Generalized Category Discovery

Cane: Context-Aware Network Embedding for Relation Modeling

Categorical Image Classification Based On Representational Deep Network (RESNET)

Context Attention Heterogeneous Network Embedding

DeepEmLAN: Deep embedding learning for attributed networks

CEIR: Concept-based Explainable Image Representation Learning

Decoupled Representation Learning for Attributed Networks

Nearest Neighbor Classifier Embedded Network for Active Learning

Unsupervised Heterogeneous Coupling Learning for Categorical Representation

PNE: Label Embedding Enhanced Network Embedding.

Mcne: An End-To-End Framework For Learning Multiple Conditional Network Representations Of Social Network

Learning Structured Output Representations from Attributes using Deep Conditional Generative Models

Class attention network for image recognition

Visual Recognition with Deep Nearest Centroids

Representation learning using Attention Network and CNN for Heterogeneous networks

An Approach Towards Learning K-means-friendly Deep Latent Representation

CatGCN: Graph Convolutional Networks with Categorical Node Features

Exploiting Field Dependencies for Learning on Categorical Data

ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks

Face Recognition via Centralized Coordinate Learning