Abstract:Recently, the Network Representation Learning (NRL) techniques, which target at learning the low-dimension vector representation of graph structures, have attracted wide attention due to the effectiveness on various social-oriented application. Though large efforts have been made on the joint analysis combining node attributes with the network structure, they may usually fail to summarize the weighted correlations within nodes and attributes, especially when the nodes suffer extremely sparse attributes. To that end, in this paper, we propose a novel Sparse Attributed Network Embedding (SANE) framework to learn the network structure and sparse attribute information simultaneously in a united approach. Specifically, we first embed the nodes and attributes into a low-dimensional vector space. Then we introduce the pairwise method to capture the interaction between nodes and sparse attributes, and aggregate the attribute information of neighbors to alleviate sparsity for obtaining a better vector representation of node embeddings, which will be used in following network representation learning task. Along this line, we maintain the network structure by maximizing the probability of predicting the center node according to surrounding context nodes. Different from previous work, we introduce an attention mechanism to adaptively weigh the strength of interactions between each context node and the center node, according to the node attribute similarity. Furthermore, we combine the attention network with CBOW model to learn the similarity of the network structure and node attributes simultaneously. Extensive experiments on public datasets have validated the effectiveness of our SANE model with significant margin compared with the state-of-the-art baselines, which demonstrates the potential of adaptively attribute analysis in network embedding.

Multi-order Attribute Network Representation Learning Via Constructing Hierarchical Graphs

Hierarchical Mixed Neural Network for Joint Representation Learning of Social-Attribute Network.

Universal Network Representation for Heterogeneous Information Networks.

ANRL: Attributed Network Representation Learning Via Deep Neural Networks

Community-enhanced Network Representation Learning for Network Analysis.

A Unified Framework for Community Detection and Network Representation Learning

Flexible Attributed Network Embedding.

MERIT: Learning Multi-level Representations on Temporal Graphs.

Network Representation Learning: From Preprocessing, Feature Extraction to Node Embedding

Deep Attributed Network Representation Learning via Attribute Enhanced Neighborhood

AttrHIN: Network Representation Learning Method for Heterogeneous Information Network

Fast Network Embedding Enhancement via High Order Proximity Approximation

Network Representation Learning: From Traditional Feature Learning to Deep Learning

Mcne: An End-To-End Framework For Learning Multiple Conditional Network Representations Of Social Network

Sparse Attributed Network Embedding Via Adaptively Aggregating Neighborhood Information

A United Approach to Learning Sparse Attributed Network Embedding

Hierarchical Representation Learning for Attributed Networks

Representation Learning for Attributed Multiplex Heterogeneous Network

Learning Effective Road Network Representation with Hierarchical Graph Neural Networks

Network Representation Learning with Community Awareness and Its Applications in Brain Networks

Multiple heterogeneous network representation learning based on multi-granularity fusion