Abstract:Node Importance Estimation (NIE) is a task of inferring importance scores of the nodes in a graph. Due to the availability of richer data and knowledge, recent research interests of NIE have been dedicating to knowledge graphs for predicting future or missing node importance scores. Existing state-of-the-art NIE methods train the model by available labels, and they consider every interested node equally before training. However, the nodes with higher importance often require or receive more attention in real-world scenarios, e.g., people may care more about the movies or webpages with higher importance. To this end, we introduce Label Informed ContrAstive Pretraining (LICAP) to the NIE problem for being better aware of the nodes with high importance scores. Specifically, LICAP is a novel type of contrastive learning framework that aims to fully utilize the continuous labels to generate contrastive samples for pretraining embeddings. Considering the NIE problem, LICAP adopts a novel sampling strategy called top nodes preferred hierarchical sampling to first group all interested nodes into a top bin and a non-top bin based on node importance scores, and then divide the nodes within top bin into several finer bins also based on the scores. The contrastive samples are generated from those bins, and are then used to pretrain node embeddings of knowledge graphs via a newly proposed Predicate-aware Graph Attention Networks (PreGAT), so as to better separate the top nodes from non-top nodes, and distinguish the top nodes within top bin by keeping the relative order among finer bins. Extensive experiments demonstrate that the LICAP pretrained embeddings can further boost the performance of existing NIE methods and achieve the new state-of-the-art performance regarding both regression and ranking metrics. The source code for reproducibility is available at

Node Importance Specific Meta Learning in Graph Neural Networks

Self-Supervised Node Representation Learning Via Node-to-Neighbourhood Alignment.

Node Classification on Graphs with Few-Shot Novel Labels Via Meta Transformed Network Embedding

InfoMax Classification-Enhanced Learnable Network for Few-Shot Node Classification

Robust Graph Meta-learning for Weakly-supervised Few-shot Node Classification

MuL-GRN: Multi-Level Graph Relation Network for Few-Shot Node Classification

Graph Contrastive Learning Meets Graph Meta Learning: A Unified Method for Few-shot Node Tasks

Meta-Inductive Node Classification across Graphs

Inductive Linear Probing for Few-shot Node Classification

Meta-GPS++: Enhancing Graph Meta-Learning with Contrastive Learning and Self-Training

Node Importance Estimation with Multiview Contrastive Representation Learning

Label Informed Contrastive Pretraining for Node Importance Estimation on Knowledge Graphs

Multi-level self-adaptive prototypical networks for few-shot node classification on attributed networks

Comprehensive importance measurement for nodes within a node-weighted network

Node Importance Estimation Leveraging LLMs for Semantic Augmentation in Knowledge Graphs

Relative and Absolute Location Embedding for Few-Shot Node Classification on Graph

Meta-Hybrid: Integrate Meta-Learning to Enhance Class Imbalance Graph Learning

Graph Prototypical Networks for Few-shot Learning on Attributed Networks

Few-shot Network Anomaly Detection via Cross-network Meta-learning

A general deep-learning approach to node importance identification

Graph-MLP: Node Classification without Message Passing in Graph