Abstract:Recently, maximizing mutual information has emerged as a powerful tool for unsupervised graph representation learning. Existing methods are typically effective in capturing graph information from the topology view but consistently ignore the node feature view. To circumvent this problem, we propose a novel method by exploiting mutual information maximization across feature and topology views. Specifically, we first construct the feature graph to capture the underlying structure of nodes in feature spaces by measuring the distance between pairs of nodes. Then we use a cross-view representation learning module to capture both local and global information content across feature and topology views on graphs. To model the information shared by the feature and topology spaces, we develop a common representation learning module by using mutual information maximization and reconstruction loss minimization. Here, minimizing reconstruction loss forces the model to learn the shared information of feature and topology spaces. To explicitly encourage diversity between graph representations from the same view, we also introduce a disagreement regularization to enlarge the distance between representations from the same view. Experiments on synthetic and real-world datasets demonstrate the effectiveness of integrating feature and topology views. In particular, compared with the previous supervised methods, the proposed method achieves comparable or even better performance under the unsupervised representation and linear evaluation protocol.

Maximizing Mutual Information Across Feature and Topology Views for Learning Graph Representations

Graph Representation Learning Via Graphical Mutual Information Maximization.

Cluster-aware Multiplex InfoMax for Unsupervised Graph Representation Learning

Learning Representations by Graphical Mutual Information Estimation and Maximization

Contrastive Graph Representation Learning Via Maximizing Mutual Information.

Heterogeneous Deep Graph Infomax

Node Representation Learning in Graph via Node-to-Neighbourhood Mutual Information Maximization

Graph contrastive learning with min-max mutual information

Graph Contrastive Learning with Local and Global Mutual Information Maximization.

Learning Representations by Maximizing Mutual Information Across Views

Unsupervised Hierarchical Graph Representation Learning by Mutual Information Maximization

Interdependence-Adaptive Mutual Information Maximization for Graph Contrastive Learning

Utilizing Edge Features in Graph Neural Networks Via Variational Information Maximization

Multiview Deep Graph Infomax to Achieve Unsupervised Graph Embedding

Multi-view Unsupervised Graph Representation Learning.

Towards Consistency and Complementarity: A Multiview Graph Information Bottleneck Approach

Multimodal Representation Learning via Maximization of Local Mutual Information

Joint learning of feature and topology for multi-view graph convolutional network

Clustering by Maximizing Mutual Information Across Views

Auto-weighted Multi-view Feature Selection with Graph Optimization

Exploiting Mutual Information for Substructure-Aware Graph Representation Learning