Abstract:With the success of Graph Neural Network (GNN) in network data, some GNN-based representation learning methods for networks have emerged recently. Variational Graph Autoencoder (VGAE) is a basic GNN framework for network representation. Its purpose is to well preserve the topology and node attribute information of the network to learn node representation, but it only reconstructs network topology, and does not consider the reconstruction of node features. This strategy will make node representation can not well reserve node features information, impairing the ability of the VGAE method to learn higher quality representations. To solve this problem, we arise a new network representation method to improve the VGAE method for well retaining both node features and network structure information. The method utilizes adversarial mutual information learning to maximize the mutual information (MI) of node features and node representations during the encoding process of the variational autoencoder, which forces the variational encoder to get the representation containing the most informative node features. The method consists of three parts: a variational graph autoencoder includes a variational encoder (MI generator (G)) and a decoder, a positive MI sample module (maximizing MI module), and an MI discriminator (D). Furthermore, we explain why maximizing MI between node features and node representation can reconstruct node attributes. Finally, we conduct experiments on seven public representative datasets for nodes classification, nodes clustering, and graph visualization tasks. Experimental results demonstrate that the proposed algorithm significantly outperforms current popular network representation algorithms on these tasks. The best improvement is 17.13% than the VGAE method.

The Difference Learning of Hidden Layer Between Autoencoder and Variational Autoencoder

Different Latent Variables Learning In Variational Autoencoder

Hidden Talents of the Variational Autoencoder

Variational Composite Autoencoders

Effective Representing of Information Network by Variational Autoencoder

Variational Auto-Decoder: A Method for Neural Generative Modeling from Incomplete Data

Fault Detection Based on Variational Autoencoders for Complex Nonlinear Processes

An adaptive dimension reduction algorithm for latent variables of variational autoencoder.

Asymmetric Variational Autoencoders

Guided Variational Autoencoder for Disentanglement Learning

Recurrent Variational Autoencoders for Learning Nonlinear Generative Models in the Presence of Outliers.

On the Necessity and Effectiveness of Learning the Prior of Variational Auto-Encoder.

Variational Graph Autoencoder with Adversarial Mutual Information Learning for Network Representation Learning

Variation Autoencoder Based Network Representation Learning for Classification.

Variational Approaches for Auto-Encoding Generative Adversarial Networks

Generative autoencoder to prevent overregularization of variational autoencoder

VTAE: Variational Transformer Autoencoder with Manifolds Learning

VAE-Var: Variational-Autoencoder-Enhanced Variational Assimilation

Supervised Vector Quantized Variational Autoencoder for Learning Interpretable Global Representations

Variational Autoencoder for Deep Learning of Images, Labels and Captions

An Introduction to Variational Autoencoders