Adversarial Residual Variational Graph Autoencoder with Batch Normalization

Qisheng Liao,Xu Wu,Xiaqing Xie,Jingchen Wu,Lirong Qiu,Lijuan Sun
DOI: https://doi.org/10.1109/dsc53577.2021.00013
2021-01-01
Abstract:The variational graph autoencoder (VGAE), a framework for unsupervised learning on graph-structured data, has captured more attention recently in graph embedding area. However, it has been faced up with the challenge of KL vanishing, which will converge to local optimum and make the graph embedding unavailable for downstream tasks like link prediction. This paper proposes a novel variational graph autoencoder framework to achieve more effective graph embedding. Firstly, we introduce batch normalization to make sure the KL distribution consistent with the whole dataset by keeping its expectation positive, thus avoiding posteriori collapse. In addition, we invite residual connection and adversarial network to simultaneously embed the topology information and content information into graph representation stably, enhancing the expressive ability of latent vector. Finally, link prediction experiments on three citation datasets demonstrate that the AUC scores of our algorithm are higher than 92% and the average accuracies are higher than 93%, which is competitive comparing with the state-of-the-art variational graph autoencoders.
What problem does this paper attempt to address?