Node-Image CAE: A Novel Embedding Method Via Convolutional Auto-encoder and High-Order Proximities

Di Qiao,Wu Yang,Wei Wang
DOI: https://doi.org/10.1007/978-3-030-82136-4_27
2021-01-01
Abstract:The network embedding method, which mainly aims to generate low-dimensional embedding vectors for nodes in a network, has received great passion from researchers and provides excellent tools for application and research. Various models have been applied to this field to gain high-quality embedding vectors and got prodigious success, such as Matrix Factorization, Multilayer Perceptron, Recurrent Neural Network, Generative Adversarial Networks, Graph Convolutional Network, and so on. However, a very powerful model—Convolutional Neural Network, which plays a significant role in Digital Image Processing, Natural Language Processing, etc.—has not been widely used (except whole-graph embedding). CNN is thought inappropriate to embed nodes into vectors because traditional CNN can only work on grid-like data such as images while a graph generally has a irregular structure. And with the development of the embedding method, high-order proximities are gradually found playing a crucial role in exploring the network’s underlying structure. However, many existing embedding methods can only preserve fixed-order proximities, limiting the scope of their application. In this paper, we try to explore a viable way to apply CNN on node-embedding task. We first build an image for each node that can flexibly preserve different order proximities and feed them into a variation of the Convolutional Neural Network, the Convolutional Auto-Encoder (CAE), to generate embedding vectors. Experiments show that our method outperforms state-of-the-art embedding methods.
What problem does this paper attempt to address?