Abstract:The network embedding problem that maps nodes in a graph to vectors in Euclidean space can be very useful for addressing several important tasks on a graph. Recently, graph neural networks (GNNs) have been proposed for solving such a problem. However, most embedding algorithms and GNNs are difficult to interpret and do not scale well to handle millions of nodes. In this paper, we tackle the problem from a new perspective based on the equivalence of three constrained optimization problems: the network embedding problem, the trace maximization problem of the modularity matrix in a sampled graph, and the matrix factorization problem of the modularity matrix in a sampled graph. The optimal solutions to these three problems are the dominant eigenvectors of the modularity matrix. We proposed two algorithms that belong to a special class of graph convolutional networks (GCNs) for solving these problems: (i) Clustering As Feature Embedding GCN (CAFE-GCN) and (ii) sphere-GCN. Both algorithms are stable trace maximization algorithms, and they yield good approximations of dominant eigenvectors. Moreover, there are linear-time implementations for sparse graphs. In addition to solving the network embedding problem, both proposed GCNs are capable of performing dimensionality reduction. Various experiments are conducted to evaluate our proposed GCNs and show that our proposed GCNs outperform almost all the baseline methods. Moreover, CAFE-GCN could be benefited from the labeled data and have tremendous improvements in various performance metrics.

Encoding Space Based on Directed Acyclic Graphs

Evolutionary NAS with Gene Expression Programming of Cellular Encoding

Understanding Geometry of Encoder-Decoder CNNs

A Generic Graph-Based Neural Architecture Encoding Scheme with Multifaceted Information

TA-GATES: An Encoding Scheme for Neural Network Architectures

Structure-Aware Group Discrimination with Adaptive-View Graph Encoder: A Fast Graph Contrastive Learning Framework

Stacked What-Where Auto-encoders

Adaptive Graph Encoder for Attributed Graph Embedding

Some New Layer Architectures for Graph CNN

Graph Convolutional Auto-encoder with Bi-decoder and Adaptive-sharing Adjacency

Explainable, Stable, and Scalable Graph Convolutional Networks for Learning Graph Representation

A Study on Encodings for Neural Architecture Search

Attention-Gate-Based Encoder–Decoder Network for Automatical Building Extraction

HC-GAE: The Hierarchical Cluster-based Graph Auto-Encoder for Graph Representation Learning

DUPLEX: Dual GAT for Complex Embedding of Directed Graphs

GANE: A Generative Adversarial Network Embedding

GaborNet Visual Encoding: A Lightweight Region-Based Visual Encoding Model With Good Expressiveness and Biological Interpretability

GACNN: Training Deep Convolutional Neural Networks with Genetic Algorithm

Genetic CNN

A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAS

XC-NAS: A New Cellular Encoding Approach for Neural Architecture Search of Multi-path Convolutional Neural Networks