Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision

Zeyang Zhang,Xin Wang,Ziwei Zhang,Guangyao Shen,Shiqi Shen,Wenwu Zhu

2024-03-08

Abstract:The existing graph neural architecture search (GNAS) methods heavily rely on supervised labels during the search process, failing to handle ubiquitous scenarios where supervisions are not available. In this paper, we study the problem of unsupervised graph neural architecture search, which remains unexplored in the literature. The key problem is to discover the latent graph factors that drive the formation of graph data as well as the underlying relations between the factors and the optimal neural architectures. Handling this problem is challenging given that the latent graph factors together with architectures are highly entangled due to the nature of the graph and the complexity of the neural architecture search process. To address the challenge, we propose a novel Disentangled Self-supervised Graph Neural Architecture Search (DSGAS) model, which is able to discover the optimal architectures capturing various latent graph factors in a self-supervised fashion based on unlabeled graph data. Specifically, we first design a disentangled graph super-network capable of incorporating multiple architectures with factor-wise disentanglement, which are optimized simultaneously. Then, we estimate the performance of architectures under different factors by our proposed self-supervised training with joint architecture-graph disentanglement. Finally, we propose a contrastive search with architecture augmentations to discover architectures with factor-specific expertise. Extensive experiments on 11 real-world datasets demonstrate that the proposed model is able to achieve state-of-the-art performance against several baseline methods in an unsupervised manner.

Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

This paper addresses the problem of unsupervised graph neural architecture search (GNAS). Existing GNAS methods rely on supervised labels for search, but cannot handle the case without labels. The paper explores how to automatically discover the optimal graph neural network architecture on unlabeled graph data, and also investigates the underlying factors driving the formation of the graph data and their relationship with the optimal architecture. The proposed DSGAS model can self-supervise the discovery of these factors and find architectures with specific capabilities through comparative search and architectural enhancement. Experimental results show that DSGAS outperforms existing baseline methods in unsupervised and semi-supervised settings.