Abstract:Graph neural architecture search (GNAS) can customize high-performance graph neural network architectures for specific graph tasks or datasets. However, existing GNAS methods begin searching for architectures from a zero-knowledge state, ignoring the prior knowledge that may improve the search efficiency. The available knowledge base (e.g. NAS-Bench-Graph) contains many rich architectures and their multiple performance metrics, such as the accuracy (#Acc) and number of parameters (#Params). This study proposes exploiting such prior knowledge to accelerate the multi-objective evolutionary search on a new graph dataset, named knowledge-aware evolutionary GNAS (KEGNAS). KEGNAS employs the knowledge base to train a knowledge model and a deep multi-output Gaussian process (DMOGP) in one go, which generates and evaluates transfer architectures in only a few GPU seconds. The knowledge model first establishes a dataset-to-architecture mapping, which can quickly generate candidate transfer architectures for a new dataset. Subsequently, the DMOGP with architecture and dataset encodings is designed to predict multiple performance metrics for candidate transfer architectures on the new dataset. According to the predicted metrics, non-dominated candidate transfer architectures are selected to warm-start the multi-objective evolutionary algorithm for optimizing the #Acc and #Params on a new dataset. Empirical studies on NAS-Bench-Graph and five real-world datasets show that KEGNAS swiftly generates top-performance architectures, achieving 4.27% higher accuracy than advanced evolutionary baselines and 11.54% higher accuracy than advanced differentiable baselines. In addition, ablation studies demonstrate that the use of prior knowledge significantly improves the search performance.

Auto-GNAS: A Parallel Graph Neural Architecture Search Framework

Auto-GNN: Neural Architecture Search of Graph Neural Networks

GraphNAS++: Distributed Architecture Search for Graph Neural Networks

Rethinking Graph Neural Architecture Search From Message-Passing.

GraphPAS: Parallel Architecture Search for Graph Neural Networks

Simplifying Architecture Search for Graph Neural Network

Rethinking Graph Neural Network Search from Message-passing

Genetic-GNN: Evolutionary architecture search for Graph Neural Networks

EGNAS: Efficient Graph Neural Architecture Search Through Evolutionary Algorithm

DFG-NAS: Deep and Flexible Graph Neural Architecture Search

Probabilistic Dual Network Architecture Search on Graphs

AutoGraph: Automated Graph Neural Network

SA-GNAS: Seed Architecture Expansion for Efficient Large-scale Graph Neural Architecture Search

AutoGSR: Neural Architecture Search for Graph-based Session Recommendation

NAS-Bench-Graph: Benchmarking Graph Neural Architecture Search

Graph Differentiable Architecture Search with Structure Learning

Knowledge-aware Evolutionary Graph Neural Architecture Search

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks

AutoGSR

Search to aggregate neighborhood for graph neural network

One-shot Graph Neural Architecture Search with Dynamic Search Space