Abstract:Due to the unique construction module and design of graph neural networks (GNNs), neural architecture search (NAS) methods specifically for GNNs have become a promising research hotspot in recent years. Among the existing methods, one class of methods microscopically searches for the constituent components of network layers. However, most of them ignore the topology connections between network layers or the feature fusion strategies. Another class of methods, called differentiable architecture search methods, has the advantage of searching topology connections and feature fusion strategies. However, constrained by the requirement of predefining all candidate operations, these methods can only sample a limited number of network layers. In this paper, we propose a surrogate evolutionary graph neural architecture search (GNAS) algorithm whose search space contains not only the microscopic network layer components but also topology connections and feature fusion strategies (called CTFGNAS). The GNN sampled in CTFGNAS is represented by a simple one-dimensional vector and does not fix the network depth. To address the problem that traditional crossover and mutation operators applied to GNAS may produce illegal solutions, we design a repair operation to guarantee the legitimacy of the solutions. The network depth is also increased with a large probability in the mutation operation to alleviate the oversmoothing problem. In addition, to cope with the challenge of computational resources due to the increased search space, we form a surrogate model with three classical regression models, where only a small number of solutions are truly evaluated for their fitness, and the remaining large number of solutions are predicted for their fitness by the surrogate model. Finally, experiments are executed on six widely used real-world datasets. The experimental results illustrate that CTFGNAS obtains more effective results than the state-of-the-art handcrafted GNNs and GNAS methods on all datasets. CTFGNAS is now available on the following website: https://github.com/chnyliu/CTFGNAS.

Genetic-Gated Networks for Deep Reinforcement

GEN Model: An Alternative Approach to Deep Neural Network Models

Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning

Evolving Differentiable Gene Regulatory Networks

Genetic-GNN: Evolutionary architecture search for Graph Neural Networks

DGFN: Double Generative Flow Networks

Genetic Algorithms for Evolving Deep Neural Networks

Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data

Quadratic Graph Attention Network (Q-GAT) for Robust Construction of Gene Regulatory Networks

Learning Asynchronous Boolean Networks from Single-Cell Data Using Multiobjective Cooperative Genetic Programming

Dynamic Dual Gating Neural Networks

GEGAN: Generative Adversarial Networks Training Based on Gradient Directed Evolutionary Strategy

Policy Optimization by Genetic Distillation

GACNN: Training Deep Convolutional Neural Networks with Genetic Algorithm

Deep Neural Crossover

A Neural Networks for Real Coded Genetic Algorithm

Gradient-Free Neural Network Training via Synaptic-Level Reinforcement Learning

Deep Genetic Network

Direct Mutation and Crossover in Genetic Algorithms Applied to Reinforcement Learning Tasks

Autonomously and Simultaneously Refining Deep Neural Network Parameters by a Bi-Generative Adversarial Network Aided Genetic Algorithm

A Surrogate Evolutionary Neural Architecture Search Algorithm for Graph Neural Networks