Abstract:Due to the unique construction module and design of graph neural networks (GNNs), neural architecture search (NAS) methods specifically for GNNs have become a promising research hotspot in recent years. Among the existing methods, one class of methods microscopically searches for the constituent components of network layers. However, most of them ignore the topology connections between network layers or the feature fusion strategies. Another class of methods, called differentiable architecture search methods, has the advantage of searching topology connections and feature fusion strategies. However, constrained by the requirement of predefining all candidate operations, these methods can only sample a limited number of network layers. In this paper, we propose a surrogate evolutionary graph neural architecture search (GNAS) algorithm whose search space contains not only the microscopic network layer components but also topology connections and feature fusion strategies (called CTFGNAS). The GNN sampled in CTFGNAS is represented by a simple one-dimensional vector and does not fix the network depth. To address the problem that traditional crossover and mutation operators applied to GNAS may produce illegal solutions, we design a repair operation to guarantee the legitimacy of the solutions. The network depth is also increased with a large probability in the mutation operation to alleviate the oversmoothing problem. In addition, to cope with the challenge of computational resources due to the increased search space, we form a surrogate model with three classical regression models, where only a small number of solutions are truly evaluated for their fitness, and the remaining large number of solutions are predicted for their fitness by the surrogate model. Finally, experiments are executed on six widely used real-world datasets. The experimental results illustrate that CTFGNAS obtains more effective results than the state-of-the-art handcrafted GNNs and GNAS methods on all datasets. CTFGNAS is now available on the following website: https://github.com/chnyliu/CTFGNAS.

Surrogate-Assisted Evolution of Convolutional Neural Networks by Collaboratively Optimizing the Basic Blocks and Topologies

Automatically Evolving CNN Architectures Based on Blocks

Simple-Encoded evolving convolutional neural network and its application to skin disease image classification

A Graph-Based Encoding for Evolutionary Convolutional Neural Network Architecture Design

Efficient Evolutionary Neural Architecture Search Based on Hybrid Search Space

Evolutionary Neural Architecture Search Combining Multi-Branch ConvNet and Improved Transformer

Evolving Convolutional Neural Networks by Symbiotic Organisms Search Algorithm for Image Classification

Surrogate-assisted Particle Swarm Optimisation for Evolving Variable-length Transferable Blocks for Image Classification

Completely Automated CNN Architecture Design Based on Blocks

XC-NAS: A New Cellular Encoding Approach for Neural Architecture Search of Multi-path Convolutional Neural Networks

Multiobjective Evolutionary Design of Deep Convolutional Neural Networks for Image Classification

Using Cartesian Genetic Programming Approach with New Crossover Technique to Design Convolutional Neural Networks

A Self-Adaptive Mutation Neural Architecture Search Algorithm Based on Blocks

A Gradient-Guided Evolutionary Neural Architecture Search

Automated Design of CNN Architecture Based on Efficient Evolutionary Search

Improved Search in Neuroevolution Using a Neural Architecture Classifier With the CNN Architecture Encoding as Feature Vector

An Aggressive Genetic Programming Approach for Searching Neural Network Structure Under Computational Constraints

Architecture search of accurate and lightweight CNNs using genetic algorithm

Finding Better Topologies for Deep Convolutional Neural Networks by Evolution

A Surrogate Evolutionary Neural Architecture Search Algorithm for Graph Neural Networks