Abstract:Although Transformer architectures have been successfully applied to graph data with the advent of Graph Transformer, current design of Graph Transformer still heavily relies on human labor and expertise knowledge to decide proper neural architectures and suitable graph encoding strategies at each Transformer layer. In literature, there have been some works on automated design of Transformers focusing on non-graph data such as texts and images without considering graph encoding strategies, which fail to handle the non-euclidean graph data. In this paper, we study the problem of automated graph Transformer, for the first time. However, solving these problems poses the following challenges: i) how can we design a unified search space for graph Transformer, and ii) how to deal with the coupling relations between Transformer architectures and the graph encodings of each Transformer layer. To address these challenges, we propose Automated Graph Transformer (AutoGT), a neural architecture search framework that can automatically discover the optimal graph Transformer architectures by joint optimization of Transformer architecture and graph encoding strategies. Specifically, we first propose a unified graph Transformer formulation that can represent most of state-of-the-art graph Transformer architectures. Based upon the unified formulation, we further design the graph Transformer search space that includes both candidate architectures and various graph encodings. To handle the coupling relations, we propose a novel encoding-aware performance estimation strategy by gradually training and splitting the supernets according to the correlations between graph encodings and architectures. The proposed strategy can provide a more consistent and fine-grained performance prediction when evaluating the jointly optimized graph encodings and architectures. Extensive experiments and ablation studies show that our proposed AutoGT gains sufficient improvement over state-of-the-art hand-crafted baselines on all datasets, demonstrating its effectiveness and wide applicability.

GT-Net: Variational Autoencoder Networks based on Graph Transformer for 3D Shape Learning

View-Aware Geometry-Structure Joint Learning for Single-View 3D Shape Reconstruction

StructureNet: Hierarchical Graph Networks for 3D Shape Generation

Learning Part Generation and Assembly for Structure-aware Shape Synthesis

GTNet: Graph Transformer Network for 3D Point Cloud Classification and Semantic Segmentation

EGCT: Enhanced Graph Convolutional Transformer for 3D Point Cloud Representation Learning

VTAE: Variational Transformer Autoencoder with Manifolds Learning

Graph Transformer GANs with Graph Masked Modeling for Architectural Layout Generation

Dual octree graph networks for learning adaptive volumetric shape representations

PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers

Geometry-aware 3D pose transfer using transformer autoencoder

PAI-GCN: Permutable Anisotropic Graph Convolutional Networks for 3D Shape Representation Learning.

PoseGTAC: Graph Transformer Encoder-Decoder with Atrous Convolution for 3D Human Pose Estimation

DAE-Net: Deforming Auto-Encoder for fine-grained shape co-segmentation

AutoGT: Automated Graph Transformer Architecture Search

3D ShapeNets: A Deep Representation for Volumetric Shapes

Learning View-Based Graph Convolutional Network for Multi-View 3D Shape Analysis

Learning Adversarial 3D Model Generation with 2D Image Enhancer

GTAE: Graph Transformer–Based Auto-Encoders for Linguistic-Constrained Text Style Transfer

D-VAE: A Variational Autoencoder for Directed Acyclic Graphs