Abstract:Graph Neural Networks (GNNs) have become one of the indispensable tools to learn from graph-structured data, and their usefulness has been shown in wide variety of tasks. In recent years, there have been tremendous improvements in architecture design, resulting in better performance on various prediction tasks. In general, these neural architectures combine node feature aggregation and feature transformation using learnable weight matrix in the same layer. This makes it challenging to analyze the importance of node features aggregated from various hops and the expressiveness of the neural network layers. As different graph datasets show varying levels of homophily and heterophily in features and class label distribution, it becomes essential to understand which features are important for the prediction tasks without any prior information. In this work, we decouple the node feature aggregation step and depth of graph neural network, and empirically analyze how different aggregated features play a role in prediction performance. We show that not all features generated via aggregation steps are useful, and often using these less informative features can be detrimental to the performance of the GNN model. Through our experiments, we show that learning certain subsets of these features can lead to better performance on wide variety of datasets. Based on our observations, we introduce several key design strategies for graph neural networks. More specifically, we propose to use softmax as a regularizer and ”soft-selector” of features aggregated from neighbors at different hop distances; and L2-Normalization over GNN layers. Combining these techniques, we present a simple and shallow model, Feature Selection Graph Neural Network (FSGNN), and show empirically that the proposed model achieves comparable or even higher accuracy than state-of-the-art GNN models in nine benchmark datasets for the node classification task, with remarkable improvements up to 51.1%. Source code available at https://github.com/sunilkmaurya/FSGNN/.

Modeling Heterogeneity with Flexible and Semantic Aligned Graph Neural Networks

Beyond Homophily and Homogeneity Assumption: Relation-Based Frequency Adaptive Graph Neural Networks

Semantic-guided graph neural network for heterogeneous graph embedding

Addressing Heterogeneity and Heterophily in Graphs: A Heterogeneous Heterophilic Spectral Graph Neural Network

HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networks

Scalable Graph Neural Networks for Heterogeneous Graphs

Heterophilic Graph Neural Network Based on Spatial and Frequency Domain Adaptive Embedding Mechanism

Simple and Efficient Heterogeneous Graph Neural Network

HetGNN-SF: Self-supervised learning on heterogeneous graph neural network via semantic strength and feature similarity

KAGNN: Graph neural network with kernel alignment for heterogeneous graph learning

Multi-graph aggregated graph neural network for heterogeneous graph representation learning

Adaptive Neighbor Graph Aggregated Graph Attention Network for Heterogeneous Graph Embedding

SR-HGN: Semantic- and Relation-Aware Heterogeneous Graph Neural Network

Heterogeneous Graph Neural Network With Multi-View Representation Learning

Exploiting Neighbor Effect: Conv-Agnostic GNN Framework for Graphs with Heterophily

Graph Neural Networks with Heterophily

Node classification oriented Adaptive Multichannel Heterogeneous Graph Neural Network

GCNH: A Simple Method For Representation Learning On Heterophilous Graphs

Node-dependent Semantic Search over Heterogeneous Graph Neural Networks

Signed Attention Based Graph Neural Network for Graphs with Heterophily.

Simplifying approach to node classification in Graph Neural Networks