Abstract:Edge features contain important information about graphs. However, current state-of-the-art neural network models designed for graph learning, e.g. graph convolutional networks (GCN) and graph attention networks (GAT), adequately utilize edge features, especially multi-dimensional edge features. In this paper, we build a new framework for a family of new graph neural network models that can more sufficiently exploit edge features, including those of undirected or multi-dimensional edges. The proposed framework can consolidate current graph neural network models; e.g. graph convolutional networks (GCN) and graph attention networks (GAT). The proposed framework and new models have the following novelties: First, we propose to use doubly stochastic normalization of graph edge features instead of the commonly used row or symmetric normalization approches used in current graph neural networks. Second, we construct new formulas for the operations in each individual layer so that they can handle multi-dimensional edge features. Third, for the proposed new framework, edge features are adaptive across network layers. As a result, our proposed new framework and new models can exploit a rich source of graph information. We apply our new models to graph node classification on several citation networks, whole graph classification, and regression on several molecular datasets. Compared with the current state-of-the-art methods, i.e. GCNs and GAT, our models obtain better performance, which testify to the importance of exploiting edge features in graph neural networks.

What problem does this paper attempt to address?

The paper attempts to address issues primarily focused on the current Graph Neural Networks (GNNs) models' insufficient utilization of edge features when processing graph data. Specifically: 1. **Insufficient Utilization of Multi-dimensional Edge Features**: Existing GNN models such as Graph Convolutional Networks (GCNs) and Graph Attention Networks (GATs) do not adequately utilize edge features, especially multi-dimensional edge features. For example, GAT can only handle one-dimensional binary edge features, while GCN can utilize one-dimensional real-valued edge features but is limited to a single dimension. 2. **Adaptability of Edge Features**: In GAT and GCN, the original adjacency matrix used in each layer is usually fixed or predefined, which may lead to noise issues and cannot adaptively adjust edge features as the network layers increase. 3. **Handling of Directional Edge Features**: Many real-world graph data are directional, such as citation relationships in citation networks. However, existing GNN models often treat directed graphs as undirected, ignoring the direction information of edges, which may lead to the loss of important information. To address these issues, the paper proposes a new framework and model—Edge-Enhanced Graph Neural Networks (EGNN), which improves existing models through the following innovations: - **Dual Random Normalization**: Introduces a dual random normalization method to handle the edge feature matrix. Compared to traditional row normalization or symmetric normalization, this method can better stabilize the feature propagation process in multi-layer graph neural networks. - **Multi-dimensional Edge Feature Processing**: Designs new formulas that enable the model to effectively handle multi-dimensional edge features, thereby capturing richer graph structure information. - **Cross-layer Edge Feature Adaptability**: Uses an attention mechanism to allow edge features to adaptively change between different network layers, better integrating local and global information. - **Directional Edge Feature Encoding**: Proposes a method to encode directional edge features as multi-dimensional features, effectively utilizing edge direction information in the model. Through these innovations, experimental results of the EGNN model on multiple graph datasets show that compared to existing GNN models, EGNN achieves better performance in node classification, graph classification, and regression tasks, validating the importance of fully utilizing edge features.

Exploiting Edge Features in Graph Neural Networks

Exploiting Edge Features for Graph Neural Networks

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Utilizing Edge Features in Graph Neural Networks Via Variational Information Maximization

Enhancing Graph Neural Networks with Edge Features Through Sequential Representation

Graph Classification via Discriminative Edge Feature Learning

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Edge-Featured Graph Attention Network

EGAT: Edge-Featured Graph Attention Network

Exploiting Node-Feature Bipartite Graph in Graph Convolutional Networks.

Towards characterizing the value of edge embeddings in Graph Neural Networks

Revisiting Attention-Based Graph Neural Networks for Graph Classification

Reliable Representations Make A Stronger Defender: Unsupervised Structure Refinement for Robust GNN

DEGNN: Dual Experts Graph Neural Network Handling Both Edge and Node Feature Noise

Exploiting Neighbor Effect: Conv-Agnostic GNN Framework for Graphs with Heterophily

Graph Neural Networks Inspired by Classical Iterative Algorithms

Enhancing Graph Neural Networks by a High-quality Aggregation of Beneficial Information

Feature Expansion for Graph Neural Networks

Edge Convolutional Networks: Decomposing Graph Convolutional Networks for Stochastic Training with Independent Edges

High-order graph attention network

GAIN: Graph Attention & Interaction Network for Inductive Semi-Supervised Learning over Large-scale Graphs