Abstract:Graph attention networks (GAT), which have strong performance in tackling various analytical tasks on network data, have attracted wide attention. However, complex real-world networks have both edge topology and node features. GAT only relies on the topology of edges to extract network information, and the association between node features is underutilized, which may seriously hinder GAT’s expressive ability on some tasks. In addition, the attention mechanism can automatically assign different weights to different pieces of information, making it easier to express information with multiple aspects. Therefore, we propose semi-supervised multi-channel attention networks (MC-GAT), which simultaneously extract node features, topological structures, and their combination information. The MC-GAT model consists of two specific attention modules, one common attention module, and the attention mechanism. To create node embeddings containing various informational aspects, we use the attention mechanism to assign weights to each. Extensive testing on benchmark datasets has shown us to be at our best. The performance of the proposed model is demonstrated by the fact that MC-GAT achieves relative maximum improvements of 4.22% for accuracy (ACC) on BlogCatalog and 5.23% for macro F1-score (F1) on UAI2010. Experimental results on relevant datasets show that the method has satisfactory performance, and multi-channel graph attention can capture richer structural and feature information within linear time complexity. This work provides a new way of thinking about graph neural networks.

Not All Neighbors Are Worth Attending To: Graph Selective Attention Networks for Semi-supervised Learning

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Neighbor Overlay-Induced Graph Attention Network

How Attentive are Graph Attention Networks?

How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervision

HONGAT: Graph Attention Networks in the Presence of High-Order Neighbors

Graph Context-Attention Network Via Low and High Order Aggregation

Self-supervised Graph Representations with Generative Adversarial Learning

Attention-based Graph Neural Network for Semi-supervised Learning

Spiking GATs: Learning Graph Attentions via Spiking Neural Network

Representation Learning on Heterophilic Graph with Directional Neighborhood Attention

Global-local graph attention: unifying global and local attention for node classification

Community Attention Network for Semi-supervised Node Classification.

MC-GAT: Multi-Channel Graph Attention Networks for Capturing Diverse Information in Complex Graphs

Dual Separated Attention-based Graph Neural Network

FairGAT: Fairness-aware Graph Attention Networks

Context-Aware Graph Attention Networks

Simple and Deep Graph Attention Networks

Sparse Graphs-based Dynamic Attention Networks

Revisiting Attention-Based Graph Neural Networks for Graph Classification

Towards Deep Attention in Graph Neural Networks: Problems and Remedies