Abstract:Graph Transformers (GTs) have recently achieved significant success in the graph domain by effectively capturing both long-range dependencies and graph inductive biases. However, these methods face two primary challenges: (1) multi-view chaos, which results from coupling multi-view information (positional, structural, attribute), thereby impeding flexible usage and the interpretability of the propagation process. (2) local-global chaos, which arises from coupling local message passing with global attention, leading to issues of overfitting and over-globalizing. To address these challenges, we propose a high-level decoupled perspective of GTs, breaking them down into three components and two interaction levels: positional attention, structural attention, and attribute attention, alongside local and global interaction. Based on this decoupled perspective, we design a decoupled graph triple attention network named DeGTA, which separately computes multi-view attentions and adaptively integrates multi-view local and global information. This approach offers three key advantages: enhanced interpretability, flexible design, and adaptive integration of local and global information. Through extensive experiments, DeGTA achieves state-of-the-art performance across various datasets and tasks, including node classification and graph classification. Comprehensive ablation studies demonstrate that decoupling is essential for improving performance and enhancing interpretability. Our code is available at: <a class="link-external link-https" href="https://github.com/wangxiaotang0906/DeGTA" rel="external noopener nofollow">this https URL</a>

Graph-Attention-Based Decentralized Edge Learning for Non-IID Data.

Distributed Learning over Networks with Graph-Attention-Based Personalization

A Graph Neural Network Based Decentralized Learning Scheme

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System.

Graph Attention Network Reinforcement Learning Based Computation Offloading in Multi-Access Edge Computing.

Representation Learning on Heterophilic Graph with Directional Neighborhood Attention

Edge-Featured Graph Attention Network

Spiking GATs: Learning Graph Attentions via Spiking Neural Network

Transferable graph neural networks with deep alignment attention

Cascaded Attention: Adaptive and Gated Graph Attention Network for Multiagent Reinforcement Learning

EGAT: Edge-Featured Graph Attention Network

Not All Neighbors Are Worth Attending To: Graph Selective Attention Networks for Semi-supervised Learning

Fully Decentralized Joint Learning of Personalized Models and Collaboration Graphs

Graph Triple Attention Network: A Decoupled Perspective

Differentiable Clustering for Graph Attention

Personalized Decentralized Multi-Task Learning Over Dynamic Communication Graphs

Graph Explicit Attention Network Based on Predefined Strategy

Deep Graph Attention Model

FDGATII : Fast Dynamic Graph Attention with Initial Residual and Identity Mapping

Neighbor Overlay-Induced Graph Attention Network