Abstract:Over the last decade, graph neural networks (GNNs) have made significant progress in numerous graph machine learning tasks. In real-world applications, where domain shifts occur and labels are often unavailable for a new target domain, graph domain adaptation (GDA) approaches have been proposed to facilitate knowledge transfer from the source domain to the target domain. Previous efforts in tackling distribution shifts across domains have mainly focused on aligning the node embedding distributions generated by the GNNs in the source and target domains. However, as the core part of GDA approaches, the impact of the underlying GNN architecture has received limited attention. In this work, we explore this orthogonal direction, i.e., how to facilitate GDA with architectural enhancement. In particular, we consider a class of GNNs that are designed explicitly based on optimization problems, namely unfolded GNNs (UGNNs), whose training process can be represented as bi-level optimization. Empirical and theoretical analyses demonstrate that when transferring from the source domain to the target domain, the lower-level objective value generated by the UGNNs significantly increases, resulting in an increase in the upper-level objective as well. Motivated by this observation, we propose a simple yet effective strategy called cascaded propagation (CP), which is guaranteed to decrease the lower-level objective value. The CP strategy is widely applicable to general UGNNs, and we evaluate its efficacy with three representative UGNN architectures. Extensive experiments on five real-world datasets demonstrate that the UGNNs integrated with CP outperform state-of-the-art GDA baselines.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper is mainly dedicated to solving the key challenges in **Graph Domain Adaptation (GDA)**. Specifically, it focuses on how to improve performance by enhancing the architecture of Graph Neural Networks (GNNs) when transferring knowledge between different domains. The following are the core problems of the paper: 1. **Distribution change problems in domain transfer**: - In real - world applications, when migrating from the source domain to the target domain, the situation where labels are unavailable is often encountered. This leads to changes in node features, structural patterns, and task label distributions, thus hindering the effective transfer of knowledge. - Existing GDA methods mainly focus on aligning the node embedding distributions of the source and target domains, but ignore the influence of the underlying GNN architecture. 2. **The influence of GNN architecture on domain adaptation**: - The paper points out that most of the existing research ignores the influence of the GNN architecture itself on domain adaptation. The author believes that by improving the GNN architecture, the distribution change problems in domain transfer can be better addressed. 3. **The application of Unfolded Graph Neural Networks (UGNNs)**: - The author selects a class of GNNs designed based on optimization problems, namely UGNNs, whose training process can be represented as a bi - level optimization problem. This type of network has high transparency and is convenient for analysis and improvement. 4. **Proposing the Cascaded Propagation (CP) strategy**: - The paper proposes a simple and effective strategy - Cascaded Propagation (CP), which aims to reduce the value of the lower - level objective function, thereby improving the performance of the model in the target domain. - The CP strategy ensures the decrease of the lower - level objective function value by re - injecting the output of the lower - level problem as input, and may further reduce the value of the higher - level loss function. ### Summary The main objective of this paper is to improve the performance of Graph Domain Adaptation (GDA) tasks by improving the architecture of UGNNs, especially by introducing the CP strategy. Through theoretical analysis and experiments, the author proves that the CP strategy can effectively reduce the value of the lower - level objective function and achieves better results than existing GDA methods on multiple real - world datasets.

Domain Adaptive Unfolded Graph Neural Networks

Can Modifying Data Address Graph Domain Adaptation?

Rethinking Propagation for Unsupervised Graph Domain Adaptation

TO-UGDA: target-oriented unsupervised graph domain adaptation

Towards Understanding Graph Neural Networks: An Algorithm Unrolling Perspective

Revisiting, Benchmarking and Understanding Unsupervised Graph Domain Adaptation

Source Free Unsupervised Graph Domain Adaptation

Gradually Vanishing Gap in Prototypical Network for Unsupervised Domain Adaptation

Domain Adaptive Graph Classification

Investigating Out-of-Distribution Generalization of GNNs: An Architecture Perspective

Source Free Graph Unsupervised Domain Adaptation

Graph-Relational Domain Adaptation

NI-UDA: Graph Adversarial Domain Adaptation from Non-shared-and-Imbalanced Big Data to Small Imbalanced Applications

Ada-GNN: Adapting to Local Patterns for Improving Graph Neural Networks

Directed Acyclic Graph Neural Networks

Upcycling Models under Domain and Category Shift

OpenGDA: Graph Domain Adaptation Benchmark for Cross-network Learning

Graph Domain Adaptation: Challenges, Progress and Prospects

A Unified View on Graph Neural Networks as Graph Signal Denoising

AKE-GNN: Effective Graph Learning with Adaptive Knowledge Exchange

Domain-Aware Graph Network for Bridging Multi-Source Domain Adaptation