Abstract:With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models (LLMs) into a unified Model architecture (e.g., LLM as enhancer, LLM as collaborators, LLM as predictor) has emerged as a promising technological paradigm. The core of this new graph learning paradigm lies in the synergistic combination of GNNs' ability to capture complex structural relationships and LLMs' proficiency in understanding informative contexts from the rich textual descriptions of graphs. Therefore, we can leverage graph description texts with rich semantic context to fundamentally enhance Data quality, thereby improving the representational capacity of model-centric approaches in line with data-centric machine learning principles. By leveraging the strengths of these distinct neural network architectures, this integrated approach addresses a wide range of TAG-based Task (e.g., graph learning, graph reasoning, and graph question answering), particularly in complex industrial scenarios (e.g., supervised, few-shot, and zero-shot settings). In other words, we can treat text as a medium to enable cross-domain generalization of graph learning Model, allowing a single graph model to effectively handle the diversity of downstream graph-based Task across different data domains. This work serves as a foundational reference for researchers and practitioners looking to advance graph learning methodologies in the rapidly evolving landscape of LLM. We consistently maintain the related open-source materials at \url{<a class="link-external link-https" href="https://github.com/xkLi-Allen/Awesome-GNN-in-LLMs-Papers" rel="external noopener nofollow">this https URL</a>}.

Large Language Models on Graphs: A Comprehensive Survey

Large Language Models on Graphs: A Comprehensive Survey

A Survey of Large Language Models for Graphs

A Survey of Graph Meets Large Language Model: Progress and Future Directions

Evaluating Large Language Models on Graphs: Performance Insights and Comparative Analysis

A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applications

GPT4Graph: Can Large Language Models Understand Graph Structured Data ? an Empirical Evaluation and Benchmarking.

Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs

Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniques

Can Large Language Models Analyze Graphs like Professionals? A Benchmark, Datasets and Models

Graph Machine Learning in the Era of Large Language Models (LLMs)

Exploring the Potential of Large Language Models in Graph Generation

Integrating Graphs With Large Language Models: Methods and Prospects

Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Tasks

Large Language Models and Knowledge Graphs: Opportunities and Challenges

Large Language Model with Graph Convolution for Recommendation

GraphEval2000: Benchmarking and Improving Large Language Models on Graph Datasets

GraphLLM: Boosting Graph Reasoning Ability of Large Language Model

Large Language Models Meet NLP: A Survey

Graph Learning and Its Advancements on Large Language Models: A Holistic Survey