Abstract:Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep learning, Graph Neural Networks (GNNs) have emerged as a cornerstone in Graph Machine Learning (Graph ML), facilitating the representation and processing of graph structures. Recently, LLMs have demonstrated unprecedented capabilities in language tasks and are widely adopted in a variety of applications such as computer vision and recommender systems. This remarkable success has also attracted interest in applying LLMs to the graph domain. Increasing efforts have been made to explore the potential of LLMs in advancing Graph ML's generalization, transferability, and few-shot learning ability. Meanwhile, graphs, especially knowledge graphs, are rich in reliable factual knowledge, which can be utilized to enhance the reasoning capabilities of LLMs and potentially alleviate their limitations such as hallucinations and the lack of explainability. Given the rapid progress of this research direction, a systematic review summarizing the latest advancements for Graph ML in the era of LLMs is necessary to provide an in-depth understanding to researchers and practitioners. Therefore, in this survey, we first review the recent developments in Graph ML. We then explore how LLMs can be utilized to enhance the quality of graph features, alleviate the reliance on labeled data, and address challenges such as graph heterogeneity and out-of-distribution (OOD) generalization. Afterward, we delve into how graphs can enhance LLMs, highlighting their abilities to enhance LLM pre-training and inference. Furthermore, we investigate various applications and discuss the potential future directions in this promising field.

LGM: Mining Frequent Subgraphs from Linear Graphs

JPMiner: Mining Frequent Jump Patterns from Graph Databases.

Mining Frequent Neighborhood Patterns in Large Labeled Graphs

A linear delay algorithm for enumerating all connected induced subgraphs

Extracting Frequent Connected Subgraphs from Large Graph Sets.

Mining Discriminative Subgraph Patterns from Structural Data

Efficient Mining of Frequent Subgraphs in the Presence of Isomorphism

Extract Frequent Pattern from Simple Graph Data.

Deterministic Graph-Walking Program Mining

GCG: Mining Maximal Complete Graph Patterns from Large Spatial Data

Large Graph Analysis in the GMine System

GTRACE-RS: Efficient Graph Sequence Mining using Reverse Search

Representation Learning for Frequent Subgraph Mining

SPIN: mining maximal frequent subgraphs from graph databases.

Efficient Mining Of Minimal Distinguishing Subgraph Patterns From Graph Databases

Graph Machine Learning in the Era of Large Language Models (LLMs)

Visual Graph Mining

Mining contextually meaningful subgraphs from a vertex-attributed graph

Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs

Graph Linearization Methods for Reasoning on Graphs with Large Language Models