Abstract:Graph data in real-world scenarios undergo rapid and frequent changes, making it challenging for existing graph models to effectively handle the continuous influx of new data and accommodate data withdrawal requests. The approach to frequently retraining graph models is resource intensive and impractical. To address this pressing challenge, this paper introduces a new concept of graph memory learning. Its core idea is to enable a graph model to selectively remember new knowledge but forget old knowledge. Building on this approach, the paper presents a novel graph memory learning framework - Brain-inspired Graph Memory Learning (BGML), inspired by brain network dynamics and function-structure coupling strategies. BGML incorporates a multi-granular hierarchical progressive learning mechanism rooted in feature graph grain learning to mitigate potential conflict between memorization and forgetting in graph memory learning. This mechanism allows for a comprehensive and multi-level perception of local details within evolving graphs. In addition, to tackle the issue of unreliable structures in newly added incremental information, the paper introduces an information self-assessment ownership mechanism. This mechanism not only facilitates the propagation of incremental information within the model but also effectively preserves the integrity of past experiences. We design five types of graph memory learning tasks: regular, memory, unlearning, data-incremental, and class-incremental to evaluate BGML. Its excellent performance is confirmed through extensive experiments on multiple real-world node classification datasets.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to effectively handle the inflow of new data and the withdrawal requests of old data in dynamic graph data. Specifically, existing graph models have difficulty coping with constantly changing data streams, especially in cases where the model needs to be frequently retrained, which is not only resource - intensive but also impractical. Therefore, the paper proposes a new concept - Graph Memory Learning (GML), whose core idea is to enable the graph model to selectively remember new knowledge but forget old knowledge. Through this method, the paper aims to solve the challenges faced by existing graph models when dealing with continuous data inflow and data withdrawal requests, and improve the adaptability and efficiency of the model in dynamic graph data. ### Main contributions of the paper 1. **Define a new problem**: For the first time, attempt to define the new problem of Graph Memory Learning (GML), and propose a new GML paradigm inspired by the coupling of brain network dynamics and functional structure. 2. **Multi - granular hierarchical progressive learning mechanism**: The Multi - granular Hierarchical Progressive Learning (MGHPL) mechanism based on Feature Graph Grain Learning (FGGL) can alleviate the conflict between memory and forgetting in the local graph structure. 3. **Information Self - Assessment Ownership mechanism**: Propose an Information Self - Assessment Ownership (ISAO) mechanism to establish a reliable graph structure for new knowledge, enabling it to independently select the most appropriate graph granularity and neighbors. 4. **Experimental verification**: Conducted extensive experiments on five real - world node classification datasets for five tasks, and the results show that BGML significantly outperforms all baseline methods. ### Key technologies 1. **Multi - granular graph partitioning (MGP)**: - **Brain - inspired**: Similar to the brain's sensory system, different sensory organs receive different knowledge stimuli, convert them into neural signals and transmit them to different cortical areas of the brain for processing. - **MGP method**: Based on the common community detection Label Propagation Algorithm (LPA) or k - means clustering algorithm (k - means clustering, KM), divide the static graph \( G_0 \) into multiple granularities and establish a hierarchical structure of knowledge details. To alleviate the problem of uneven partitioning, use the balanced versions of BLPA and BEKM. 2. **Multi - granular hierarchical progressive learning mechanism (MGHPL)**: - **Brain - inspired**: The cognitive process of the brain involves the coordination of cortical partitions and a hierarchical progressive processing mechanism. When knowledge enters, the corresponding primary sensory area responds, and if the extracted features are not sufficient to provide an accurate judgment, the information is passed to the secondary partition for supplementation. - **MGHPL mechanism**: Through multi - granular graph partitioning (MGP) and feature graph granularity learning (FGGL), achieve in - depth understanding and hierarchical extraction of local graph information. 3. **Information Self - Assessment Ownership mechanism (ISAO)**: - **Brain - inspired**: Similar to the brain's synaptic remodeling mechanism, the ISAO mechanism helps incremental knowledge form a credible graph structure, protecting existing knowledge and saving computational resources. ### Summary The paper solves the problem of effectively handling the inflow of new data and the withdrawal requests of old data in dynamic graph data by introducing the Graph Memory Learning framework (BGML) inspired by the coupling of brain network dynamics and functional structure. This framework improves the adaptability and performance of the graph model in a dynamic environment through multi - granular graph partitioning, multi - granular hierarchical progressive learning mechanism and information self - assessment ownership mechanism.

Graph Memory Learning: Imitating Lifelong Remembering and Forgetting of Brain Networks

Sparsified Subgraph Memory for Continual Graph Representation Learning

Long Short-Term Graph Memory Against Class-imbalanced Over-smoothing

The storage capacity of a directed graph and nodewise autonomous, ubiquitous learning

Lifelong Learning With Cycle Memory Networks

MemMap: an Adaptive and Latent Memory Structure for Dynamic Graph Learning

Enhancing Graph Neural Networks via Memorized Global Information

Graph Continual Learning with Debiased Lossless Memory Replay

Autonomous and Ubiquitous In-node Learning Algorithms of Active Directed Graphs and Its Storage Behavior

Sample Efficient Reinforcement Learning Using Graph-Based Memory Reconstruction.

Overcome Anterograde Forgetting with Cycled Memory Networks

Lifelong Learning Process: Self-Memory Supervising and Dynamically Growing Networks

Holistic Memory Diversification for Incremental Learning in Growing Graphs

GraphMemDialog: Optimizing End-to-End Task-Oriented Dialog Systems Using Graph Memory Networks

MemoryPath: A Deep Reinforcement Learning Framework for Incorporating Memory Component into Knowledge Graph Reasoning

Modeling Biological Memory Network by an Autonomous and Adaptive Multi-Agent System

Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracing

Memory-Augmented Graph Neural Networks: A Brain-Inspired Review

Incremental Graph Classification by Class Prototype Construction and Augmentation

Overcoming Catastrophic Forgetting in Graph Neural Networks with Experience Replay