Abstract:Traditional in-memory graph systems often suffer from scalability due to the limited capacity and volatility of DRAM. Emerging non-volatile memory (NVM) provides an opportunity to achieve highly scalable and high-performance graph stores for its large capacity and persistence characteristics. However, directly deploying current in-memory graph storage systems on NVM would cause significant inefficiencies in NVM access, as their graph organization designed for DRAM may incur higher write amplification, crash inconsistency and costly concurrency control overhead in NVM for write-intensive work-loads. In this paper, we propose FTGraph, a Flexible Tree-based Graph storage system, for both efficient dynamical graph updates and analysis. To achieve this goal, we introduce a novel degree-aware suffix bit tree to effectively manage vertices and edges of the graph, enabling adaptability to real-world power-law degree distributions while significantly reducing NVM writes. Based on it, we adopt two optimization methods, logical vertex ID translation and sequential storage, for vertices with very high degrees within the tree to enhance graph analysis operations. We further integrate 8B NVM atomic writes with optimistic version-based concurrency control through a dual bitmap design to ensure low-overhead, log-free crash consistency and reduce read-writer contention. Experimental results show that FTGraph achieves up to $\mathbf{21.2}\times$ higher update performance and up to $\mathbf{85.4}\times$ higher analysis performance, compared with state-of-the-art dynamic graph systems implemented on NVMs.

Wind-Bell Index: Towards Ultra-Fast Edge Query for Graph Databases.

Understanding Energy Efficiency of Databases on Single Board Computers for Edge Computing

GraphChi-DB: Simple Design for a Scalable Graph Database System -- on Just a PC

Graph indexing for large networks: A neighborhood tree-based approach.

Graph Database Indexing Using Structured Graph Decomposition.

Building a High-Performance Graph Storage on Top of Tree-Structured Key-Value Stores

G-SQL: Fast Query Processing via Graph Exploration.

Efficient Index for Temporal Core Queries over Bipartite Graphs

NXgraph: an Efficient Graph Processing System on a Single Machine

A+ Indexes: Tunable and Space-Efficient Adjacency Lists in Graph Database Management Systems

Integrating R-Tree Spatial Indexing as Subgraphs in Graph Database Management Systems

ByteGraph: A High-Performance Distributed Graph Database in ByteDance

GraphMiner

Scalable Mining of Large Disk-Based Graph Databases.

FTGraph: A Flexible Tree-Based Graph Store on Persistent Memory for Large-Scale Dynamic Graphs

LSMGraph: A High-Performance Dynamic Graph Storage System with Multi-Level CSR

Demystifying Graph Databases: Analysis and Taxonomy of Data Organization, System Designs, and Graph Queries

AeonG: An Efficient Built-in Temporal Support in Graph Databases

Distributed Graph Layout for Scalable Small-world Network Analysis

BiFennel: Fast Bipartite Graph Partitioning Algorithm for Big Data

EmptyHeaded: A Relational Engine for Graph Processing