Towards Persistent Storage and Retrieval of Domain Models using Graph Database Technology

Nico Hochgeschwender,Holger Voos,Gerhard K. Kraetzschmar

DOI: https://doi.org/10.48550/arXiv.1607.04138

IF: 3.7

2016-02-19

Robotics

Abstract:We employ graph database technology to persistently store and retrieve robot domain models.

What problem does this paper attempt to address?

Empowering Domain-Specific Language Models with Graph-Oriented Databases: A Paradigm Shift in Performance and Model Maintenance

Ricardo Di Pasquale,Soledad Represa

2024-10-05

Abstract:In an era dominated by data, the management and utilization of domain-specific language have emerged as critical challenges in various application domains, particularly those with industry-specific requirements. Our work is driven by the need to effectively manage and process large volumes of short text documents inherent in specific application domains. By leveraging domain-specific knowledge and expertise, our approach aims to shape factual data within these domains, thereby facilitating enhanced utilization and understanding by end-users. Central to our methodology is the integration of domain-specific language models with graph-oriented databases, facilitating seamless processing, analysis, and utilization of textual data within targeted domains. Our work underscores the transformative potential of the partnership of domain-specific language models and graph-oriented databases. This cooperation aims to assist researchers and engineers in metric usage, mitigation of latency issues, boosting explainability, enhancing debug and improving overall model performance. Moving forward, we envision our work as a guide AI engineers, providing valuable insights for the implementation of domain-specific language models in conjunction with graph-oriented databases, and additionally provide valuable experience in full-life cycle maintenance of this kind of products.

Artificial Intelligence,Databases,Machine Learning
Design and Implementation of Underlying Storage for Graph Engine

Hongbin MA,Guihai CHEN

DOI: https://doi.org/10.3969/j.issn.1000-3428.2014.11.012

2014-01-01

Abstract:Graph applications rise with the emerging of social network and semantic Web,and generate many graph data processing products,including Neo4j,HyperGraphDB,etc. However,current solutions fail to take into consideration graph applications’ higher requirements on data availability and scalability. This paper proposes a modeling and storage solution based on distributed memory cloud. It takes advantage of the prior work to build a key-value system over the memory cloud,then builds data modeling and read-write based on it. Experimental results on large scaled datasets show that this solution has a good figure random access performance,and it can support massive graph applications efficiently.
NEST: Node with Statistics Tree for IoT Data Persistence and Real-time Queries

Jiahua Huang,Chun Cao,Jun Ma,Xiaoxing Ma

DOI: https://doi.org/10.1145/3671016.3671393

2024-01-01

Abstract:Data persistence is a critical foundation for Internet of Things (IoT), it provides the capability of data collection from IoT devices and pulls out these data by queries for applications to consume. In most cases, both the relationship between devices and the metrics on devices are required, so polyglot persistence systems consisting of graph databases and time series databases are deployed for data persistence. However, as the scale of IoT device network continues to grow, polyglot persistence finds it hard to achieve the need of real-time queries demanded by query-bound applications like artificial intelligence in IoT, which is where multi-model database be proficient in. In this article, we introduce NEST, a clustered tree index with statistics stored on its nodes, which is designed to solve the problem of real-time queries in query-bounding scenarios. We implement NEST on the open-source multi-model database ArcadeDB, using its document model to persist time series data together with graph model, which allows NEST to manage both graph model and time series model in a single database. NEST can process queries two times faster compared to polyglot persistence and other data models under IoT scenarios, providing data persistence support to IoT query-bound use cases.
SparkRDF: Elastic Discreted RDF Graph Processing Engine with Distributed Memory

Xi Chen,Huajun Chen,Ningyu Zhang,Songyang Zhang

DOI: https://doi.org/10.1109/wi-iat.2015.186

2014-01-01

Abstract:With the explosive growth of semantic data on the Web over the past years, many large-scale RDF knowledge bases with billions of facts are generating. This poses significant challenges for the storage and query of big RDF graphs. Current systems still have many limitations in processing big RDF graphs including scalability and real-time. In this paper, we introduce the SparkRDF, an elastic discreted RDF graph processing engine with distributed memory. To reduce the high I/O and communication cost in distributed processing platforms, SparkRDF implements SPARQL query based on Spark, a novel in-memory distributed computing framework for big data processing. All the intermediate results are modeled as Resilient Discreted SubGraph, which are cached in the distributed memory to support fast iterative join operations. To cut down the search space and avoid the overhead of memory, we split the RDF graph into the small Multi-layer Elastic SubGraph based on the relations and classes. For SPARQL query optimization, SparkRDF deploys a serials of optimization strategies, leading to effective reduction on the size of intermediate results, the number of joins and the cost of communication. Our extensive evaluation demonstrates that SparkRDF can efficiently implement non-selective joins faster than both current state-of-the-art distributed and centralized stores, while being able to process other queries in real time, scaling linearly to the amount of data.
Future Robotics Database Management System along with Cloud TPS

Vijaykumar S,Saravanakumar S G

DOI: https://doi.org/10.48550/arXiv.1112.2026

2011-12-09

Abstract:This paper deals with memory management issues of robotics. In our proposal we break one of the major issues in creating humanoid. . Database issue is the complicated thing in robotics schema design here in our proposal we suggest new concept called NOSQL database for the effective data retrieval, so that the humanoid robots will get the massive thinking ability in searching each items using chained instructions. For query transactions in robotics we need an effective consistency transactions so by using latest technology called CloudTPS which guarantees full ACID properties so that the robot can make their queries using multi-item transactions through this we obtain data consistency in data retrievals. In addition we included map reduce concepts it can splits the job to the respective workers so that it can process the data in a parallel way.

Databases,Robotics
Graph-Based RDF Data Management

Lei Zou,M. Tamer Özsu

DOI: https://doi.org/10.1007/s41019-016-0029-6

2017-01-01

Data Science and Engineering

Abstract:The increasing size of RDF data requires efficient systems to store and query them. There have been efforts to map RDF data to a relational representation, and a number of systems exist that follow this approach. We have been investigating an alternative approach of maintaining the native graph model to represent RDF data, and utilizing graph database techniques (such as a structure-aware index and a graph matching algorithm) to address RDF data management. Since 2009, we have been developing a set of graph-based RDF data management systems that follow this approach: gStore, gStore-D and gAnswer. The first two are designed to support efficient SPARQL query evaluation in a centralized and distributed/parallel environments, respectively, while the last one aims to provide an easy-to-use interface (natural language question/answering) for users to access a RDF repository. In this paper, we give an overview of these systems and also discuss our design philosophy.
Adaptive and transparent decision-making in autonomous robots through graph-structured world models

Site Hu,Takato Horii,Takayuki Nagai

DOI: https://doi.org/10.1080/01691864.2024.2415995

IF: 2.057

2024-10-20

Advanced Robotics

Abstract:The growing ubiquity of autonomous robots across different fields necessitates that agents adapt to diverse tasks and ensure transparency and intelligibility in their decision-making processes. This study presents a novel framework that combines a graph-structured world model with large language models (LLMs) to address these requirements. First, a latent space is created to capture the reachability between distinct states. Next, a graph is constructed within this latent space by clustering an offline dataset that effectively captures the complex dynamics of the environment. Subsequently, LLMs are employed to redefine the reward function and relabel the dataset, thereby establishing a well-defined Markov decision process based on the previously learned graph. This relabeling process ensures that the agent's decision space aligns with user intentions. Consequently, a predictive world model is obtained, offering insights into potential future states and facilitating graph-based planning. Moreover, by inputting the planned path of the agent in the graph-structured world model into LLMs, natural language explanations can be generated to provide transparency in the decision-making process. Experiments on the D4RL benchmark validated the effectiveness of our approach in long-horizon planning, its adaptability to different user tasks, and its inherent explainability.

robotics
A dynamic knowledge graph approach to distributed self-driving laboratories

Jiaru Bai,Sebastian Mosbach,Connor J. Taylor,Dogancan Karan,Kok Foong Lee,Simon D. Rihm,Jethro Akroyd,Alexei A. Lapkin,Markus Kraft

DOI: https://doi.org/10.1038/s41467-023-44599-9

IF: 16.6

2024-01-23

Nature Communications

Abstract:Abstract The ability to integrate resources and share knowledge across organisations empowers scientists to expedite the scientific discovery process. This is especially crucial in addressing emerging global challenges that require global solutions. In this work, we develop an architecture for distributed self-driving laboratories within The World Avatar project, which seeks to create an all-encompassing digital twin based on a dynamic knowledge graph. We employ ontologies to capture data and material flows in design-make-test-analyse cycles, utilising autonomous agents as executable knowledge components to carry out the experimentation workflow. Data provenance is recorded to ensure its findability, accessibility, interoperability, and reusability. We demonstrate the practical application of our framework by linking two robots in Cambridge and Singapore for a collaborative closed-loop optimisation for a pharmaceutically-relevant aldol condensation reaction in real-time. The knowledge graph autonomously evolves toward the scientist’s research goals, with the two robots effectively generating a Pareto front for cost-yield optimisation in three days.

multidisciplinary sciences
Prototyping Autonomous Robotic Networks on Different Layers of RAMI 4.0 with Digital Twins

Alexander Barbie,Wilhelm Hasselbring,Niklas Pech,Stefan Sommer,Sascha Flögel,Frank Wenzhöfer

DOI: https://doi.org/10.1109/MFI49285.2020.9235210

2021-03-17

Abstract:In this decade, the amount of (industrial) Internet of Things devices will increase tremendously. Today, there exist no common standards for interconnection, observation, or the monitoring of these devices. In context of the German "Industrie 4.0" strategy the Reference Architectural Model Industry 4.0 (RAMI 4.0) was introduced to connect different aspects of this rapid development. The idea is to let different stakeholders of these products speak and understand the same terminology. In this paper, we present an approach using Digital Twins to prototype different layers along the axis of the RAMI 4.0, by the example of an autonomous ocean observation system developed in the project ARCHES.

Software Engineering
Construction and Application of the Knowledge Graph Method in Maintenance of Robot in Automotive Manufacturing Industry

Zongrui Jiang,Can Zhao,Yan Zhang,Haitao Ma,Dongdong Guo,Wenbo Du,Hao Peng

DOI: https://doi.org/10.1145/3632314.3632332

2023-12-09

Abstract:Based on the spare parts and structure data of industrial robots, the entity list of robot parts is established to form a query dictionary, and entity annotation is performed on the robot corpus by means of dictionary query, which reduces the cost of manual annotation and ensures the quality of annotation data. In the process of entity recognition training, Bert+Bilstm+CRF model structure is used to initially use 70% of the dictionary data for annotation, and the model is trained by iteratively increasing the annotation data in a continuous cycle, so that the model can extract all the entities in the robot corpus as much as possible. In addition, the material number/model information and PM maintenance content/strategy of the entity have been used as attributes of the entity. Meanwhile, the experience summarized by the failure model and effect analysis of industrial robots is fully utilized to connect the phenomena, causes and measures through the entities in order to build the industrial robot knowledge graph relationships. The constructed knowledge graph relationship is stored in a Neo4j graphical database, making it convenient for content retrieval and inquiry of application systems.In the industrial robot knowledge graph application side, the field maintenance personnel requirements are collected through a questionnaire survey and the requirements are classified into intent. A Bert+TextCNN structure model is built to realize the intention recognition of user inquiries. By combining entity recognition models and intent classification models, the system is able to better understand user inquiry needs, leading to the implementation of an intelligent maintenance system for industrial robots.

Computer Science,Engineering
Graph database-based network security situation awareness data storage method

Xiaoling Tao,Yang Liu,Feng Zhao,Changsong Yang,Yong Wang

DOI: https://doi.org/10.1186/s13638-018-1309-9

2018-12-01

EURASIP Journal on Wireless Communications and Networking

Abstract:With the rapid development of the Internet, network security situation awareness has attracted tremendous attention. In large-scale complex networks, network security situation awareness data presents the characteristics of large-scale, multi-source, and heterogeneous. Recently, much research work have been done on network security situation awareness. However, most of the existing methods store different types of data in different ways, which makes data query and analysis inefficient. To solve this problem, we propose a graph database-based hierarchical multi-domain network security situation awareness data storage method. In our scheme, we build a hierarchical multi-domain network security situation awareness model to divide the network into different domains, which can collect and dispose the awareness data more efficiently. Meanwhile, to unify our storage mode, we also define network security situation awareness data storage rules and methods based on graph database. Finally, extensive experiments on real datasets show that our proposed method is efficient compared to state-of-the-art storage models.

telecommunications,engineering, electrical & electronic
Managing Large Scale Native RDF Semantic Repository from the Graph Model Perspective

Gang Wu,Juanzi Li

2007-01-01

Abstract:We propose a set of solutions for managing a large scale RDF semantic repository from the perspective of RDF graph model. A native storage instead of relational database is used to hold RDF. Indices supporting regular path expres- sion, full-text retrieval and partial OWL Lite inference are built above the storage model. Semantic ranking for re- sources are provided as well. Categories and Subject Descriptors: H.3.3 (Informa- tion Storage and Retrieval): Information Search and Re- trieval
Suitability of Graph Database Technology for the Analysis of Spatio-Temporal Data

Sedick Baker Effendi,Brink van der Merwe,Wolf-Tilo Balke

DOI: https://doi.org/10.3390/fi12050078

2020-04-26

Future Internet

Abstract:Every day large quantities of spatio-temporal data are captured, whether by Web-based companies for social data mining or by other industries for a variety of applications ranging from disaster relief to marine data analysis. Making sense of all this data dramatically increases the need for intelligent backend systems to provide realtime query response times while scaling well (in terms of storage and performance) with increasing quantities of structured or semi-structured, multi-dimensional data. Currently, relational database solutions with spatial extensions such as PostGIS, seem to come to their limits. However, the use of graph database technology has been rising in popularity and has been found to handle graph-like spatio-temporal data much more effectively. Motivated by the need to effectively store multi-dimensional, interconnected data, this paper investigates whether or not graph database technology is better suited when compared to the extended relational approach. Three database technologies will be investigated using real world datasets namely: PostgreSQL, JanusGraph, and TigerGraph. The datasets used are the Yelp challenge dataset and an ambulance response simulation dataset, thus combining real world spatial data with realistic simulations offering more control over the dataset. Our extensive evaluation is based on how each database performs under practical data analysis scenarios similar to those found on enterprise level.
Customized Information and Domain-centric Knowledge Graph Construction with Large Language Models

Frank Wawrzik,Matthias Plaue,Savan Vekariya,Christoph Grimm

2024-09-30

Abstract:In this paper we propose a novel approach based on knowledge graphs to provide timely access to structured information, to enable actionable technology intelligence, and improve cyber-physical systems planning. Our framework encompasses a text mining process, which includes information retrieval, keyphrase extraction, semantic network creation, and topic map visualization. Following this data exploration process, we employ a selective knowledge graph construction (KGC) approach supported by an electronics and innovation ontology-backed pipeline for multi-objective decision-making with a focus on cyber-physical systems. We apply our methodology to the domain of automotive electrical systems to demonstrate the approach, which is scalable. Our results demonstrate that our construction process outperforms GraphGPT as well as our bi-LSTM and transformer REBEL with a pre-defined dataset by several times in terms of class recognition, relationship construction and correct "sublass of" categorization. Additionally, we outline reasoning applications and provide a comparison with Wikidata to show the differences and advantages of the approach.

Artificial Intelligence,Computation and Language
Enhancing Graph Representation of the Environment through Local and Cloud Computation

Francesco Argenziano,Vincenzo Suriani,Daniele Nardi

2023-09-22

Abstract:Enriching the robot representation of the operational environment is a challenging task that aims at bridging the gap between low-level sensor readings and high-level semantic understanding. Having a rich representation often requires computationally demanding architectures and pure point cloud based detection systems that struggle when dealing with everyday objects that have to be handled by the robot. To overcome these issues, we propose a graph-based representation that addresses this gap by providing a semantic representation of robot environments from multiple sources. In fact, to acquire information from the environment, the framework combines classical computer vision tools with modern computer vision cloud services, ensuring computational feasibility on onboard hardware. By incorporating an ontology hierarchy with over 800 object classes, the framework achieves cross-domain adaptability, eliminating the need for environment-specific tools. The proposed approach allows us to handle also small objects and integrate them into the semantic representation of the environment. The approach is implemented in the Robot Operating System (ROS) using the RViz visualizer for environment representation. This work is a first step towards the development of a general-purpose framework, to facilitate intuitive interaction and navigation across different domains.

Robotics,Artificial Intelligence
An Ontology and Knowledge Graph Infrastructure for Digital Library Knowledge Representation

Stefano Ferilli,Domenico Redavid

DOI: https://doi.org/10.1007/978-3-030-39905-4_6

2020-01-01

Abstract:New technologies for storing and handling knowledge provide unprecedented opportunities for enhanced fruition of digital libraries and archives. Going beyond document retrieval based on lexical content or metadata, using the context of documents, and/or of their content, may provide very new ways to put them in perspective and grasp a deeper understanding thereof, also for non-technical users.Several components are needed to support this new perspective: suitable ontological resources to describe such variated knowledge, collaborative tools to collect the precious knowledge scattered across many scholars and practitioners spread all over the world, and to store it in a knowledge base, fruition tools to make the collected knowledge available to all interested stakeholders (scholars, researchers, but also common people).This paper proposes the GraphBRAIN environment as a possible infrastructure. It is a general-purpose tool that allows its users to design and populate knowledge graphs, to collaboratively enrich them, and to exploit advanced fruition tools, consultation and analysis tools. Its functionality may also be provided as a set of Web services to end-user applications. An initial version of the ontology and knowledge graph for digital libraries and archives are also presented and discussed in the paper.
MillenniumDB: A Persistent, Open-Source, Graph Database

Domagoj Vrgoc,Carlos Rojas,Renzo Angles,Marcelo Arenas,Diego Arroyuelo,Carlos Buil Aranda,Aidan Hogan,Gonzalo Navarro,Cristian Riveros,Juan Romero

DOI: https://doi.org/10.48550/arXiv.2111.01540

2021-11-02

Databases

Abstract:In this systems paper, we present MillenniumDB: a novel graph database engine that is modular, persistent, and open source. MillenniumDB is based on a graph data model, which we call domain graphs, that provides a simple abstraction upon which a variety of popular graph models can be supported. The engine itself is founded on a combination of tried and tested techniques from relational data management, state-of-the-art algorithms for worst-case-optimal joins, as well as graph-specific algorithms for evaluating path queries. In this paper, we present the main design principles underlying MillenniumDB, describing the abstract graph model and query semantics supported, the concrete data model and query syntax implemented, as well as the storage, indexing, query planning and query evaluation techniques used. We evaluate MillenniumDB over real-world data and queries from the Wikidata knowledge graph, where we find that it outperforms other popular persistent graph database engines (including both enterprise and open source alternatives) that support similar query features.
Adapting to Non-Stationary Environments: Multi-Armed Bandit Enhanced Retrieval-Augmented Generation on Knowledge Graphs

Xiaqiang Tang,Jian Li,Nan Du,Sihong Xie

2024-12-10

Abstract:Despite the superior performance of Large language models on many NLP tasks, they still face significant limitations in memorizing extensive world knowledge. Recent studies have demonstrated that leveraging the Retrieval-Augmented Generation (RAG) framework, combined with Knowledge Graphs that encapsulate extensive factual data in a structured format, robustly enhances the reasoning capabilities of LLMs. However, deploying such systems in real-world scenarios presents challenges: the continuous evolution of non-stationary environments may lead to performance degradation and user satisfaction requires a careful balance of performance and responsiveness. To address these challenges, we introduce a Multi-objective Multi-Armed Bandit enhanced RAG framework, supported by multiple retrieval methods with diverse capabilities under rich and evolving retrieval contexts in practice. Within this framework, each retrieval method is treated as a distinct ``arm''. The system utilizes real-time user feedback to adapt to dynamic environments, by selecting the appropriate retrieval method based on input queries and the historical multi-objective performance of each arm. Extensive experiments conducted on two benchmark KGQA datasets demonstrate that our method significantly outperforms baseline methods in non-stationary settings while achieving state-of-the-art performance in stationary environments. Code and data are available at <a class="link-external link-https" href="https://github.com/FUTUREEEEEE/Dynamic-RAG.git" rel="external noopener nofollow">this https URL</a>

Artificial Intelligence,Computation and Language
Using A Conceptual Model To Transform Road Networks From Openstreetmap To A Graph Database

Dietrich Steinmetz,Daniel Dyballa,Hui Ma,Sven Hartmann

DOI: https://doi.org/10.1007/978-3-030-00847-5_22

2018-01-01

Abstract:We present a method for extracting road network data that has been crowdsourced in the OpenStreetMap project and transform it into a road network that is stored as a graph database. We propose an algorithm for the transformation, discuss opportunities for semantic enrichment of the road network, and for restricting the transformation to geographic regions of interest. Our approach is guided by a conceptual schema. To evaluate the practicability of our approach we have implemented it in a prototype tool, and conducted experiments that demonstrate the scalability.
Managing data of sensor-equipped transportation networks using graph databases

Erik Bollen,Rik Hendrix,Bart Kuijpers

DOI: https://doi.org/10.5194/gi-13-353-2024

2024-11-28

Geoscientific Instrumentation Methods and Data Systems

Abstract:In this paper, we are concerned with data pertinent to transportation networks , which model situations in which objects move along a graph-like structure. We assume that these networks are equipped with sensors that monitor the network and the objects moving along it. These sensors produce time series data , resulting in sensor networks. Examples are river, road, and electricity networks.

geosciences, multidisciplinary,meteorology & atmospheric sciences

Towards Persistent Storage and Retrieval of Domain Models using Graph Database Technology

Empowering Domain-Specific Language Models with Graph-Oriented Databases: A Paradigm Shift in Performance and Model Maintenance

Design and Implementation of Underlying Storage for Graph Engine

NEST: Node with Statistics Tree for IoT Data Persistence and Real-time Queries

SparkRDF: Elastic Discreted RDF Graph Processing Engine with Distributed Memory

Future Robotics Database Management System along with Cloud TPS

Graph-Based RDF Data Management

Adaptive and transparent decision-making in autonomous robots through graph-structured world models

A dynamic knowledge graph approach to distributed self-driving laboratories

Prototyping Autonomous Robotic Networks on Different Layers of RAMI 4.0 with Digital Twins

Construction and Application of the Knowledge Graph Method in Maintenance of Robot in Automotive Manufacturing Industry

Graph database-based network security situation awareness data storage method

Managing Large Scale Native RDF Semantic Repository from the Graph Model Perspective

Suitability of Graph Database Technology for the Analysis of Spatio-Temporal Data

Customized Information and Domain-centric Knowledge Graph Construction with Large Language Models

Enhancing Graph Representation of the Environment through Local and Cloud Computation

An Ontology and Knowledge Graph Infrastructure for Digital Library Knowledge Representation

MillenniumDB: A Persistent, Open-Source, Graph Database

Adapting to Non-Stationary Environments: Multi-Armed Bandit Enhanced Retrieval-Augmented Generation on Knowledge Graphs

Using A Conceptual Model To Transform Road Networks From Openstreetmap To A Graph Database

Managing data of sensor-equipped transportation networks using graph databases