Abstract:In the era of big data, the volume of semantic data grows rapidly. The large scale semantic data contains a lot of significant but often implicit information that needs to be derived by reasoning. The semantic data reasoning is a challenging process. On one hand, the traditional single-node reasoning systems can hardly cope with such large amount of data due to the resource limitations. On the other hand, the existing large scale reasoning systems are not very efficient and scalable due to the complexity of reasoning process. In this paper, we propose Cichlid, an efficient distributed reasoning engine for the widely-used RDFS and OWL Horst rule sets. Cichlid is built on top of Spark. It implements parallel reasoning algorithms with the Spark RDD programming model. Further, we proposed the optimized parallel RDFS reasoning algorithm from three aspects, including data partition model, the execution order of reasoning rules and removing of duplicated data. Then, for the parallel OWL reasoning process, we optimized the most time-consuming parts, including large-scale data join, the transitive closure computation and the equivalent relation computation. In addition to above optimizations at the reasoning algorithm level, we also optimized the inner Spark execution mechanism by proposing an off-heap memory storage mechanism for RDD. This system-level optimization patch has been accepted and integrated into Apache Spark 1.0. The experimental results show that Cichlid is around 10 times faster on average than the state-of-the-art distributed reasoning systems for both large scale synthetic and real-world benchmarks. The proposed reasoning algorithms and engine also achieve excellent scalability and fault tolerance.

Large-Scale Reasoning with OWL

Concise and Organized Perception Facilitates Large Language Models for Deductive Reasoning.

OWL reasoning over big biomedical data

Reasoning over RDF Knowledge Bases using Deep Learning

Paraconsistent Reasoning with OWL - Algorithms and the ParOWL Reasoner ?

Algorithms for Paraconsistent Reasoning with OWL

Pellet: A practical OWL-DL reasoner

Reasoning about semantic Web in Isabelle/HOL

Integrating Relational Databases with Semantic Web Ontologies : Reasoning and Query Answering using Views

Large Scale Semantic Rule-based Backward Chaining Reasoning on Spark

Concise and Organized Perception Facilitates Reasoning in Large Language Models

A Framework for Parallelizing OWL Classification in Description Logic Reasoners

Enhancing DLV for Large-Scale Reasoning

Scalable Distributed Ontology Reasoning Using DHT-Based Partitioning

REL: Working out is all you need

Cichlid: Efficient Large Scale RDFS/OWL Reasoning with Spark

Scaling Synthetic Logical Reasoning Datasets with Context-Sensitive Declarative Grammars

Towards Reasoning in Large Language Models: A Survey

Meta-Reasoning: Semantics-Symbol Deconstruction for Large Language Models

Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text

Plausible reasoning over large health datasets: A novel approach to data analytics leveraging semantics