Abstract:As the core building blocks of the Semantic Web, ontologies provide shared vocabularies and conceptual knowledge for specific application fields. At the same time, ontologies can restrict their individuals and relationships through their semantic schema. However, logical conflicts of an ontology are often inevitably unavoidable in actual application scenarios when the ontology contains any form of disjointness or negation. Generally, logical conflicts can be divided into incoherence and inconsistency. Reasoning with incoherent ontologies may obtain many redundant relationships, and incoherence is a potential cause of inconsistency which seriously affects the correctness of semantic reasoning Therefore, handling incoherence is imperative, which mainly involves the fields of conflicts detection, ontology repair and justification computation. Various incoherent ontologies are indispensable to evaluate the proposed methods for handling incoherence. We provide a survey of relevant research works to study the proposed construction methods of incoherent ontologies. It is observed that incoherent ontologies in existing works still have the following limitations: (1) Lots of web pages used to download ontologies were temporarily constructed are now inaccessible; (2) Most of the existing incoherent ontologies were constructed in a simple way such as randomly adding disjointness axioms or merging ontologies through their alignments without considering all possible incoherence cases. To address the limitations, we propose a general framework to construct incoherent ontologies and design a hybrid algorithm to instantiate this framework. With the implemented construction methods, a comprehensive benchmark containing 116 ontologies is constructed. In our evaluations, incoherent ontologies in the benchmark are measured with 11 classic metrics. We then compare 5 representative ontology debugging systems and 3 repair methods. The evaluation results reveal that these ontologies could reflect different characteristics of each ontology system and repair method. All observations could guide researchers to select incoherent ontologies. The availability of our benchmark makes a contribution to the community of ontology debugging and repair fields.

Measuring effectiveness of ontology debugging systems.

Study of Ontology Debugging Approaches Based on the Criterion Set BLUEI<Superscript>2</Superscript>CI

Interactive ontology debugging: Two query strategies for efficient fault localization

Direct computation of diagnoses for ontology debugging

Benchmark Construction and Experimental Evaluations for Incoherent Ontologies

"Automated Debugging Considered Harmful" Considered Harmful A User Study Revisiting the Usefulness of Spectra-Based Fault Localization Techniques with Professionals Using Real Bugs from Large Systems

A Graph-Based Approach to Ontology Debugging in DL-Lite

Debugging Ontology Mappings: A Static Approach

Exploring Duality on Ontology Debugging

Analysis on the Comparison of Ontology Evaluation Tools

A Dependency-Graph Based Approach for Finding Justification in OWL 2 EL1

RIO: Minimizing User Interaction in Ontology Debugging

Decomposition-Based Optimization For Debugging Of Inconsistent Owl Dl Ontologies

Graph-based Approaches to Debugging and Revision of Terminologies in DL-Lite

An Optimization Strategy for Debugging Incoherent Terminologies in Dynamic Environments

Completing and Debugging Ontologies: state of the art and challenges

Implementation and Evaluation of a Backtracking Algorithm for Finding All Justifications in OWL 2 EL.

Evaluating The Stability And Credibility Of Ontology Matching Methods

Extracting a Justification for OWL Ontologies by Critical Axioms

Constructive Justification Extraction for OWL Ontologies.

Obtaining Ontology Reasoner Serving for Discrete Mathematics Knowledge