Abstract:Modeling an ontology is a hard and time-consuming task. Although methodologies are useful for ontologists to create good ontologies, they do not help with the task of evaluating the quality of the ontology to be reused. For these reasons, it is imperative to evaluate the quality of the ontology after constructing it or before reusing it. Few studies usually present only a set of criteria and questions, but no guidelines to evaluate the ontology. The effort to evaluate an ontology is very high as there is a huge dependence on the evaluator's expertise to understand the criteria and questions in depth. Moreover, the evaluation is still very subjective. This study presents a novel methodology for ontology evaluation, taking into account three fundamental principles: i) it is based on the Goal, Question, Metric approach for empirical evaluation; ii) the goals of the methodologies are based on the roles of knowledge representations combined with specific evaluation criteria; iii) each ontology is evaluated according to the type of ontology. The methodology was empirically evaluated using different ontologists and ontologies of the same domain. The main contributions of this study are: i) defining a step-by-step approach to evaluate the quality of an ontology; ii) proposing an evaluation based on the roles of knowledge representations; iii) the explicit difference of the evaluation according to the type of the ontology iii) a questionnaire to evaluate the ontologies; iv) a statistical model that automatically calculates the quality of the ontologies.

A Method of Ontology Evaluation Based on Coverage, Cohesion and Coupling

An Ontology Evaluation Method Based on Corpus

A Comparative Study on Three Ontology Mapping Methods in the Integration of Product Knowledge

Evaluate the Comprehensiveness of Ontology

Assess Content Comprehensiveness of Ontologies

The Study on Construction of Ontology Evaluation Metrics System

FOCA: A Methodology for Ontology Evaluation

An efficient multi-strategy ontology mapping method

Evaluation criteria of ontology integration method & its application

Analysis on the Comparison of Ontology Evaluation Tools

A Method for Evaluating the Quality of Web Service Based on Ontology

Evaluation System Research of an Ontology Mapping System

Evaluating The Stability And Credibility Of Ontology Matching Methods

Evaluate Retrieval Systems Based on Ontology Vocabulary.

A Survey of Ontology Construction Based on Folksonomy

A Domain Ontology Construction Method with Ontology Modification Effort Assessment

An Evaluation Framework for Domain Ontology

User Oriented Semi-automatic Method of Constructing Domain Ontology.

Ontology-based question expansion for question similarity calculation

A New Methodology for Building Ontology Based on Reusing the Heterogeneous Ontologies

Review on Wordnet-Based Ontology Construction in China