Maximizing agreement on diverse ontologies with "wisdom of crowds" relation classification

M. Zhitomirsky-Geffet,E. Erez
DOI: https://doi.org/10.1108/OIR-03-2014-0073
2014-08-21
Abstract:Purpose – Ontologies are defined as consensual formal conceptualisation of shared knowledge. However, the explicit overlap between diverse ontologies is usually very low since they are typically constructed by different experts. Hence, the purpose of this paper is to suggest to exploit “wisdom of crowds” to assess the maximal potential for inter-ontology agreement on controversial domains. Design/methodology/approach – The authors propose a scheme where independent ontology users can explicitly express their opinions on the specified set of ontologies. The collected user opinions are further employed as features for machine classification algorithm to distinguish between the consensual ontological relations and the controversial ones. In addition, the authors devised new evaluation methods to measure the reliability and accuracy of the presented scheme. Findings – The accuracy of the relation classification (90 per cent) and the reliability of user agreement annotations were quite high (over 90 per cent)....
What problem does this paper attempt to address?