Comparative analysis of the syntactic and semantic consistency of terms in software testing glossaries

Luis Olsina,Philip Lew,Pablo Becker

DOI: https://doi.org/10.1007/s11219-023-09638-0

2023-05-17

Software Quality Journal

Abstract:This paper addresses terminological consistency issues of three software testing glossaries used in academia and industry. The evaluation focus mainly deals with a sub-characteristic of information quality such as consistency, which includes syntactic and semantic consistency. To systematically conduct this study, we have established a set of activities or steps. These include defining the evaluation goal and scope, selecting the glossaries, conceiving the terminological categories, classifying the glossary terms into categories, calculating syntactic and semantic similarities, analyzing consistency, and making recommendations. For instance, for the testing domain, eight terminological categories were conceived, in which, for each selected glossary, a corresponding term is included in a category, considering the semantics intended by the authors of these standard documents. To count the occurrence frequency of a term in the glossaries, a tool was built that also takes into account the matching of synonyms. Then, a comparative analysis of syntactic and semantic consistency was carried out for all the terms ending in the word "testing," which enables us to give recommendations. This exploratory study identifies some inconsistencies that might deserve further attention and efforts to promote agreement and harmonization among the authors/editors of these glossaries in order to provide their readers with the most consistent and easiest way to understand and learn software testing concepts.

computer science, software engineering