Risk-Based Adaptive Group Testing of Web Services

Xiaoying Bai,Ron S. Kenett
2009-01-01
Abstract:Comprehensive testing is necessary to ensure the quality of complex web services that are loosely coupled, dynamic bound and integrated through standard protocols. Testing of such web services ca n be however very expensive due to the diversified us er requirements and the large numbers of service combinations delivered by the open platform. Group testing was introduced in our previous research as a selective testing technique to reduce test cost and improve test efficiencies. This paper proposes a ri sk- based approach to group test selection. With this approach test cases are categorized and scheduled with respect to the risks of their target service features. The paper reports a first attempt for an ontology-b ased quantitative risk assessment of semantic web servic es. The failure rate and the importance of services are estimated based on a complexity and dependency analysis of the ontology specified domain knowledge model and various service model. The paper also discusses the risk-based group testing process and strategies for ranking and ruling-out services of t he test groups, at each risk level. Runtime monitoring mechanism is incorporated to detect the dynamic changes in service configuration and composition so that the risks can be continuously adjusted online.
What problem does this paper attempt to address?