An Approach of Iterative Partition Testing Based on Priority Sampling

Xiao-Fang ZHANG,Zong-Zhang ZHANG,Xiao-Yuan XIE,Yi-Cheng ZHOU
DOI: https://doi.org/10.11897/sp.j.1016.2016.02307
2016-01-01
Abstract:Random testing and partition-based testing are two important test case generation methods.Comparisons on the efficiency and effectiveness between these two methods have been a popular research area.As an enhanced version of random testing,Adaptive Random Testing (ART)aims to evenly spread test cases within the input domain,in order to achieve better failure detection effectiveness.This paper follows the intuition of ART that high diversity is helpful in detecting failures,and proposes a novel algorithm,named Iterative Partition Testing based on Priority Sampling (IPT-PS).IPT-PS iteratively divides the input domain into grids,and selects the center point of each grid as test case.Priority-based execution strategy is then applied on newly generated test cases in each round of iteration.Iterative partition and fixed-center-point sampling only require information of the input domain,while priority-based execution considers different spatial characteristics of test cases.All these three steps need trivial time cost,and help to sample test cases much more even than traditional fixed-size partition testing,such that betterfailure detection effectiveness can be achieved.We theoretically prove the upper bound of the effectiveness for our method,and conduct comprehensive empirical analysis.Our experimental results show that IPT-PS can achieve effectiveness as high as ART,but with time cost as low as random testing.
What problem does this paper attempt to address?