Specification-based Test Generation and Optimization Using Model Checking

Hongwei Zeng,Huaikou Miao,Jing Liu

DOI: https://doi.org/10.1109/TASE.2007.46

2007-01-01

Abstract:Symmetry reduction is a technique that can help alleviate the problem of state space explosion in model checking. The idea is to verify only a subset of states from each class (orbit) of symmetric states. This paper presents a framework for symmetry ...

What problem does this paper attempt to address?

Design of a Certifying Compiler Supporting Proof of Program Safety

Yiyun Chen,Lin Ge,Baojian Hua,Zhaopeng Li,Cheng Liu

DOI: https://doi.org/10.1109/TASE.2007.19

2007-01-01

Abstract:Symmetry reduction is a technique that can help alleviate the problem of state space explosion in model checking. The idea is to verify only a subset of states from each class (orbit) of symmetric states. This paper presents a framework for symmetry ...
Improving Combinability of Petri Nets with Inheritance, Aggregation and Association

Shengyuan Wang,Yuan Dong

DOI: https://doi.org/10.1109/TASE.2007.31

2007-01-01

Abstract:Symmetry reduction is a technique that can help alleviate the problem of state space explosion in model checking. The idea is to verify only a subset of states from each class (orbit) of symmetric states. This paper presents a framework for symmetry ...
SymMC: Approximate Model Enumeration and Counting Using Symmetry Information for Alloy Specifications.

Wenxi Wang,Yang Hu,Kenneth L. McMillan,Sarfraz Khurshid

DOI: https://doi.org/10.1145/3540250.3549161

2022-01-01

Abstract:Specifying and analyzing critical properties of software systems plays an important role in the development of reliable systems. Alloy is a mature tool-set that provides a first-order relational logic for writing specifications, and a fully automatic powerful backend for analyzing the specifications. It has been widely applied in areas including verification, security, and synthesis. Symmetry breaking is a useful approach for pruning the search space to efficiently check the satisfiability of combinatorial problems. As the backend solver of Alloy, Kodkod does the partial symmetry breaking (PaSB) for Alloy specifications. While full symmetry breaking remains challenging to scale, a recent study showed that Kodkod PaSB could significantly reduce the model counting time, albeit at the cost of producing only partial model counts. However, the desired term is either the isomorphic count under no symmetry breaking, or the non-isomorphic models/count under full symmetry breaking. This paper presents an approach called SymMC, which utilizes the symmetry information to compute all the desired terms for Alloy specifications. To make SymMC scalable, we propose approximate algorithms based on sampling to estimate the desired terms. We show that our proposed estimators have consistency and upper bound properties. To our knowledge, SymMC is the first approach that automatically approximates non-isomorphic model enumeration/counting for Alloy specifications. Thanks to the non-isomorphic model counting, SymMC also provides the first automatic quantification measurement on the solution space pruning ability of Kodkod PaSB. Furthermore, empirical evaluations show that SymMC provides a competitive isomorphic counting approach for Alloy specifications compared to the state-of-the-art model counters.
Symmetry reduction method for complicated system model based on decision diagrams

JI Ming-yu,WANG Hai-tao,CHEN Zhi-yuan,LI Yan-mei

DOI: https://doi.org/10.3969/j.issn.1000-7024.2013.10.062

2013-01-01

Abstract:To solve the state space explosion problem of model checking process for complicated stochastic systems,a symmetry reduction method based probabilistic model which supports the transition reward characteristics is proposed.The size of the state set in the original model is decreased by using the exclusive representation function of the state set equivalence relations and the traditional multi-terminal binary decision diagram is improved by adding the return characteristics which is used to represent the transition relations of probabilistic reward model,an efficient symmetric reduction algorithm is proposed for reduce transition relations based on transition matrix.The example result shows the feasibility and validity of the method.
Using model checking to generate test cases for class testing

Chenliang Liang,Changhai Nie,Baowen Xu,Zhenyu Chen

DOI: https://doi.org/10.3321/j.issn:1001-0505.2007.05.008

2007-01-01

Abstract:A novel approach is presented to generate test cases for class testing. The states and the behaviors of the object are extracted from the source code. Then the class under testing is characterized abstractly with a 4-tuple, which can be converted into an equivalent Kripke model. The coverage criteria are expressed by computer tree logic (CTL) formulae. Model checker generates witnesses automatically when verifying CTL formulae on that Kripke model. The witnesses can be converted into a test suite which satisfies the corresponding coverage criteria. Test cases are generated from source code directly, and the greedy method is used to reduce redundant test cases in order to save the cost of software testing. The experimental results show that test cases generated by the proposed approach can achieve high rate of coverage.
Self-adaptive Intrusion Detection System for Computational Grid

Jiancheng Ni,Zhishu Li,Jirong Sun,Jianchuan Xing

DOI: https://doi.org/10.1109/TASE.2007.44

2007-01-01

Abstract:Symmetry reduction is a technique that can help alleviate the problem of state space explosion in model checking. The idea is to verify only a subset of states from each class (orbit) of symmetric states. This paper presents a framework for symmetry ...
Specification guidelines to avoid the state space explosion problem

Jan Friso Groote,Tim W.D.M. Kouters,Ammar Osaiweran

DOI: https://doi.org/10.1002/stvr.1536

2014-05-12

Abstract:During the last two decades, we modelled the behaviour of a large number of systems. We noted that different styles of modelling had quite an effect on the size of the state spaces of the modelled systems. The differences were so substantial that some specification styles led to far too many states to verify the correctness of the model, whereas with other styles, the number of states was so small that verification was a straightforward activity. In this article, we summarize our experience by providing seven specification guidelines to keep state spaces small. For each guideline, we provide an application, generally from the realm of traffic light controllers, for which we provide a ‘bad’ model with a large state space, and a ‘good’ model with a small state space. The good and bad models are both suitable for their purpose but are not behaviourally equivalent. For all guidelines, we discuss circumstances under which it is reasonable to apply the guidelines. Copyright © 2014 John Wiley & Sons, Ltd. This paper provides seven guidelines that help in preventing the transition systems generated from behavioural process models to become extremely large. This is required to allow the models to be formally analysed. Experience teaches that this is essentially the only way to get such models correct.
Symbolic and Structural Model-Checking

Yann Thierry-Mieg

DOI: https://doi.org/10.48550/arXiv.2005.12911

2021-12-18

Abstract:Brute-force model-checking consists in exhaustive exploration of the state-space of a Petri net, and meets the dreaded state-space explosion problem. In contrast, this paper shows how to solve model-checking problems using a combination of techniques that stay in complexity proportional to the size of the net structure rather than to the state-space size. We combine an SMT based over-approximation to prove that some behaviors are unfeasible, an under-approximation using memory-less sampling of runs to find witness traces or counter-examples, and a set of structural reduction rules that can simplify both the system and the property. This approach was able to win by a clear margin the model-checking contest 2020 for reachability queries as well as deadlock detection, thus demonstrating the practical effectiveness and general applicability of the system of rules presented in this paper.

Distributed, Parallel, and Cluster Computing,Formal Languages and Automata Theory,Logic in Computer Science
Model Checking in Bits and Pieces

Kedar S. Namjoshi

DOI: https://doi.org/10.4204/EPTCS.129.25

2013-09-20

Abstract:Fully automated verification of concurrent programs is a difficult problem, primarily because of state explosion: the exponential growth of a program state space with the number of its concurrently active components. It is natural to apply a divide and conquer strategy to ameliorate state explosion, by analyzing only a single component at a time. We show that this strategy leads to the notion of a "split" invariant, an assertion which is globally inductive, while being structured as the conjunction of a number of local, per-component invariants. This formulation is closely connected to the classical Owicki-Gries method and to Rely-Guarantee reasoning. We show how the division of an invariant into a number of pieces with limited scope makes it possible to apply new, localized forms of symmetry and abstraction to drastically simplify its computation. Split invariance also has interesting connections to parametric verification. A quantified invariant for a parametric system is a split invariant for every instance. We show how it is possible, in some cases, to invert this connection, and to automatically generalize from a split invariant for a small instance of a system to a quantified invariant which holds for the entire family of instances.

Logic in Computer Science
Improving Discrete Model Representations via Symmetry Considerations

Hanif D. Sherali,J. Cole Smith

DOI: https://doi.org/10.1287/mnsc.47.10.1396.10265

IF: 5.4

2001-10-01

Management Science

Abstract:In this paper, we focus on a useful modeling concept that is frequently ignored while formu lating discrete optimization problems. Very often, there exists a natural symmetry inherent in the problem itself that, if propagated to the model, can hopelessly mire a branch-and-bound solver by burdening it to explore and eliminate such alternative symmetric solutions. We discuss three applications where such a symmetry arises: a telecommunications network design problem, a noise pollution problem, and a machine procurement and operation problem. For each case, we identify the indistinguishable objects in the model that create the problem symmetry and show how imposing certain decision hierarchies within the model significantly enhances its solvability, while using a popular modern-day commercial branch-and-cut software (CPLEX 6.5).

management,operations research & management science
Optimized symbolic model checking for component-based systems

Lianyi Zhang,Qingdi Meng,Guiming Luo

DOI: https://doi.org/10.1109/ICCI-CC.2014.6921486

2014-01-01

Abstract:Symbolic model checking with BDDs is a very effective model checking technique, which can prove (or disprove) the existence of a counterexample by the symbolic computation of reachable states sets of systems. However, the memory and time are consumed seriously by the symbolic computations for component-based systems. The BDD-based symbolic model checking for component-based systems is considered in this paper. Firstly, a method of partitioned transition relation is given. Then an algorithm is proposed to partition the variables of transitions into separate value-changed and value-unchanged sets. The memory can be reduced and the runtime is also improved and verified by some experiments.
Abstraction-based model checking programs

Junyan Qian,Baowen Xu,Yingzhou Zhang

2007-01-01

Journal of Computational Information Systems

Abstract:Model checking is an automatic formal verification technique for a finite state system. Iterative abstraction refinement has emerged recently as the leading approach to software model checking. We present a methodology for automatically verifying programs against safety specifications based on finite state machine. As the first step, an initial abstract model is automatically extracted from source code using predicate abstraction and theorem proving. In order to reduce time complexities of this process, we partition the set of candidate predicates into subsets, and then construct abstract model independently.
Positive and Negative Testing with Mutation-Driven Model Checking

Zhenyu Chen,Axel Hollmann

2008-01-01

Abstract:Mutation-driven test case generation with model checking has been proposed to reduce the costs of specification-based mutation analysis. Most of the existing work focuses on verifying the expected behaviors in the original model, i.e. positive testing. In this paper negative testing is introduced to check the unexpected behaviors. Mutants are divided into three types: increscent, decrescent, and cross ones. Both, positive and negative testing is proposed to guarantee the detection of these mutants. A non-trivial example illustrates and validates our approach.
An Effective Model Extraction Method with State Space Compression for Model Checking SystemC TLM Designs

Yanyan Gao,Xi Li

DOI: https://doi.org/10.1109/samos.2013.6621107

2013-01-01

Abstract:SystemC has become a de-facto standard language for SoC and ASIP designs. The verification of implementation with SystemC is the key to guarantee the correctness of designs and prevent the errors from propagating to the lower levels. The gap between SystemC TLM model and its corresponding formal model makes it hard to perform automated translation between them. SystemC describes process behavior in sequential statements and usually employs intermediate variables, while most model checking languages for hardware only describe parallel behaviors, in which the usage of intermediate variables not only increases state space and may prolong execution time, but also introduce potential errors. For a model checking language which supports parallel description, the elimination of redundant intermediate variables is requisite and also an efficient way to reduce the state space. This paper intends to solve these issues: (1) proposing an extraction method that can implement the translation from a description which supports sequential execution to a description supports parallel execution; (2) identifying and removing redundant intermediate variables. In this paper, a novel mechanism is presented to automatically extract behavior description from SystemC to a widespreadly used model checking language SMV. We have implemented a tool SC2SMV and performed actual extraction process on it to demonstrate the effectiveness of the method presented in this paper.
Accelerating Software Model Checking Based on Program Backbone.

Kuanjiu Zhou,Jiawei Yong,Xiaolong Wang,Longtao Ren,Gang Hou,Junwang Chang

DOI: https://doi.org/10.1007/978-3-642-45293-2_26

2013-01-01

Abstract:Model checking technique has been gradually applied to verify the reliability of software systems. However, as to software with large scale and complex structure, the verification procedure suffers from the state space explosion, thus leading to a low efficiency or resource exhaustion. In this paper, we propose a method of accelerating software model checking based on program backbone to verify the properties in ANSI-C source codes. We prune the program with respect to the assertion property, and compress the circular paths by maximal strongly connected components to extract the program backbone. Subsequently, the Hoare theory is used to generate an invariant from the compressed circular nodes, which reduces the length of path encoding. The assertion property is finally translated into a quantifier-free formula and checked for satisfiability by the SMT solver Z3. The experiments show that this method substantially improves the efficiency of program verification.
A study on symmetry properties in structural optimization

Xu Guo Zongliang Du,Gengdong Cheng

2013-01-01

Abstract:Symmetry is a very important property for structure design owing to the convenience in theoretical analysis, numerical computation and manufacturability. So a question, which has received considerable attentions in structural optimization fields, emerges naturally: whether the optimal solution of a symmetric optimization problem is symmetric? In a review article, Prof. Rozvany (2011) presented a number of conjectures concerning the fundamental properties of exact optimal topologies and concluded that for a particular class of problems satisfied some specific restrictions, at least one optimal topology is symmetric if the external loads, the boundary of the design domain and the support conditions are all symmetric. In the present work, symmetry properties of a class of optimization problems are revisited from a more general point of view. The main finding is that not the linearity but quasi-convexity is a key point to guarantee the existence of symmetric solutions for symmetric optimization problems. Our analysis verdicts a conclusion that under some invariant assumptions, for a large class of structural optimization problems that can be formulated as quasi-convex programs, there is at least one symmetric global optimal solution if the prescribed loading and support conditions are symmetric. With this conclusion, the conjectures in Rozvany (2011) can be seen as the special cases and the existence of symmetric global optimum for a larger class of optimization problems can be proved. Some concrete examples with analytical solutions verify our proposition sufficiently. Moreover, through a practical structural optimization example that the global optimum of a symmetric optimization problem which is not quasi-convex may be highly asymmetric illustrates that the significance of quasi-convexity for guarantee the symmetry property of optimal solution. So heuristic symmetry reductions without serious theoretical analysis are inadvisable and may result in strongly suboptimal solutions. Furthermore, the symmetry analyses of robust and discrete structural optimization problems, which are seldom touched in the literature, are also discussed based on the former proposition. Besides, for some specific non-convex problems, based on the results of sequential convexification, it is proved that at least one of the K-K-T points of the optimization problem is symmetric as long as the optimization problem
Interpolation-Based Multi-core Bounded Model Checking of HSTM Designs.

Kun Liu,Xiaozhen Zhang,Weiqiang Kong,Gang Hou,Masahiko Watanabe,Akira Fukuda

DOI: https://doi.org/10.1109/dsa.2019.00013

2020-01-01

Abstract:Bounded model checking, an effective way to reduce the state space, plays a significant role in verifying the reliability of a system. By combining bounded model checking and interpolation sequence, the verification of the properties out of some certain boundary can be completed. However, the introduction of interpolation-sequence increases the complexity of the model encoding and then affects the overall performance of a model checker. In order to alleviate the problem, we propose interpolation-based multi-core bounded model checking technology. Decomposing large problems into small ones, multicore parallel solutions can effectively shorten the elapsed time of problem processing. According to the conditional predicates, the paths in the model are divided into path clusters, and the interpolation sequence is used to determine if there is no counterexample path in each path cluster. Based on the nature of fixpoint in the path cluster, we propose a path cluster pruning algorithm in order to reduce the scale of the state space to be searched, which contributes to improving the efficiency. In this paper, we also present two optimization methods: incremental encoding and verification hypothesis. We have implemented the algorithms in the verification of the Hierarchical State Transition Matrix (HSTM) model design, and the experimental results have shown that our method have significantly increase the credibility of the verification results.
A Relation-Based Method Combining Functional and Structural Testing for Test Case Generation

Shaoying Liu,Yuting Chen

DOI: https://doi.org/10.1016/j.jss.2007.05.036

IF: 3.5

2008-01-01

Journal of Systems and Software

Abstract:Specification-based (or functional) testing enables us to detect errors in the implementation of functions defined in specifications, but since specifications are often incomplete in practice for some reasons (e.g., lack of ideas, no time to write), it is unlikely to be sufficient for testing all parts of corresponding programs. On the other hand, implementation-based (or structural) testing focuses on the examination of program structures, which allows us to test all parts of the programs, but may not be effective to show whether the programs properly implement the corresponding specifications. To perform a comprehensive testing of a program in practice, it is important to adopt both specification-based and implementation-based testing. In this paper we describe a relation-based test method that combines the specification-based and the implementation-based testing approaches. We establish a set of relations for test case generation, illustrate how the method is used with an example, and investigate the effectiveness and weakness of the method through an experiment on testing a software tool system.
A Method Combining Review and Testing for Verifying Software Systems

Yuting Chen,Shaoying Liu,W. Eric Wong

DOI: https://doi.org/10.1109/BMEI.2008.332

2008-01-01

Abstract:The application of specification-based program verification techniques (e.g., black-box testing, formal proof) faces strong challenges in practice when the gap between the structure of a specification and that of its program is large. This paper describes a method combining program review and testing to address these challenges. The essential idea of the combination is first to use a view-based program review approach to maintain consistency between the specification structure and the program structure, and then to use a view-based testing approach to dynamically check whether the program satisfies the functional requirements defined in the specification. Views are used to serve as the basis for reviewing structural consistency and for testing functional consistency.
A Review Approach to Detecting Violations of Consistency Between Specification and Program Structures.

Yuting Chen,Shaoying Liu,W. Eric Wong

DOI: https://doi.org/10.1142/s0218194008003994

2008-01-01

Abstract:The application of specification-based program verification techniques (e.g., black-box testing, formal proof) faces strong challenges in practice when the gap between the structure of a specification and that of its program is large. This paper describes a view-based program review approach to addressing these challenges. The essential idea of the approach is first to derive comparable views from the specification and program, and then detect and eliminate the violations of structural consistency in the program views on the basis of a set of criteria. We also developed a prototype tool to support the review approach, and conducted a case study to assess the effectiveness of the approach.

Specification-based Test Generation and Optimization Using Model Checking

Design of a Certifying Compiler Supporting Proof of Program Safety

Improving Combinability of Petri Nets with Inheritance, Aggregation and Association

SymMC: Approximate Model Enumeration and Counting Using Symmetry Information for Alloy Specifications.

Symmetry reduction method for complicated system model based on decision diagrams

Using model checking to generate test cases for class testing

Self-adaptive Intrusion Detection System for Computational Grid

Specification guidelines to avoid the state space explosion problem

Symbolic and Structural Model-Checking

Model Checking in Bits and Pieces

Improving Discrete Model Representations via Symmetry Considerations

Optimized symbolic model checking for component-based systems

Abstraction-based model checking programs

Positive and Negative Testing with Mutation-Driven Model Checking

An Effective Model Extraction Method with State Space Compression for Model Checking SystemC TLM Designs

Accelerating Software Model Checking Based on Program Backbone.

A study on symmetry properties in structural optimization

Interpolation-Based Multi-core Bounded Model Checking of HSTM Designs.

A Relation-Based Method Combining Functional and Structural Testing for Test Case Generation

A Method Combining Review and Testing for Verifying Software Systems

A Review Approach to Detecting Violations of Consistency Between Specification and Program Structures.