Abstract:Many automated system analysis techniques (e.g., model checking, model-based testing) rely on first obtaining a model of the system under analysis. System modeling is often done manually, which is often considered as a hindrance to adopt model-based system analysis and development techniques. To overcome this problem, researchers have proposed to automatically “learn” models based on sample system executions and shown that the learned models can be useful sometimes. There are however many questions to be answered. For instance, how much shall we generalize from the observed samples and how fast would learning converge? Or, would the analysis result based on the learned model be more accurate than the estimation we could have obtained by sampling many system executions within the same amount of time? Moreover, how well does learning scale to real-world applications? If the answer is negative, what are the potential methods to improve the efficiency of learning? In this work, we first investigate existing algorithms for learning probabilistic models for model checking and propose an evolution-based approach for better controlling the degree of generalization. Then, we present existing approaches to learn abstract models to improve the efficiency of learning for scalability reasons. Lastly, we conduct an empirical study in order to answer the above questions. Our findings include that the effectiveness of learning may sometimes be limited and it is worth investigating how abstraction should be done properly in order to learn abstract models.

A probabilistic learning approach for counterexample guided abstraction refinement

Learning Probabilistic Models for Model Checking: an Evolutionary Approach and an Empirical Study

Should We Learn Probabilistic Models for Model Checking? A New Approach and An Empirical Study.

Heuristic-Guided Abstraction Refinement

Effective Heuristics for Counterexample-Guided Abstraction Refinement

Integrating Evolutionary Computation with Abstraction Refinement for Model Checking

More anti-chain based refinement checking

Probabilistic Counterexample Guidance for Safer Reinforcement Learning (Extended Version)

Effective Predicate Abstraction for Program Verification

Counterexample-Guided Abstraction Refinement for Component-Based Systems

Learning Abstraction Selection for Bayesian Program Analysis

Model exploration and analysis for quantitative safety refinement in probabilistic B

Detecting spurious counterexamples efficiently in abstract model checking

Abstraction-Refinement for Hierarchical Probabilistic Models

Competent Predicate Abstraction in Model Checking.

Making Abstraction Refinement Efficient in Model Checking

A Maximum Weight Heuristic Method for Abstract State Computation

Counterexample-based refinement for a boundedness test for CFSM languages

State Abstraction via Deep Supervised Hash Learning

Finding Optimum Abstractions in Parametric Dataflow Analysis

Enabling Knowledge Refinement Upon New Concepts in Abductive Learning.