Abstract:Many automated system analysis techniques (e.g., model checking, model-based testing) rely on first obtaining a model of the system under analysis. System modeling is often done manually, which is often considered as a hindrance to adopt model-based system analysis and development techniques. To overcome this problem, researchers have proposed to automatically “learn” models based on sample system executions and shown that the learned models can be useful sometimes. There are however many questions to be answered. For instance, how much shall we generalize from the observed samples and how fast would learning converge? Or, would the analysis result based on the learned model be more accurate than the estimation we could have obtained by sampling many system executions within the same amount of time? Moreover, how well does learning scale to real-world applications? If the answer is negative, what are the potential methods to improve the efficiency of learning? In this work, we first investigate existing algorithms for learning probabilistic models for model checking and propose an evolution-based approach for better controlling the degree of generalization. Then, we present existing approaches to learn abstract models to improve the efficiency of learning for scalability reasons. Lastly, we conduct an empirical study in order to answer the above questions. Our findings include that the effectiveness of learning may sometimes be limited and it is worth investigating how abstraction should be done properly in order to learn abstract models.

Active model learning of stochastic reactive systems (extended version)

Learning Probabilistic Models for Model Checking: an Evolutionary Approach and an Empirical Study

Should We Learn Probabilistic Models for Model Checking? A New Approach and An Empirical Study.

Improving Probability Estimation Through Active Probabilistic Model Learning.

Learning Markov Decision Processes for Model Checking

Learning Probabilistic Automata for Model Checking

Automatically ‘verifying’ Discrete-Time Complex Systems Through Learning, Abstraction and Refinement

L*-Based Learning of Markov Decision Processes (extended Version)

Human in the Loop: Interactive Passive Automata Learning via Evidence-Driven State-Merging Algorithms

Improving active Mealy machine learning for protocol conformance testing

Learning Algorithms for Verification of Markov Decision Processes

What Are the Odds? Improving the foundations of Statistical Model Checking

Actively Learning Reinforcement Learning: A Stochastic Optimal Control Approach

State Matching and Multiple References in Adaptive Active Automata Learning

Enhancing Automata Learning with Statistical Machine Learning: A Network Security Case Study

Active vs. Passive: A Comparison of Automata Learning Paradigms for Network Protocols

An active learning method for solving competitive multi-agent decision-making and control problems

Small Test Suites for Active Automata Learning

Model Learning: a Survey of Foundations, Tools and Applications

Learning Parameterized State Machine Model for Integration Testing

Robust Active Measuring under Model Uncertainty