TEST SEQUENCE GENERATION OF PROTOCOL WITH SPONTANEOUS EVENTS

石勇军,屈玉贵,赵保华

2001-01-01

Abstract:Methods are developed to generate test sequence for conformance testing from finite state machine. However, those methods can not be applied to FSM with spontaneous events. In this paper, we propose a complementary step based on UIO method in order to handle spontaneous events in FSM. It has been used in OSPF protocol conformance testing.

What problem does this paper attempt to address?

Study of protocol conformance test sequence generation algorithm based on FSM

陈涛,潘雪增,陈健,陈小平,陆魁军

DOI: https://doi.org/10.3778/j.issn.1002-8331.2010.06.017

2010-01-01

Abstract:In the field of communication protocol conformance test,how to generate test sequences which satisfy the requirements is one of hot research.Due to the generated test sequences aren’t simple and efficient enough,after introducing FSM which is the main formal model of communication protocol,this paper first studys test sequence generation algorithm based on UIO,and then improves the original algorithm.Test sequences generated by the improved algorithm have higher fault coverage,and the length of test sequences has been shortened.
A New Method to Generate Test Sequences for Protocol Conformance Testing

Gao Xiang,Wang Xin

DOI: https://doi.org/10.13382/j.jemi.2007.02.022

2007-01-01

JOURNAL OF ELECTRONIC MEASUREMENT AND INSTRUMENT

Abstract:Automatic generation of test sequences is an important issue in conformance testing of communication protocols. The optimal-length test sequences with high fault coverage are of great importance in enhancing the efficiency of the whole testing system. This paper presents a new approach for generating test sequences automatically. In this approach, a mathematical module-FSM state graph for communication protocol is specified by incidence matrix; the concept of linear programming is introduced; symmetrical FSM graph is obtained by utilizing integer linear programming renovation, and finally the shortest traversal sequences are obtained by utilizing the Chinese Postman Traversal Algorithm. The UIO sequence for the initial state in the Euler loop or for the tail state in the Euler path is used as the checking sequence for the tail state of each transition. It is proved that this approach has feasibility and superiority .
Test Sequences Generation in Protocol Test

TUAN Bo,LI Jin,SUN Hai-bo,YANG Pan-long

2008-01-01

Abstract:Some test generation methods were presented based on the concept of the protocol conformance testing.Most attention was paid to the model based on FSM,and also such other models as EFSM and DFSM.The important theories and limitations in each method were pre- sented.Finally further problems to be studied in this field and the development trends were pointed out.
Test Sequence Generation of a Communication Protocol by an Heuristic State Configuration Exploration

舒挺,孙守迁,王海宁,徐伟强,李文书

DOI: https://doi.org/10.3969/j.issn.1007-5321.2009.06.026

2009-01-01

Abstract:Reachability analysis,which is widely used to generate executable protocol conformance test sequences,often causes state explosion problem.To overcome the problem,a heuristic state configuration exploration method is proposed.Using a weight extend finite state machine as a protocol model,the new method employs the heuristic state configuration exploration to replace the traditional strategy of breadth-first-search.In this way,the generation of executable protocol conformance test sequences is reformulated to find the minimum weight path in the whole state configuration space of a protocol implementation under test.The experiment results show that the proposed method is superior to breadth-first-search algorithm in time and space complexity.
A Test Sequence Generation Algorithm Based on Improved Transition Executability Analysis

ZHAO Bao-hua,CHEN Bo,QU Yu-gui

DOI: https://doi.org/10.3969/j.issn.0253-2778.2007.09.008

2007-01-01

Abstract:A method for testing protocols modeled by EFSM(extended finite state machine) was proposed,which can insure both the control flow and data flow to be covered by test sequences.The method uses UIO(unique input/output) sequences for control flow and all Def-use paths criterion for data flow.By means of improved transition executability analysis and extending a TEA(transition executability analysis) tree with depth-first strategy,it can generate executable test sequences both for control flow and data flow,as well as the Def-use pairs of all variables.
A New Method of Generation of Communication Protocol Test Sequence

孙宇霖,屈玉贵,赵保华

DOI: https://doi.org/10.3321/j.issn:1000-436x.2001.06.020

2001-01-01

Abstract:Protocol test is an important phase of protocol engineering.In this paper,first,a new method of generation of communication protocol test sequence is proposed.The method uses formal description technique based on constructed type algebra to describle specification of protocol and generates test sequence from the description of the specification.Secondly,the paper introduces this method with an example of describing part of the specification of stack and the test sequence is also generated.Thirdly,test sequence of stack is also generatied based on finite state machine(FSM) and the compare of the two method is put forward.Finially,conclusion is given that in some aspects,the two methods are equivalent,but the former one is better when deal with large state space.
Generation Method of Synchronous Test Sequence Based on Synchronous Digraph

孙宇霖,赵保华,屈玉贵

DOI: https://doi.org/10.3321/j.issn:0254-4164.2002.06.012

2002-01-01

Jisuanji Xuebao/Chinese Journal of Computers

Abstract:Two synchronization test problems are considered for an FSM: port-based testing, which does not allow testers for the FSM to communicate with each other, and group-based testing, which divides ports of the FSM into mutually disjoint groups and allows testers for ports in the same group to communicate with each other. This paper proposes a new synchronous test sequence generation method based on synchronous digraph, which is suitable for pair, port and group synchronization problem. A method to judge how to add external synchronization operations in a nonsynchronous test sequence to change it to synchronous one is also proposed.
A Novel Method Of State Identification Sequences Generation For Testing Communication Protocols Modeled As Extended Finite State Machines

Ting Shu,Shouqian Sun,HaiNing Wang

DOI: https://doi.org/10.1109/CAIDCD.2009.5374861

2009-01-01

Abstract:The existence of predicate and conditional statements of the protocol transition specified in EFSM model results in the generation of infeasible State Identification Sequence using traditional methods. Thus, how to automatically generate executable State Identification Sequences, in an efficient and effective way, becomes the critical issue for protocol conformance testing. In this paper, we present a novel method of executable state identification sequence generation used to preferably solve the executability problem of state identification sequences. Specifically, in terms of an executable analysis tree (EAT), the proposed method can ensure the executability of the generated state identification sequence. In a specific state identification scene, we can use a state projection subspace to simplify, the state identification work. At last, an example was performed to show that the new method is how to work effectively.
Path Overlapped Method for Protocol Conformance Test Generation

WANG Zhi-Bin,ZHOU Hao,ZHAO Bao-Hua

DOI: https://doi.org/10.3969/j.issn.1003-3254.2011.07.011

2011-01-01

Abstract:A new formal method named path overlapped method is proposed for protocol conformance test generation based on UIO sequences.The main idea is to find a path without repeating transition in FSM as a POTS(path overlapped transition sequence),which is a sequence of distinct transitions such that if it is followed by a UIO sequence for the end state of the last transition in the sequence then all the transitions in the sequence are verified.According to the theoretical and experimental results,the test sequences generated by the path overlapped method are substantially shorter than those generated by other methods employing UIO sequences.Particularly,because of employing path overlapped transition sequence as a substitute for FOTS(fully overlapped transition sequence) in OUIO,generation time of overlapped sequence is greatly decreased.
A test sequences optimization method for improving fault coverage

Qiang Wang,Shuai Wang,Yindong Ji

DOI: https://doi.org/10.1109/ICIME.2010.5478197

2010-01-01

Abstract:Conformance testing for communication protocol is an active research field. But most research on test sequences generation and optimization focus on how to reduce the length of a test sequence or the automatic generation process. Less attention has been paid on how to improve the fault coverage of test sequences. Many test sequence generation methods, such as UIO method, do not guarantee complete fault coverage. In this paper, we propose a test sequences optimization method to raise fault coverage of UIO method. In this method, some key test sequences will be added to the former test suit, based on fault coverage evaluation results. Results show that this method could effectively improve the fault coverage without re-generating the whole set of test sequences. The experimental results given in Section 4 show that it could help to detect more distinguishable FSMs than former testing methods. This optimization method could not only be used on test sequences generated by UIO method, but also be added as an extended section of many other generation methods to improve test sequences generated.
Interoperability Test Approach Based on ISM

郑斯琦,平玲娣,陈小平,顾文婷

DOI: https://doi.org/10.3969/j.issn.1000-3428.2010.03.024

2010-01-01

Abstract:Interoperability test, an approach of protocol test, is an important industrial test method while performing the interoperability of equipment from different vendors. Due to lack of formal test framework and test method, it is difficult to guarantee the reliability of entire test. After introducing a generic interoperability test model from ETSI, this paper presents an interoperability test method, which is based on an Interoperability State Machine(ISM), following with an example of an interoperability test which is designed for IPsec VPN environment, to show the effectiveness and feasibility of this method.
An improved protocol test generation procedure based on UIOS

W. Y. L. Chan,C. T. Vuong,M. R. Otp

DOI: https://doi.org/10.1145/75247.75274

IF: 1.937

1989-08-01

ACM SIGCOMM Computer Communication Review

Abstract:This paper shows the Unique Input/Output, UIO, approach and the Distinguishing Sequence, DS, approach for the conformance testing of protocol implementations do not always produce identical fault converges, contrary to a previous claim. In the UIO approach, when UIO sequences and signatures are not unique in an implementation, they may not be able to detect erroneous states in the implementation. The UIO approach is revised here with the addition of a verification procedure to ensure that the UIO sequences are all unique in an implementation. Since signatures are generally not unique, this revision requires substituting the use of a signature for a state, S, with a set of input/output sequences, IO(S,K)s, unique to S, each of which distinguishes S from at least one other state, K. Verification is then applied to the IO(S,K)s. Fault coverage in the revised UIO, UIOv, approach is better than that in the original approach. A uniqueness criterion is discussed here to capture a desirable fault coverage for finite-state machine, FSM, test sequences. This criterion ensures the detection of any faulty FSM implementation provided that its set of states does not exceed that in the specified FSM. It is shown that test sequences generated by the UIOv approach and the DS approach always satisfy the uniqueness criterion. In fact, the DS approach is a special case of the UIOv approach; however, the UIOv approach has wider applicability and is generally applicable to k-distinguishable FSMs.

computer science, information systems
Identification of ICS Security Risks Toward the Analysis of Packet Interaction Characteristics Using State Sequence Matching Based on SF-FSM

Jianxin Xu,Dongqin Feng

DOI: https://doi.org/10.1155/2017/2430835

IF: 1.968

2017-01-01

Security and Communication Networks

Abstract:This paper discusses two aspects of major risks related to the cyber security of an industrial control system (ICS), including the exploitation of the vulnerabilities of legitimate communication parties and the features abused by unauthorized parties. We propose a novel framework for exposing the above two types of risks. A state fusion finite state machine (SF-FSM) model is defined to describe multiple request-response packet pair sequence signatures of various applications using the same protocol. An inverted index of keywords in an industrial protocol is also proposed to accomplish fast state sequence matching. Then we put forward the concept of scenario reconstruction, using state sequence matching based on SF-FSM, to present the known vulnerabilities corresponding to applications of a specific type and version by identifying the packet interaction characteristics from the data flow in the supervisory control layer network. We also implement an anomaly detection approach to identifying illegal access using state sequence matching based on SF-FSM. An anomaly is asserted if none of the state sequence signatures in the SF-FSM is matched with a packet flow. Ultimately, an example based on industrial protocols is demonstrated by a prototype system to validate the methods of scenario reconstruction and anomaly detection.
np-FSM-based Distributed Protocol Virtual Multi-port Test Method

Xie Lei,Xi Quansheng,Wei Jiaolong,Zhu Guangxi

DOI: https://doi.org/10.16526/j.cnki.11-4762/tp.2011.01.049

2011-01-01

Abstract:In protocol engineering area,protocol testing is a very important task.The multi-port Finite State Machine(np-FSM) model is usually used in distributed protocol testing.As a result of controllability and observability problems,synchronization and coordination of test sequence of distributed protocol is needed.In this paper,an improved distributed test model is introduced.The virtual multi-port test method can greatly simplify the synchronization and coordination problems,and improve the test efficiency.
Automatic Test Generation Based on Hierarchical Finite State Machines

刘鸿,尹霞,吴建平

DOI: https://doi.org/10.3321/j.issn:1000-0054.2003.07.036

2003-01-01

Abstract:Conventional methods of te st ing hierarchical finite state machines (HFSMs) always first flatten them to finite state machines (FSMs) and then evaluate them using FSM testing methods. The famous state-explosion problem always arises in the process. Algorithms have been developed using hierarchical characteristics to solve the state-ex plosion problem for state synchronization sequences and verification sequences . Though a bit less feasible than conventional methods, the algorithms can be ap plied to almost all HFSM models in practice and achieve shorter sequences in les s time. An efficient test generation method was then developed based on these al gorithms for conformance testing of the multicast listener discovery (MLD) proto col.
Test Sequence Generation for Distributed Software System.

Shuai Wang,Yindong Ji,Shiyuan Yang

DOI: https://doi.org/10.4304/jsw.6.2.175-183

2011-01-01

Journal of Software

Abstract:This paper considers the test case generation for distributed software (a test case contains one or more test sequences). Applying the single finite state machine (FSM) test approach to distributed software, we will suffer from some problems: 1) the state combinatorial explosion problem; 2) some unexecutable test cases may be generated; 3) some fault may be masked and cannot be isolated accurately. This paper proposed a new test case generation method based on the FSM net model. Instead of testing the global transitions of product machine, the generated test cases are used to verify the local transitions. We discuss the detailed methods of verifying the outputs and the tail states of the local transitions. Moreover, we prove that if all the local transitions are right, the transition structure of the distributed software is right. The tests are generated on the local transition structure of components, so we will not meet the state combinatorial explosion problem. All the outputs of the local transitions are checked, so the fault isolation results may be more accurate.
Protocol Interoperability Test Generation Based on Communicating Multi-Port FSMs

Zhi-Liang WANG,Jian-Ping WU,Xia YIN

DOI: https://doi.org/10.3321/j.issn:0254-4164.2006.11.002

2006-01-01

Jisuanji Xuebao/Chinese Journal of Computers

Abstract:Protocol testing is one of the important techniques to ensure the quality of implementations of network communication protocols and interoperability testing is a widely-used protocol testing technique. This paper presents an interoperability test generation method based on the formal model, Communicating Multi-port Finite State Machines. Firstly, centralized test sequence can be generated by using existing reachability analysis approach. Then fault coverage of the resulting test suite is analyzed systematically using single fault models; in order to improve the fault coverage, an enhanced test generation method is presented. Finally, the controllability and observability problems in interoperability testing are discussed; suitable distributed test architecture is selected and a formal algorithm is presented to generate the distributed synchronizable test suite according to the distributed test architecture. The experimental results show that comparing with existing methods, the method in this paper can improve the fault coverage of the resulting test suite and is feasible and effective.
A Test Path Generation Method Based on SSM Models

Hao Lan,Yin Tong,Jin Guo,Yadong Zhang,Yao Li,Chang Rao

DOI: https://doi.org/10.1109/qrs-c.2018.00048

2018-07-01

Abstract:The traditional finite state machine (FSM) cannot express complicated systems due to its flattened sequential features. A safe state machine (SSM) is an extension of FSMs with capability of expressing hierarchical structure, parallel structure and historical mechanism. Therefore, it can accurately express complicated functions of a system, and SSMs have strict formal semantics. This paper provides a method for generating test paths based on SSMs. A method of creating the reachability graph (RG) of an SSM is presented, which can eliminate the hierarchical and parallel structure, and mark the history states. Finally, test paths are generated based on certain test coverage criteria of the RG model.
A Simple Method for Deriving I/O Constraints from Test Sequences

WJ Wu,JK Ho,CY Tang

DOI: https://doi.org/10.1109/icoin.1998.648475

1998-01-01

Abstract:I/O constraints are restrictions defined on the values of parameters of send or receive events in test sequences for test realization. I/O constraints generation is an important step when translating test sequences into abstract test suites. In this paper, a symbolic assignment substitution method is used to generate I/O constraints of test sequences derived from Extended Finite-State Machines (EFSM). The proposed method is simpler and combines the steps to determine feasibility of test sequence and to generate I/O constraints.
Reachability Graph Based Hierarchical Test Generation for Network Protocols Modeled as Parallel Finite State Machines

Jiangyuan Yao,Zhiliang Wang,Xia Yin,Xingang Shi,Jianping Wu

DOI: https://doi.org/10.1109/ICCCN.2013.6614178

2013-01-01

Abstract:Current researches on model-based testing mainly focus on the single component model, such as FSM (Finite State Machine) and EFSM (Extended FSM). To model and test parallelism and concurrency among different protocol components, traditional CFSM (Communicating FSMs) models communication as asynchronous message exchange, which is not suitable for the scenario that parallel protocol components read shared variables from each other. We have developed Parallel Parameterized Extended Finite State Machine (PaP-EFSM) to handle this situation. In this paper, we present a hierarchical test generation approach for PaP-EFSMs based on reachability graphs. The combination of bottom-up reachability graph generation and top-down test sequence generation ensures the executability of the test sequences and alleviates state explosion. We apply this method to the conformance testing of SAVI, a real protocol for anti-spoofing of IP source addresses. We build a set of PaP-EFSMs for SAVI and derive the executable test sequences, which expose many implementation faults when applied to real devices from 4 different vendors.

TEST SEQUENCE GENERATION OF PROTOCOL WITH SPONTANEOUS EVENTS

Study of protocol conformance test sequence generation algorithm based on FSM

A New Method to Generate Test Sequences for Protocol Conformance Testing

Test Sequences Generation in Protocol Test

Test Sequence Generation of a Communication Protocol by an Heuristic State Configuration Exploration

A Test Sequence Generation Algorithm Based on Improved Transition Executability Analysis

A New Method of Generation of Communication Protocol Test Sequence

Generation Method of Synchronous Test Sequence Based on Synchronous Digraph

A Novel Method Of State Identification Sequences Generation For Testing Communication Protocols Modeled As Extended Finite State Machines

Path Overlapped Method for Protocol Conformance Test Generation

A test sequences optimization method for improving fault coverage

Interoperability Test Approach Based on ISM

An improved protocol test generation procedure based on UIOS

Identification of ICS Security Risks Toward the Analysis of Packet Interaction Characteristics Using State Sequence Matching Based on SF-FSM

np-FSM-based Distributed Protocol Virtual Multi-port Test Method

Automatic Test Generation Based on Hierarchical Finite State Machines

Test Sequence Generation for Distributed Software System.

Protocol Interoperability Test Generation Based on Communicating Multi-Port FSMs

A Test Path Generation Method Based on SSM Models

A Simple Method for Deriving I/O Constraints from Test Sequences

Reachability Graph Based Hierarchical Test Generation for Network Protocols Modeled as Parallel Finite State Machines