Acceptance of Formal Methods

Peter Pepper

DOI: https://doi.org/10.1007/978-3-642-46490-4_7

1984-01-01

Abstract:It is very important to provide industry with rapid improvements. But industry does need practical solutions, not the most sophisticated solutions.

What problem does this paper attempt to address?

Formal Methods: From Academia to Industrial Practice. A Travel Guide

Marieke Huisman,Dilian Gurov,Alexander Malkis

DOI: https://doi.org/10.48550/arXiv.2002.07279

2024-02-13

Abstract:For many decades, formal methods are considered to be the way forward to help the software industry to make more reliable and trustworthy software. However, despite this strong belief and many individual success stories, no real change in industrial software development seems to be occurring. In fact, the software industry itself is moving forward rapidly, and the gap between what formal methods can achieve and the daily software-development practice does not appear to be getting smaller (and might even be growing). In the past, many recommendations have already been made on how to develop formal-methods research in order to close this gap. This paper investigates why the gap nevertheless still exists and provides its own recommendations on what can be done by the formal-methods-research community to bridge it. Our recommendations do not focus on open research questions. In fact, formal-methods tools and techniques are already of high quality and can address many non-trivial problems; we do give some technical recommendations on how tools and techniques can be made more accessible. To a greater extent, we focus on the human aspect: how to achieve impact, how to change the way of thinking of the various stakeholders about this issue, and in particular, as a research community, how to alter our behaviour, and instead of competing, collaborate to address this issue.

Software Engineering
Formal Methods: The Problem Is Education

Thierry Scheurer

DOI: https://doi.org/10.1007/3-540-40891-6_18

2000-01-01

Abstract:One of the most important contributory factors of software correctness, hence reliability, is the application of Formal Methods. These methods should be widely used in practice, but their acceptance by industry is well below what it should be. The most commonly mentioned way of improving on this situation is to reform education. This must address two issues. The first is to establish an appropriate concept of Formal Methods, one which is both sound and practicable. The second is to establish the proper way of teaching the appropriate methods. This paper addresses these two issues. First, it proposes a concept of Formal Methods and examines various misconceptions about these methods. The main tenet of the paper is that Formal Methods should give priority to the formalisation of specifications of system components over the production of completely formal proofs. Second, the paper reports on the author’s experience in teaching Formal Methods and related topics at introductory (MSc conversion) level over many years. Examples of simple specifications are given, their contribution to students’ education discussed, and a number of teaching recommendations are proposed.
Applying a Formal Method in Industry: a 25-Year Trajectory

Thierry Lecomte,David Deharbe,Etienne Prun,Erwan Mottin

DOI: https://doi.org/10.48550/arXiv.2005.07190

2020-05-13

Abstract:Industrial applications involving formal methods are still exceptions to the general rule. Lack of understanding, employees without proper education, difficulty to integrate existing development cycles, no explicit requirement from the market, etc. are explanations often heard for not being more formal. Hence the feedback provided by industry to academics is not as constructive as it might be. Summarizing a 25-year return of experience in the effective application of a formal method - namely B and Event-B - in diverse application domains (railways, smartcard, automotive), this article makes clear why and where formal methods have been applied, explains the added value obtained so far, and tries to anticipate the future of these two formalisms for safety critical systems.

Software Engineering
The Bourgeois Gentleman, Engineering and Formal Methods

Thierry Lecomte

DOI: https://doi.org/10.48550/arXiv.2005.08309

2020-05-13

Abstract:Industrial applications involving formal methods are still exceptions to the general rule. Lack of understanding, employees without proper education, difficulty to integrate existing development cycles, no explicit requirement from the market, etc. are explanations often heard for not being more formal. This article reports some experience about a game changer that is going to seamlessly integrate formal methods into safety critical systems engineering.

Software Engineering
A Comparison of Formal Methods for Evaluating the Language of Preference in Engineering Design

Tomonori Honda,Maria C. Yang,Andy Dong,Haifeng Ji

DOI: https://doi.org/10.1115/detc2010-29045

2010-01-01

Abstract:In design, as with many fields, the bases of decisions are generally not formally modeled but only talked or written about. The research problem addressed in this paper revolves around the problem of modeling the direct evaluation of design alternatives and their attributes as they are realized in linguistic communication. The question is what types of linguistic data provide the most reliable linguistic displays of preference and utility. The paper compares two formal methods for assessing a design team's preferences for alternatives based on the team's discussion: APPRAISAL and Preferential Probabilities from Transcripts (PPT). Results suggest that the two methods are comparable in their assessment of preferences. This paper also examines the nature of consistency in the way design teams consider the attributes of a design. Findings suggest that assessment of an attribute can change substantially over time.
Towards A Broader Acceptance Of Formal Verification Tools: The Role Of Education

Mansur Khazeev,Manuel Mazzara,Daniel De Carvalho,Hamna Aslam

DOI: https://doi.org/10.48550/arXiv.1906.01430

2019-06-04

Software Engineering

Abstract:Formal methods yet advantageous, face challenges towards wide acceptance and adoption in software development practices. The major reason being presumed complexity. The issue can be addressed by academia with a thoughtful plan of teaching and practise. The user study detailed in this paper is examining AutoProof tool with the motivation to identify complexities attributed to formal methods. Participants' (students of Masters program in Computer Science) performance and feedback on the experience with formal methods assisted us in extracting specific problem areas that effect tool usability. The study results infer, along with improvements in verification tool functionalities, teaching program must be modified to include pre-requisite courses to make formal methods easily adapted by students and promoting their usage in software development process.
Applying formal specifications to real-world software development

G.K. Palshikar

DOI: https://doi.org/10.1109/52.965810

IF: 3

2001-01-01

IEEE Software

Abstract:While formal methods are gaining acceptance in the software industry, there is a need for practical guidelines for making the best use of formal specifications. The author provides a few such pragmatic tips for people involved in the industrial use of formal specifications. The 15 guidelines are split into two areas, dealing with process and content. The author also includes a full-page reference for literature available over the Web.

computer science, software engineering
A Manifesto for Applicable Formal Methods

Mario Gleirscher,Jaco van de Pol,Jim Woodcock

DOI: https://doi.org/10.1007/s10270-023-01124-2

2023-08-22

Abstract:Formal methods were frequently shown to be effective and, perhaps because of that, practitioners are interested in using them more often. Still, these methods are far less applied than expected, particularly, in critical domains where they are strongly recommended and where they have the greatest potential. Our hypothesis is that formal methods still seem not to be applicable enough or ready for their intended use. In critical software engineering, what do we mean when we speak of a formal method? And what does it mean for such a method to be applicable both from a scientific and practical viewpoint? Based on what the literature tells about the first question, with this manifesto, we lay out a set of principles that when followed by a formal method give rise to its mature applicability in a given scope. Rather than exercising criticism of past developments, this manifesto strives to foster an increased use of formal methods to the maximum benefit.

Software Engineering,Formal Languages and Automata Theory,Logic in Computer Science
Formal methods in software development: A road less travelled

John A van der Poll,John A Van der Poll

DOI: https://doi.org/10.18489/sacj.v45i0.33

2010-08-03

South African Computer Journal

Abstract:An integration of traditional verification techniques and formal specifications in software engineering is presented. Advocates of such techniques claim that mathematical formalisms allow them to produce quality, verifiably correct, or at least highly dependable software and that the testing and maintenance phases are shortened. Critics on the other hand maintain that software formalisms are hard to master, tedious to use and not well suited for the fast turnaround times demanded by industry. In this paper some popular formalisms and the advantages of using these during the early phases of the software development life cycle are presented. Employing the Floyd-Hoare verification principles during the formal specification phase facilitates reasoning about the properties of a specification. Some observations that may help to alleviate the formal-methods controversy are established and a number of formal methods successes is presented. Possible conditions for an increased acceptance of formalisms in oftware development are discussed.
Formalization and Validation of Safety-Critical Requirements

Alessandro Cimatti,Marco Roveri,Angelo Susi,Stefano Tonetta

DOI: https://doi.org/10.4204/EPTCS.20.7

2012-06-27

Abstract:The validation of requirements is a fundamental step in the development process of safety-critical systems. In safety critical applications such as aerospace, avionics and railways, the use of formal methods is of paramount importance both for requirements and for design validation. Nevertheless, while for the verification of the design, many formal techniques have been conceived and applied, the research on formal methods for requirements validation is not yet mature. The main obstacles are that, on the one hand, the correctness of requirements is not formally defined; on the other hand that the formalization and the validation of the requirements usually demands a strong involvement of domain experts. We report on a methodology and a series of techniques that we developed for the formalization and validation of high-level requirements for safety-critical applications. The main ingredients are a very expressive formal language and automatic satisfiability procedures. The language combines first-order, temporal, and hybrid logic. The satisfiability procedures are based on model checking and satisfiability modulo theory. We applied this technology within an industrial project to the validation of railways requirements.

Software Engineering
Rooting Formal Methods within Higher Education Curricula for Computer Science and Software Engineering -- A White Paper

Antonio Cerone,Markus Roggenbach,James Davenport,Casey Denner,Marie Farrell,Magne Haveraaen,Faron Moller,Philipp Koerner,Sebastian Krings,Peter Olveczky,Bernd-Holger Schlingloff,Nikolay Shilov,Rustam Zhumagambetov

DOI: https://doi.org/10.48550/arXiv.2010.05708

2020-10-12

Abstract:This white paper argues that formal methods need to be better rooted in higher education curricula for computer science and software engineering programmes of study. To this end, it advocates (i) improved teaching of formal methods; (ii) systematic highlighting of formal methods within existing, `classical' computer science courses; and (iii) the inclusion of a compulsory formal methods course in computer science and software engineering curricula. These recommendations are based on the observations that (a) formal methods are an essential and cost-effective means to increase software quality; however (b) computer science and software engineering programmes typically fail to provide adequate training in formal methods; and thus (c) there is a lack of computer science graduates who are qualified to apply formal methods in industry. This white paper is the result of a collective effort by authors and participants of the 1st International Workshop on "Formal Methods, Fun for Everybody" which was held in Bergen, Norway, 2-3 December 2019. As such, it represents insights based on learning and teaching computer science and software engineering (with or without formal methods) at various universities across Europe.

Software Engineering
Encapsulating Formal Methods within Domain Specific Languages: A Solution for Verifying Railway Scheme Plans

Phillip James,Markus Roggenbach

DOI: https://doi.org/10.48550/arXiv.1403.3034

2014-03-23

Abstract:The development and application of formal methods is a long standing research topic within the field of computer science. One particular challenge that remains is the uptake of formal methods into industrial practices. This paper introduces a methodology for developing domain specific languages for modelling and verification to aid in the uptake of formal methods within industry. It illustrates the successful application of this methodology within the railway domain. The presented methodology addresses issues surrounding faithful modelling, scalability of verification and accessibility to modelling and verification processes for practitioners within the domain.

Software Engineering,Logic in Computer Science
More Programming Than Programming: Teaching Formal Methods in a Software Engineering Programme

James Noble,David Streader,Isaac Oscar Gariano,Miniruwani Samarakoon

DOI: https://doi.org/10.48550/arXiv.2205.00787

2022-05-02

Software Engineering

Abstract:Formal methods for software correctness are critical to the future of software engineering - and so must be an essential part of software engineering education. Unfortunately, formal methods are often resisted by students due to perceived difficulty, mathematicity, and practical irrelevance. We redeveloped our software correctness course by taking a programming intensive approach, using the solver-aided language Dafny to provide instant formative feedback via automated assessment. Our redeveloped course increased student retention and resulted in the best evaluation for the course for at least ten years.
Human Factors of Formal Methods

Maria Spichkova

DOI: https://doi.org/10.48550/arXiv.1404.7247

2014-04-29

Abstract:This paper provides a brief introduction to the work that aims to apply the achievements within the area of engineering psychology to the area of formal methods, focusing on the specification phase of a system development process.

Software Engineering,Human-Computer Interaction
Integrating formal methods into traditional practices for software development: an overview

Carlos Alberto Fernandez-y-Fernandez

DOI: https://doi.org/10.48550/arXiv.1412.3504

2014-12-11

Software Engineering

Abstract:This paper shows an overview of a research project for integrating formal methods in popular practices for software development in Mexico. The article shows only the main results from the survey about methods and practices and an overview of the initial proposal of practices applying lightweight formal methods to requirements specification and software modelling.
A User-Study Protocol for Evaluation of Formal Verification Results and their Explanation

Arut Prakash Kaleeswaran,Arne Nordmann,Thomas Vogel,Lars Grunske

DOI: https://doi.org/10.48550/arXiv.2108.06376

2021-08-14

Abstract:Context: The complexity of modern safety-critical systems in industries keep on increasing due to the rising number of features and functionalities. This calls for formal methods in order to entrust confidence in such systems. Nevertheless, using formal methods in industry is demanding because of usability issues, e.g., the difficulty of understanding model checking results. Thus the hypothesis is, presenting the result of model checker results in a user-friendly manner could promote formal methods usage in industries. Objective: We aim to evaluate the acceptance of formal methods by engineers if the complexity of understanding verification results is made easy. Method: We perform two different exploratory studies. First, we conduct an online survey to explore challenges in identifying inconsistent specifications and using formal methods from engineers. Second, we perform a one group pretest and posttest experiment to collect impressions from engineers using formal methods if understanding verification results is eased. Limitations: The main limitation of this study is the generalization because the survey focuses on a particular target group and it uses a pre-experimental design.

Software Engineering
Formal Methods for Industrial Critical Systems

Jan Friso Groote,Marieke Huisman

DOI: https://doi.org/10.1007/s10009-024-00744-3

2024-02-16

International Journal on Software Tools for Technology Transfer

Abstract:To stimulate the development and application of formal methods in industry, we need to promote research and development for the improvement of formal methods and tools for industrial applications, and we need to exchange experiences of the industrial usage of these methods and tools. This special issue of Software Tools for Technology Transfer presents various tools and experience reports that are targeting the use of formal methods in industry. The papers in this special issue are extended versions of selected conference papers from the proceedings of the 27th International Conference on Formal Methods for Industrial Critical Systems (FMICS 2022).

computer science, software engineering
Valuing Evaluation: Methodologies to Bridge Research and Practice

Petteri Kaskenpalo,Stephen G. MacDonell

DOI: https://doi.org/10.1145/2372233.2372242

2021-01-11

Abstract:The potential disconnect between research and practice in software engineering (SE) means that the uptake of research outcomes has at times been limited. In this paper we seek to identify research approaches that are rigorous in terms of method but that are also relevant to software engineering practitioners. After considering the correspondence of several approaches to software systems research and practice we recommend a framework for applying grounded theory in SE research, as a means of delivering both robust and useful outcomes.

Software Engineering
Towards Classification of Lightweight Formal Methods

Anna Zamansky,Maria Spichkova,Guillermo Rodriguez-Navas,Peter Herrmann,Jan Olaf Blech

DOI: https://doi.org/10.48550/arXiv.1807.01923

2018-07-05

Abstract:The use of lightweight formal methods (LFM) for the development of industrial applications has become a major trend. Although the term "lightweight formal methods" has been used for over ten years now, there seems to be no common agreement on what "lightweight" actually means, and different communities apply the term in all kinds of ways. In this paper, we explore the recent trends in the use of LFM, and establish our opinion that cost-effectiveness is the driving force to deploy LFM. Further, we propose a simple framework that should help to classify different LFM approaches and to estimate which of them are most cost-effective for a certain software engineering project. We demonstrate our framework using some examples.

Software Engineering
Systematic Evaluation and Usability Analysis of Formal Tools for Railway System Design

Alessio Ferrari,Franco Mazzanti,Davide Basile,Maurice H. ter Beek

DOI: https://doi.org/10.48550/arXiv.2101.11303

2021-05-13

Abstract:Formal methods and supporting tools have a long record of success in the development of safety-critical systems. However, no single tool has emerged as the dominant solution for system design. Each tool differs from the others in terms of the modeling language used, its verification capabilities and other complementary features, and each development context has peculiar needs that require different tools. This is particularly problematic for the railway industry, in which formal methods are highly recommended by the norms, but no actual guidance is provided for the selection of tools. To guide companies in the selection of the most appropriate formal tools to adopt in their contexts, a clear assessment of the features of the currently available tools is required. To address this goal, this paper considers a set of 13 formal tools that have been used for railway system design, and it presents a systematic evaluation of such tools and a preliminary usability analysis of a subset of 7 tools, involving railway practitioners. The results are discussed considering the most desired aspects by industry and earlier related studies. While the focus is on the railway domain, the overall methodology can be applied to similar contexts. Our study thus contributes with a systematic evaluation of formal tools and it shows that despite the poor graphical interfaces, usability and maturity of the tools are not major problems, as claimed by contributions from the literature. Instead, support for process integration is the most relevant obstacle for the adoption of most of the tools.

Software Engineering,Formal Languages and Automata Theory

Acceptance of Formal Methods

Formal Methods: From Academia to Industrial Practice. A Travel Guide

Formal Methods: The Problem Is Education

Applying a Formal Method in Industry: a 25-Year Trajectory

The Bourgeois Gentleman, Engineering and Formal Methods

A Comparison of Formal Methods for Evaluating the Language of Preference in Engineering Design

Towards A Broader Acceptance Of Formal Verification Tools: The Role Of Education

Applying formal specifications to real-world software development

A Manifesto for Applicable Formal Methods

Formal methods in software development: A road less travelled

Formalization and Validation of Safety-Critical Requirements

Rooting Formal Methods within Higher Education Curricula for Computer Science and Software Engineering -- A White Paper

Encapsulating Formal Methods within Domain Specific Languages: A Solution for Verifying Railway Scheme Plans

More Programming Than Programming: Teaching Formal Methods in a Software Engineering Programme

Human Factors of Formal Methods

Integrating formal methods into traditional practices for software development: an overview

A User-Study Protocol for Evaluation of Formal Verification Results and their Explanation

Formal Methods for Industrial Critical Systems

Valuing Evaluation: Methodologies to Bridge Research and Practice

Towards Classification of Lightweight Formal Methods

Systematic Evaluation and Usability Analysis of Formal Tools for Railway System Design