Using LSTM to Predict Tactics in Coq

Xiaokun Luan,Xiyue Zhang,Meng Sun
DOI: https://doi.org/10.18293/seke2021-047
2021-01-01
Abstract:Quality assurance of rapidly evolving systems is increasingly important for their deployment to real-life applications.Despite the challenges posed by the increasing complexity of these systems, various techniques have been developed to check their correctness, such as theorem proving, which is a powerful formal verification method that can provide a complete guarantee.However, the proving process in the interactive theorem provers like Coq highly relies on human interactions, making the proving process difficult and time-consuming.To automate the proving process in Coq, we present a framework for predicting tactics in Coq by using Long Short Term Memory (LSTM).We take into account the effect of the dataset proof style on machine learning and create a new dataset following a specific proof style.We use the generated data to train an LSTM-based neural network that could give tactic predictions based on the proof context.This neural network reaches an accuracy of 58% if we only use the first predicted tactic and reaches an accuracy of 87% if we select the first three tactic suggestions, achieving a 15.2% and 12.8% improvement rate, respectively, compared to the methods in previous work.
What problem does this paper attempt to address?