Abstract:Many cloud services are relying on distributed key-value stores such as ZooKeeper, Cassandra, HBase, etc. However, distributed key-value stores are notoriously difficult to design and implement without any mistakes. Because data consistency is the contract for clients that defines what the correct values to read are for a given history of operations under a specific consistency model, consistency violations can confuse client applications by showing invalid values. As a result, serious consequences such as data loss, data corruption, and unexpected behavior of client applications can occur. Software bugs are one of main reasons why consistency violations may occur. Formal verification techniques may be used to make designs correct and minimize the risks of having bugs in the implementation. However, formal verification is not a panacea due to limitations such as the cost of verification, inability to verify existing implementations, and human errors involved. Implementation-level model checking has been heavily explored by researchers for the past decades to formally verify whether the underlying implementation of distributed systems have bugs or not. Nevertheless, previous proposals are limited because their invariant checking is not versatile enough to check for the wide spectrum of consistency models, from eventual consistency to strong consistency. In this work, consistency oracles are employed for consistency invariant checking that can be used by implementation-level model checkers to formally verify data consistency model implementations of distributed key-value stores. To integrate consistency oracles with implementation-level distributed system model checkers, the partial-order information obtained via API is leveraged to avoid the exhaustive search during consistency invariant checking. Our evaluation results show that, by using the proposed method for consistency invariant checking, our prototype model checker, VConMC, can detect consistency violations caused by several real-world software bugs in a well-known distributed key-value store, ZooKeeper.

Modeling and Verification of CKB Consensus Protocol in Coq.

Towards Modeling and Verification of the CKB Block Synchronization Protocol in Coq.

Modeling and Verifying the CKB Blockchain Consensus Protocol

Modeling and Verification of CKB Consensus Protocol in UPPAAL (S)

KBX: Verified Model Synchronization via Formal Bidirectional Transformation

Concurrent Knowledge Extraction in the Public-Key Model

CoVer: Collaborative Light-Node-Only Verification and Data Availability for Blockchains

Reusable Formal Verification of DAG-based Consensus Protocols

Improvements on Non-Interactive Zero-Knowledge Proof Systems Related to Quadratic Residuosity Languages.

SoK: A Taxonomy for Critical Analysis of Consensus Mechanisms in Consortium Blockchain

Modeling and Verification of the Bitcoin Protocol

Towards automated verification of multi-party consensus protocols

VConMC: Enabling Consistency Verification for Distributed Systems Using Implementation-Level Model Checkers and Consistency Oracles

Tyr: Finding Consensus Failure Bugs in Blockchain System with Behaviour Divergent Model.

Symbolic Model Checking the Knowledge in Herbivore Protocol.

Petri Net Based Symbolic Model Checking for Computation Tree Logic of Knowledge

Formal Verification of Quantum Protocols

Time-Bin CKA as a tool for blockchain technology

Verifying Randomized Consensus Protocols with Common Coins

Formally verified asymptotic consensus in robust networks

Verification of Implementations of Cryptographic Hash Functions