Abstract:By combining Datalog, SMT solving, and functional programming, the language Formulog provides an appealing mix of features for implementing SMT-based static analyses (e.g., refinement type checking, symbolic execution) in a natural, declarative way. At the same time, the performance of its custom Datalog solver can be an impediment to using Formulog beyond prototyping -- a common problem for Datalog variants that aspire to solve large problem instances. In this work we speed up Formulog evaluation, with surprising results: while 2.2x speedups are obtained by using the conventional techniques for high-performance Datalog (e.g., compilation, specialized data structures), the big wins come by abandoning the central assumption in modern performant Datalog engines, semi-naive Datalog evaluation. In its place, we develop eager evaluation, a concurrent Datalog evaluation algorithm that explores the logical inference space via a depth-first traversal order. In practice, eager evaluation leads to an advantageous distribution of Formulog's SMT workload to external SMT solvers and improved SMT solving times: our eager evaluation extensions to the Formulog interpreter and Soufflé's code generator achieve mean 5.2x and 7.6x speedups, respectively, over the optimized code generated by off-the-shelf Soufflé on SMT-heavy Formulog benchmarks. Using compilation and eager evaluation, Formulog implementations of refinement type checking, bottom-up pointer analysis, and symbolic execution achieve speedups on 20 out of 23 benchmarks over previously published, hand-tuned analyses written in F#, Java, and C++, providing strong evidence that Formulog can be the basis of a realistic platform for SMT-based static analysis. Moreover, our experience adds nuance to the conventional wisdom that semi-naive evaluation is the one-size-fits-all best Datalog evaluation algorithm for static analysis workloads.

Bottom-Up Evaluation of Datalog: Preliminary Report

Bottom-up Evaluation of Datalog with Negation

A Framework for Bottom-Up Simulation of SLD-Resolution

Query Optimization for Deductive Databases.

A Variant of Earley Deduction With Partial Evaluation

Evaluating Datalog over Semirings: A Grounding-based Approach

Bring Your Own Data Structures to Datalog

Practical Reasoning in DatalogMTL

A Demonstration of DLBD: Database Logic Bug Detection System.

Datalog with First-Class Facts

Extended Magic for Negation: Efficient Demand-Driven Evaluation of Stratified Datalog with Precise Complexity Guarantees

Beyond the Grounding Bottleneck: Datalog Techniques for Inference in Probabilistic Logic Programs (Technical Report)

Making Formulog Fast: An Argument for Unconventional Datalog Evaluation (Extended Version)

A Reasoning Mechanism for Deductive Object-Oriented Databases

The Datalog(Dl) Combination Of Deduction Rules And Description Logics

Synthesizing Datalog Programs Using Numerical Relaxation

Finding Cross-rule Optimization Bugs in Datalog Engines

Lower Bounds on Intermediate Results in Bottom-Up Knowledge Compilation

Evaluating Datalog via Tree Automata and Cycluits

Optimised Storage for Datalog Reasoning