Abstract:Currently, the non-transparent computing process of deep learning has become a significant reason hindering its further development. The Neural-Symbolic (NS) system formed by integrating logic rules into neural networks has attracted increasing attention owing to its direct interpretability. Embedding symbolic logical formulas into a low-dimensional continuous space provides an effective way for the NS system. However, current studies are all constrained by the modeling ability for its syntactic structure and fail to preserve the intrinsic semantics in embeddings, which causes poor performance on downstream reasoning tasks. To this end, this paper proposes a novel method of Contrastive Graph Representations (ConGR) for logical formulas embedding. First, to improve the modeling ability for the syntactic structure, ConGR introduces a densely connected graph convolutional network (GCN) with an attention mechanism to process syntax parsing graphs of formulas. In this way, discriminative local and global embeddings of formulas are obtained at the syntax level. Second, the contrastive instances (positive or negative) for each anchor formula are generated by the transformation under the guidance of logical properties. To preserve semantic information, two types of contrast, global-local and global-global, are carried out to refine formula embeddings. Extensive experiments demonstrate that ConGR obtains superior performance against state-of-the-art baselines on entailment checking and premise selection datasets.

Premise Selection for Theorem Proving by Deep Graph Embedding

Improving Graph Neural Network Representations of Logical Formulae with Subgraph Pooling

Premise Selection for Mathematics by Corpus Analysis and Kernel Methods

A Survey on Deep Learning for Theorem Proving

DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data

Contrastive Graph Representations for Logical Formulas Embedding

Verifying Programs with Logic and Extended Proof Rules: Deep Embedding v.s. Shallow Embedding

Graph Representations for Higher-Order Logic and Theorem Proving

Magnushammer: A Transformer-Based Approach to Premise Selection

Holophrasm: a neural Automated Theorem Prover for higher-order logic

Automated Theorem Proving in Intuitionistic Propositional Logic by Deep Reinforcement Learning

Probabilistic Theorem Proving

BC-Prover: Backward Chaining Prover for Formal Theorem Proving

Towards Invertible Semantic-Preserving Embeddings of Logical Formulae

Deductive Additivity for Planning of Natural Language Proofs

Rethinking Complex Queries on Knowledge Graphs with Neural Link Predictors

DT-Solver: Automated Theorem Proving with Dynamic-Tree Sampling Guided by Proof-level Value Function

DeepGate: Learning Neural Representations of Logic Gates

DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search

NaturalProver: Grounded Mathematical Proof Generation with Language Models

HOList: An Environment for Machine Learning of Higher-Order Theorem Proving