Abstract:Our goal is to $\textit{efficiently}$ discover a compact set of temporal logic rules to explain irregular events of interest. We introduce a neural-symbolic rule induction framework within the temporal point process model. The negative log-likelihood is the loss that guides the learning, where the explanatory logic rules and their weights are learned end-to-end in a $\textit{differentiable}$ way. Specifically, predicates and logic rules are represented as $\textit{vector embeddings}$, where the predicate embeddings are fixed and the rule embeddings are trained via gradient descent to obtain the most appropriate compositional representations of the predicate embeddings. To make the rule learning process more efficient and flexible, we adopt a $\textit{sequential covering algorithm}$, which progressively adds rules to the model and removes the event sequences that have been explained until all event sequences have been covered. All the found rules will be fed back to the models for a final rule embedding and weight refinement. Our approach showcases notable efficiency and accuracy across synthetic and real datasets, surpassing state-of-the-art baselines by a wide margin in terms of efficiency.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve how to efficiently discover compact temporal logical rules from irregular event data to explain key events in high - risk fields such as healthcare and finance. Specifically, the authors propose a neural - symbolic rule induction framework, which is embedded into the point - process model over time, and learns explanatory logical rules and their weights in an end - to - end differentiable manner. #### Key problems: 1. **Explaining key events**: In high - risk fields such as healthcare and finance, it is crucial to explain key events such as sudden health changes or abnormal transactions. 2. **Automatically discovering temporal logical rules**: The dynamics of these events are usually governed by temporal logical rules, and automatically discovering these rules from data has important scientific and practical value. 3. **Improving the flexibility and interpretability of the model**: Traditional parametric point - process models over time (such as the Hawkes process) are interpretable but have limited flexibility; neural - network - based models (such as RMTPP and Transformer Hawkes) are highly expressive but are often black - box models and are difficult to apply to scenarios that require explanation. #### Solutions: - **Neural - Symbolic Point - Process (NS - TPP) model**: Combines the advantages of neural networks and symbolic logic, and can maintain the flexibility of the model and improve interpretability. - **End - to - end differentiable rule learning**: Guided by the negative log - likelihood loss function, enables logical rules and their weights to be trained in a differentiable manner. - **Sequential covering algorithm**: Gradually adds rules and removes the already - explained event sequences until all event sequences are covered, thus avoiding the need to specify the total number of rules in advance. #### Main contributions: 1. **Balancing flexibility and interpretability**: The NS - TPP model achieves a balance between flexibility and interpretability by transforming structure learning into rule - embedding learning. 2. **Noise resistance**: Ensures robustness to noisy inputs by embedding and encoding rule content and predicates. 3. **Efficient rule discovery**: Adopts the sequential covering algorithm to decompose the complete learning problem into manageable sub - problems, significantly improving efficiency and accuracy. Through these methods, this paper proposes a new framework that can efficiently discover compact and easy - to - understand temporal logical rules in complex time - series data, providing strong support for clinical decision - making and applications in other high - risk fields.

Neuro-Symbolic Temporal Point Processes

Reinforcement Logic Rule Learning for Temporal Point Processes

Explaining Point Processes by Learning Interpretable Temporal Logic Rules

Temporal Logic Point Processes.

Neural Point Process for Learning Spatiotemporal Event Dynamics

An Empirical Study: Extensive Deep Temporal Point Process

Learning Neural Point Processes with Latent Graphs

TLogic: Temporal Logical Rules for Explainable Link Forecasting on Temporal Knowledge Graphs

Unveiling Latent Causal Rules: A Temporal Point Process Approach for Abnormal Event Explanation

Learning general temporal point processes based on dynamic weight generation

Pointwise-in-Time Explanation for Linear Temporal Logic Rules

Logical Rule Induction and Theory Learning Using Neural Theorem Proving

Fully Neural Network based Model for General Temporal Point Processes

Learning Temporal Logic Predicates from Data with Statistical Guarantees

Learning Conditional Generative Models for Temporal Point Processes

Learning Time Series Associated Event Sequences with Recurrent Point Process Networks

Temporal Point Process Graphical Models

Logic and Commonsense-Guided Temporal Knowledge Graph Completion

Meta-Learning for Neural Network-based Temporal Point Processes

Modeling and Applications for Temporal Point Processes