Abstract:Machines that can replicate human intelligence with type 2 reasoning capabilities should be able to reason at multiple levels of spatio-temporal abstractions and scales using internal world models. Devising formalisms to develop such internal world models, which accurately reflect the causal hierarchies inherent in the dynamics of the real world, is a critical research challenge in the domains of artificial intelligence and machine learning. This thesis identifies several limitations with the prevalent use of state space models (SSMs) as internal world models and propose two new probabilistic formalisms namely Hidden-Parameter SSMs and Multi-Time Scale SSMs to address these drawbacks. The structure of graphical models in both formalisms facilitates scalable exact probabilistic inference using belief propagation, as well as end-to-end learning via backpropagation through time. This approach permits the development of scalable, adaptive hierarchical world models capable of representing nonstationary dynamics across multiple temporal abstractions and scales. Moreover, these probabilistic formalisms integrate the concept of uncertainty in world states, thus improving the system's capacity to emulate the stochastic nature of the real world and quantify the confidence in its predictions. The thesis also discuss how these formalisms are in line with related neuroscience literature on Bayesian brain hypothesis and predicitive processing. Our experiments on various real and simulated robots demonstrate that our formalisms can match and in many cases exceed the performance of contemporary transformer variants in making long-range future predictions. We conclude the thesis by reflecting on the limitations of our current models and suggesting directions for future research.

Model for Indeterminable Temporal Information Representation Based on Porbability

Incorporating Probabilistic Knowledge into Topic Models.

Imprecise Probabilities From Imprecise Descriptions Of Real Numbers

Knowledge-oriented Semantics Modelling Towards Uncertainty Reasoning

Probabilistic Time Geographic Modeling Method Considering POI Semantics

Fuzziness and Uncertainty in Temporal Reasoning

Nondeterministic Temporal Relations in Multimedia Data

A Method for Implementing a Probabilistic Model as a Relational Database

A Probabilistic Model with Commonsense Constraints for Pattern-based Temporal Fact Extraction

Temporal Logic Point Processes.

Time-critical dynamic decision making

Qualitative Spatio-temporal Reasoning Combining Multiple Spatial Relations and Time

Unifying Probability with Nondeterminism

Modeling Temporal Uncertainty of Events : a Descriptive Perspective

Learning World Models With Hierarchical Temporal Abstractions: A Probabilistic Perspective

Modeling Uncertain Context Information via Event Probabilities

Inferable Dynamic Markov Model to Predict Interference Effects.

Reasoning About Hybrid Probabilistic Knowledge Bases

Temporal Dempster-Shafer Theory

A Unified Temporal Knowledge Graph Reasoning Model Towards Interpolation and Extrapolation

An Expressive Probabilistic Temporal Logic