Abstract:Tsetlin Machines (TMs) have emerged as a compelling alternative to conventional deep learning methods, offering notable advantages such as smaller memory footprint, faster inference, fault-tolerant properties, and interpretability. Although various adaptations of TMs have expanded their applicability across diverse domains, a fundamental gap remains in understanding how TMs quantify uncertainty in their predictions. In response, this paper introduces the Probabilistic Tsetlin Machine (PTM) framework, aimed at providing a robust, reliable, and interpretable approach for uncertainty quantification. Unlike the original TM, the PTM learns the probability of staying on each state of each Tsetlin Automaton (TA) across all clauses. These probabilities are updated using the feedback tables that are part of the TM framework: Type I and Type II feedback. During inference, TAs decide their actions by sampling states based on learned probability distributions, akin to Bayesian neural networks when generating weight values. In our experimental analysis, we first illustrate the spread of the probabilities across TA states for the noisy-XOR dataset. Then we evaluate the PTM alongside benchmark models using both simulated and real-world datasets. The experiments on the simulated dataset reveal the PTM's effectiveness in uncertainty quantification, particularly in delineating decision boundaries and identifying regions of high uncertainty. Moreover, when applied to multiclass classification tasks using the Iris dataset, the PTM demonstrates competitive performance in terms of predictive entropy and expected calibration error, showcasing its potential as a reliable tool for uncertainty estimation. Our findings underscore the importance of selecting appropriate models for accurate uncertainty quantification in predictive tasks, with the PTM offering a particularly interpretable and effective solution.

Probabilistic Tangent Subspace

Tangent Space Learning and Generalization

Detecting and Visualizing Profile Correlation in Subspace

Classification of Hyperspectral Image Based on Sparse Representation in Tangent Space

Discriminative analysis algorithm for linear local tangent spaces

Tensor Subspace Analysis.

Improved Tangent Space Based Distance Metric for Accurate Lithographic Hotspot Classification

Probabilistic PCA for T Distributions.

Supervised Local Tangent Space Alignment for Classification

Probabilistic tangent subspace method for multiuser detection

A Probabilistic Model for Image Representation Via Multiple Patterns

A Tale of Three Probabilistic Families: Discriminative, Descriptive and Generative Models

Robust Discriminative t-Linear Subspace Learning for Image Feature Extraction

Subspace Learning Based on Tensor Analysis

2D-DLPP Algorithm Based on SPD Manifold Tangent Space.

Trivergence of Probability Distributions, at glance

Enhanced Face Recognition Using Tensor Neighborhood Preserving Discriminant Projections

Principal Manifolds and Nonlinear Dimensionality Reduction Via Tangent Space Alignment

The Probabilistic Tsetlin Machine: A Novel Approach to Uncertainty Quantification

Combining intrinsic dimension and local tangent space for manifold spectral clustering image segmentation

BYY harmony learning of t-mixtures with the application to image segmentation based on contourlet texture features.