Abstract:Faced with complex problems, the human brain demonstrates a remarkable capacity to transcend sensory input and form latent understandings of perceived world patterns. However, this cognitive capacity is not explicitly considered or encoded in current large language models (LLMs). As a result, LLMs often struggle to capture latent structures and model uncertainty in complex compositional reasoning tasks. This work introduces a novel Bayesian prompting approach that facilitates training-free Bayesian inference with LLMs by using a verbalized Probabilistic Graphical Model (PGM). While traditional Bayesian approaches typically depend on extensive data and predetermined mathematical structures for learning latent factors and dependencies, our approach efficiently reasons latent variables and their probabilistic dependencies by prompting LLMs to adhere to Bayesian principles. We evaluated our model on several compositional reasoning tasks, both close-ended and open-ended. Our results indicate that the model effectively enhances confidence elicitation and text generation quality, demonstrating its potential to improve AI language understanding systems, especially in modeling uncertainty.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: currently, large - language models (LLMs) have difficulty in capturing latent structures and modeling uncertainty when handling complex reasoning tasks. Specifically, although LLMs perform excellently in processing and generating human languages, they rely on explicit data patterns and cannot handle implicit knowledge well or integrate unpublished information from multiple sources. Therefore, these models perform poorly when they need to understand implicit knowledge or handle uncertainty. To solve these problems, the author proposes a new Bayesian prompting method, using verbalized probabilistic graphical models (vPGM), enabling LLMs to perform Bayesian inference without additional training. This method aims to improve the performance of LLMs in complex combinatorial reasoning tasks, especially in modeling uncertainty and improving confidence - level estimation. ### Main problem summary: 1. **Insufficient ability to capture latent structures**: LLMs have difficulty in identifying and understanding latent structures in complex reasoning tasks. 2. **Modeling uncertainty**: LLMs perform poorly in handling uncertainty, especially when facing implicit knowledge or incomplete information. 3. **Reliance on explicit data patterns**: The performance of LLMs is limited by the scope of their training data and they cannot effectively handle information not explicitly represented in the training data. ### Solutions: - **Introducing vPGM**: Through verbalized probabilistic graphical models, LLMs can perform Bayesian inference, thereby better capturing latent variables and their probabilistic dependencies. - **Reducing dependence on large amounts of data and predefined structures**: Unlike traditional Bayesian methods, vPGM does not require large amounts of data or predefined latent factors and dependencies, but guides LLMs to reason through prompts. ### Experimental verification: The author evaluated the effect of vPGM on multiple combinatorial reasoning tasks, including closed - ended and open - ended questions. The experimental results show that vPGM has significant improvements in improving confidence - level estimation and text - generation quality, especially when handling complex reasoning tasks. ### Formula representation: - The expected - value calculation formula for the posterior probability distribution: \[ E_{P(Z|X)}[P(Y|Z)] \approx \sum_Z P(Y|Z)P(Z|X) \] where \( X \) represents the observed input and \( Z \) is a sample drawn from vPGM. Through this method, vPGM not only improves the performance of LLMs in complex reasoning tasks, but also enhances the interpretability and reliability of the model.

Verbalized Probabilistic Graphical Modeling with Large Language Models

GraphLLM: Boosting Graph Reasoning Ability of Large Language Model

Large Language Models and Knowledge Graphs: Opportunities and Challenges

Large Language Models on Graphs: A Comprehensive Survey

LLMExplainer: Large Language Model based Bayesian Inference for Graph Explanation Generation

Graph-enhanced Large Language Models in Asynchronous Plan Reasoning

Exploring the Potential of Large Language Models in Graph Generation

Harnessing the Power of Large Language Model for Uncertainty Aware Graph Processing

The Curious Case of Nonverbal Abstract Reasoning with Multi-Modal Large Language Models

MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration

Graph Neural Prompting with Large Language Models

GraphInsight: Unlocking Insights in Large Language Models for Graph Structure Understanding

Does Reasoning Emerge? Examining the Probabilities of Causation in Large Language Models

GraphReason: Enhancing Reasoning Capabilities of Large Language Models through A Graph-Based Verification Approach

LLMGA: Multimodal Large Language Model based Generation Assistant

Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models

Large Language Model with Graph Convolution for Recommendation

Large Language Models Can Better Understand Knowledge Graphs Than We Thought

GUNDAM: Aligning Large Language Models with Graph Understanding

Can Large Language Models Understand Symbolic Graphics Programs?