Abstract:We propose a novel approach for decision making problems leveraging the generalization capabilities of large language models (LLMs). Traditional methods such as expert systems, planning algorithms, and reinforcement learning often exhibit limited generalization, typically requiring the training of new models for each unique task. In contrast, LLMs demonstrate remarkable success in generalizing across varied language tasks, inspiring a new strategy for training decision making models. Our approach, referred to as "Learning then Using" (LTU), entails a two-stage process. Initially, the \textit{learning} phase develops a robust foundational decision making model by integrating diverse knowledge from various domains and decision making contexts. The subsequent \textit{using} phase refines this foundation model for specific decision making scenarios. Distinct from other studies that employ LLMs for decision making through supervised learning, our LTU method embraces a versatile training methodology that combines broad pre-training with targeted fine-tuning. Experiments in e-commerce domains such as advertising and search optimization have shown that LTU approach outperforms traditional supervised learning regimes in decision making capabilities and generalization. The LTU approach is the first practical training architecture for both single-step and multi-step decision making tasks combined with LLMs, which can be applied beyond game and robot domains. It provides a robust and adaptable framework for decision making, enhances the effectiveness and flexibility of various systems in tackling various challenges.

Large Language Models for Explainable Decisions in Dynamic Digital Twins

Explainable Human-in-the-loop Dynamic Data-Driven Digital Twins

Explainable Modeling in Digital Twin

Empowering digital twins with large language models for global temporal feature learning

Towards Uncovering How Large Language Model Works: An Explainability Perspective

Argumentative Large Language Models for Explainable and Contestable Decision-Making

Integrating Automated Knowledge Extraction with Large Language Models for Explainable Medical Decision-Making

Explainability for Large Language Models: A Survey

LLM experiments with simulation: Large Language Model Multi-Agent System for Simulation Model Parametrization in Digital Twins

Large Language Models and Explainable Law: a Hybrid Methodology

Large Language Models and Knowledge Graphs: Opportunities and Challenges

Explaining Agent Behavior with Large Language Models

DeLLMa: Decision Making Under Uncertainty with Large Language Models

Predicting and Understanding Human Action Decisions: Insights from Large Language Models and Cognitive Instance-Based Learning

Deciphering Diagnoses: How Large Language Models Explanations Influence Clinical Decision Making

Explingo: Explaining AI Predictions using Large Language Models

Rethinking Interpretability in the Era of Large Language Models

Large Language Model As Autonomous Decision Maker

Building Decision Making Models Through Language Model Regime

Inference to the Best Explanation in Large Language Models

Large Language Models for Scientific Synthesis, Inference and Explanation