Abstract:We introduce Diagram of Thought (DoT), a framework that models iterative reasoning in large language models (LLMs) as the construction of a directed acyclic graph (DAG) within a single model. Unlike traditional approaches that represent reasoning as linear chains or trees, DoT organizes propositions, critiques, refinements, and verifications into a cohesive DAG structure, allowing the model to explore complex reasoning pathways while maintaining logical consistency. Each node in the diagram corresponds to a proposition that has been proposed, critiqued, refined, or verified, enabling the LLM to iteratively improve its reasoning through natural language feedback. By leveraging auto-regressive next-token prediction with role-specific tokens, DoT facilitates seamless transitions between proposing ideas and critically evaluating them, providing richer feedback than binary signals. Furthermore, we formalize the DoT framework using Topos Theory, providing a mathematical foundation that ensures logical consistency and soundness in the reasoning process. This approach enhances both the training and inference processes within a single LLM, eliminating the need for multiple models or external control mechanisms. DoT offers a conceptual framework for designing next-generation reasoning-specialized models, emphasizing training efficiency, robust reasoning capabilities, and theoretical grounding. The code is available at <a class="link-external link-https" href="https://github.com/diagram-of-thought/diagram-of-thought" rel="external noopener nofollow">this https URL</a>.

The Distributed Logical Reasoning Language D_Tuili and Its Implementation on Microcomputer Network

Design, Implementation of the Parallel C Language Based on C/S Mode in Distributed Systems

DMODULA: A Distributed Programming Language

A Demonstration of DLBD: Database Logic Bug Detection System.

Programming languages for distributed computing systems

A Reasoning Mechanism for Deductive Object-Oriented Databases

DC++: a kind of object-oriented distributed programming language

of ML and PARLOG Programs on Multicomputers

The Implementation of Dynamic Linking in Dynamic Binary Translation Systems

On the Diagram of Thought

Intelligent Decision on Distributive Teaching System

Parallel Collaborative Reasoning Approaches Based on DatalogMTL in IoT Scenarios

Implementation of MPLS LDP Using SDL

Research & Realization about Distributed Object Technology JavaRMI

Practical Reasoning in DatalogMTL

The Verification of PLC Program Based on Interactive Theorem Proving Tool COQ

A Distributed Computing Model for Wu’s Method

A Test System Framework for Distributed Programming

Distributed Transaction Processing Technology and Its Models

Goal-Driven Reasoning in DatalogMTL with Magic Sets