10 Questions about Boggle Logic Puzzles

Jonathan Needleman

DOI: https://doi.org/10.48550/arXiv.1506.04173

2015-06-11

History and Overview

Abstract:Boggle logic puzzles are based on the popular word game Boggle, where you are given list of words, and your goal is to recreate a Boggle board. In this paper we give an overview of known results and then propose a number of problems related to these puzzles.

What problem does this paper attempt to address?

How to Solve "The Hardest Logic Puzzle Ever" and Its Generalization

Daniel Vallstrom

DOI: https://doi.org/10.48550/arXiv.2201.09801

2024-06-16

Abstract:Raymond Smullyan came up with a puzzle that George Boolos called "The Hardest Logic Puzzle Ever".[1] The puzzle has truthful, lying, and random gods who answer yes or no questions with words that we don't know the meaning of. The challenge is to figure out which type each god is. The puzzle has attracted some general attention -- for example, one popular presentation of the puzzle has been viewed 10 million times.[2] Various "top-down" solutions to the puzzle have been developed.[1,3] Here a systematic bottom-up approach to the puzzle and its generalization is presented. We prove that an n gods puzzle is solvable if and only if the random gods are less than the non-random gods, for arbitrary cardinals. We develop a solution using 4.15 questions to the 5 gods variant with 2 random and 3 lying gods.

General Mathematics
Solving probability puzzles with logic toolkit

Adrian Groza

2023-05-19

Abstract:The proposed approach is to formalise the probabilistic puzzle in equational FOL. Two formalisations are needed: one theory for all models of the given puzzle, and a second theory for the favorable models. Then Mace4 - that computes all the interpretation models of a FOL theory - is called twice. First, it is asked to compute all the possible models M p .Second, the additional constraint is added, and Mace4 computes only favourabile models M f. Finally, the definition of probability is applied: the number of favorable models is divided by the number of possible models. The proposed approach equips students from the logic tribe to find the correct solution for puzzles from the probabilitistic tribe, by using their favourite instruments: modelling and formalisation. I have exemplified here five probabilistic puzzles and how they can be solved by translating the min FOL and then find the corresponding interpretation models. Mace4 was the tool of choice here. Ongoing work is investigating the limits of this method on various collections of probabilistic puzzles

Artificial Intelligence
What is the Title of this Paper? Solving logic puzzles using algorithms

Ujaan Rakshit,Nishchal Dwivedi

2023-06-30

Abstract:This work delves into the realm of logic puzzles by focusing on the Knight and Knave problems popularized by Raymond Smullyan in his book series "What is the Name of This Book?". The puzzles revolve around characters known as Knights (truth-tellers) and Knaves (liars), challenging solvers to determine the true identity of each person based on their statements. This paper explores the utilization of Python algorithms to automate the process of solving these puzzles, offering a computational approach that enhances efficiency and accessibility. In this work, we aim to develop a Python algorithm capable of parsing and analyzing the statements provided in the Knight and Knave puzzles. A logical reasoning framework is integrated within the algorithm to deduce the identities of the characters based on their statements. The algorithm processes the input statements, create a knowledge base, and make deductions following the rules of Knight and Knave logic. The developed algorithm is thoroughly tested on various instances of Knight and Knave puzzles, comparing its results to known solutions and manual approaches. We further expand the scope of the problem by introducing a Normal (who can sometimes lie and sometimes say the truth).

Logic in Computer Science,Artificial Intelligence
Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad?

Antonia Wüst,Tim Tobiasch,Lukas Helff,Devendra S. Dhami,Constantin A. Rothkopf,Kristian Kersting

2024-10-25

Abstract:Recently, newly developed Vision-Language Models (VLMs), such as OpenAI's GPT-4o, have emerged, seemingly demonstrating advanced reasoning capabilities across text and image modalities. Yet, the depth of these advances in language-guided perception and abstract reasoning remains underexplored, and it is unclear whether these models can truly live up to their ambitious promises. To assess the progress and identify shortcomings, we enter the wonderland of Bongard problems, a set of classical visual reasoning puzzles that require human-like abilities of pattern recognition and abstract reasoning. While VLMs occasionally succeed in identifying discriminative concepts and solving some of the problems, they frequently falter, failing to understand and reason about visual concepts. Surprisingly, even elementary concepts that may seem trivial to humans, such as simple spirals, pose significant challenges. Moreover, even when asked to explicitly focus on and analyze these concepts, they continue to falter, suggesting not only a lack of understanding of these elementary visual concepts but also an inability to generalize to unseen concepts. These observations underscore the current limitations of VLMs, emphasize that a significant gap remains between human-like visual reasoning and machine cognition, and highlight the ongoing need for innovation in this area.

Artificial Intelligence,Machine Learning
Reasoning about Agent Types and the Hardest Logic Puzzle Ever

Fenrong Liu,Yanjing Wang

DOI: https://doi.org/10.1007/s11023-012-9287-x

IF: 5.339

2012-01-01

Minds and Machines

Abstract:In this paper, we first propose a simple formal language to specify types of agents in terms of necessary conditions for their announcements. Based on this language, types of agents are treated as ‘first-class citizens’ and studied extensively in various dynamic epistemic frameworks which are suitable for reasoning about knowledge and agent types via announcements and questions. To demonstrate our approach, we discuss various versions of Smullyan’s Knights and Knaves puzzles, including the Hardest Logic Puzzle Ever (HLPE) proposed by Boolos (in Harv Rev Philos 6:62–65, 1996). In particular, we formalize HLPE and verify a classic solution to it. Moreover, we propose a spectrum of new puzzles based on HLPE by considering subjective (knowledge-based) agent types and relaxing the implicit epistemic assumptions in the original puzzle. The new puzzles are harder than the previously proposed ones in the literature, in the sense that they require deeper epistemic reasoning. Surprisingly, we also show that a version of HLPE in which the agents do not know the others’ types does not have a solution at all. Our formalism paves the way for studying these new puzzles using automatic model checking techniques.
Making New Connections: LLMs as Puzzle Generators for The New York Times' Connections Word Game

Tim Merino,Sam Earle,Ryan Sudhakaran,Shyam Sudhakaran,Julian Togelius

2024-07-16

Abstract:The Connections puzzle is a word association game published daily by The New York Times (NYT). In this game, players are asked to find groups of four words that are connected by a common theme. While solving a given Connections puzzle requires both semantic knowledge and abstract reasoning, generating novel puzzles additionally requires a form of metacognition: generators must be able to accurately model the downstream reasoning of potential solvers. In this paper, we investigate the ability of the GPT family of Large Language Models (LLMs) to generate challenging and creative word games for human players. We start with an analysis of the word game Connections and the unique challenges it poses as a Procedural Content Generation (PCG) domain. We then propose a method for generating Connections puzzles using LLMs by adapting a Tree of Thoughts (ToT) prompting approach. We evaluate this method by conducting a user study, asking human players to compare AI-generated puzzles against published Connections puzzles. Our findings show that LLMs are capable puzzle creators, and can generate diverse sets of enjoyable, challenging, and creative Connections puzzles as judged by human users.

Artificial Intelligence,Computation and Language
Latin Puzzles

Miguel G. Palomo

DOI: https://doi.org/10.48550/arXiv.1602.06946

2016-02-23

Abstract:Based on a previous generalization by the author of Latin squares to Latin boards, this paper generalizes partial Latin squares and related objects like partial Latin squares, completable partial Latin squares and Latin square puzzles. The latter challenge players to complete partial Latin squares, Sudoku being the most popular variant nowadays. The present generalization results in partial Latin boards, completable partial Latin boards and Latin puzzles. Provided examples of Latin puzzles illustrate how they differ from puzzles based on Latin squares. The examples include Sudoku Ripeto and Custom Sudoku, two new Sudoku variants. This is followed by a discussion of methods to find Latin boards and Latin puzzles amenable to being solved by human players, with an emphasis on those based on constraint programming. The paper also includes an analysis of objective and subjective ways to measure the difficulty of Latin puzzles.

History and Overview
Pictorial and Apictorial Polygonal Jigsaw Puzzles from Arbitrary Number of Crossing Cuts

Peleg Harel,Ofir Itzhak Shahar,Ohad Ben-Shahar

DOI: https://doi.org/10.1007/s11263-024-02033-7

IF: 13.369

2024-03-24

International Journal of Computer Vision

Abstract:Jigsaw puzzle solving, the problem of constructing a coherent whole from a set of non-overlapping unordered visual fragments, is fundamental to numerous applications, and yet most of the literature of the last two decades has focused thus far on less realistic puzzles whose pieces are identical squares. Here we formalize a new type of jigsaw puzzle where the pieces are general convex polygons generated by cutting through a global polygonal shape/image with an arbitrary number of straight cuts, a generation model inspired by the celebrated Lazy caterer's sequence. We analyze the theoretical properties of such puzzles, including the inherent challenges in solving them once pieces are contaminated with geometrical noise. To cope with such difficulties and obtain tractable solutions, we abstract the problem as a multi-body spring-mass dynamical system endowed with hierarchical loop constraints and a layered reconstruction process. We define evaluation metrics and present experimental results on both apictorial and pictorial puzzles to show that they are solvable completely automatically.

computer science, artificial intelligence
Number Jigsaw Puzzle: A Mathematical Puzzle Game for Facilitating Players' Problem-Solving Strategies

O. W. S. Huang,H. N. H. Cheng,Tak-Wai Chan,Owen W.S. Huang,Hercy N.H. Cheng

DOI: https://doi.org/10.1109/digitel.2007.37

2007-03-01

Abstract:Puzzles can be regarded as problem-solving games, in which players have to solve the obstacle they confront. Solving puzzles helps players to foster logical thinking and to facilitate problem-solving strategies. In this paper, we base on four puzzle games, magic square, jigsaw puzzle, sudoku, and kakuro, and then we design a number puzzle game, called number jigsaw puzzle (NJP). In solving NJP, players could construct their problem-solving strategies according to their previous knowledge. A pilot study was conducted to investigate what strategies the players would use in solving NJP. The result shows that the five different strategies had been found in the pilot study.
Playing Codenames with Language Graphs and Word Embeddings

Divya Koyyalagunta,Anna Sun,Rachel Lea Draelos,Cynthia Rudin

DOI: https://doi.org/10.48550/arXiv.2105.05885

2021-05-13

Abstract:Although board games and video games have been studied for decades in artificial intelligence research, challenging word games remain relatively unexplored. Word games are not as constrained as games like chess or poker. Instead, word game strategy is defined by the players' understanding of the way words relate to each other. The word game Codenames provides a unique opportunity to investigate common sense understanding of relationships between words, an important open challenge. We propose an algorithm that can generate Codenames clues from the language graph BabelNet or from any of several embedding methods - word2vec, GloVe, fastText or BERT. We introduce a new scoring function that measures the quality of clues, and we propose a weighting term called DETECT that incorporates dictionary-based word representations and document frequency to improve clue selection. We develop BabelNet-Word Selection Framework (BabelNet-WSF) to improve BabelNet clue quality and overcome the computational barriers that previously prevented leveraging language graphs for Codenames. Extensive experiments with human evaluators demonstrate that our proposed innovations yield state-of-the-art performance, with up to 102.8% improvement in precision@2 in some cases. Overall, this work advances the formal study of word games and approaches for common sense language understanding.

Computation and Language,Artificial Intelligence,Machine Learning
Recursive Interlocking Puzzles.

Peng Song,Chi-Wing Fu,Daniel Cohen-Or

DOI: https://doi.org/10.1145/2366145.2366147

IF: 6.2

2012-01-01

ACM Transactions on Graphics

Abstract:Interlocking puzzles are very challenging geometric problems with the fascinating property that once we solve one by putting together the puzzle pieces, the puzzle pieces interlock with one another, preventing the assembly from falling apart. Though interlocking puzzles have been known for hundreds of years, very little is known about the governing mechanics. Thus, designing new interlocking geometries is basically accomplished with extensive manual effort or expensive exhaustive search with computers.In this paper, we revisit the notion of interlocking in greater depth, and devise a formal method of the interlocking mechanics. From this, we can develop a constructive approach for devising new interlocking geometries that directly guarantees the validity of the interlocking instead of exhaustively testing it. In particular, we focus on an interesting subclass of interlocking puzzles that are recursive in the sense that the assembly of puzzle pieces can remain an interlocking puzzle also after sequential removal of pieces; there is only one specific sequence of assembling, or disassembling, such a puzzle. Our proposed method can allow efficient generation of recursive interlocking geometries of various complexities, and by further realizing it with LEGO bricks, we can enable the hand-built creation of custom puzzle games.
A Mathematical Foundation for the Numberlink Game

Andrea Arauza Rivera,Matt McClinton,David Smith

DOI: https://doi.org/10.48550/arXiv.2210.02888

2022-09-29

General Mathematics

Abstract:Numberlink is a puzzle game in which players are given a grid with nodes marked with a natural number, $n$, and asked to create $n$ connections with neighboring nodes. Connections can only be made with top, bottom, left and right neighbors, and one cannot have more than two connections between any neighboring nodes. In this paper, we give a mathematical formulation of the puzzles via graphs and give some immediate consequences of this formulation. The main result of this work is an algorithm which provides insight into characteristics of these puzzles and their solutions. Finally, we give a few open questions and further directions.
PUZZLES: A Benchmark for Neural Algorithmic Reasoning

Benjamin Estermann,Luca A. Lanzendörfer,Yannick Niedermayr,Roger Wattenhofer

2024-06-29

Abstract:Algorithmic reasoning is a fundamental cognitive ability that plays a pivotal role in problem-solving and decision-making processes. Reinforcement Learning (RL) has demonstrated remarkable proficiency in tasks such as motor control, handling perceptual input, and managing stochastic environments. These advancements have been enabled in part by the availability of benchmarks. In this work we introduce PUZZLES, a benchmark based on Simon Tatham's Portable Puzzle Collection, aimed at fostering progress in algorithmic and logical reasoning in RL. PUZZLES contains 40 diverse logic puzzles of adjustable sizes and varying levels of complexity; many puzzles also feature a diverse set of additional configuration parameters. The 40 puzzles provide detailed information on the strengths and generalization capabilities of RL agents. Furthermore, we evaluate various RL algorithms on PUZZLES, providing baseline comparisons and demonstrating the potential for future research. All the software, including the environment, is available at <a class="link-external link-https" href="https://github.com/ETH-DISCO/rlp" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Artificial Intelligence
Ludii and XCSP: Playing and Solving Logic Puzzles

Cédric Piette,Éric Piette,Matthew Stephenson,Dennis J.N.J. Soemers,Cameron Browne,Cedric Piette,Eric Piette

DOI: https://doi.org/10.1109/cig.2019.8848086

2019-08-01

Abstract:Many of the famous single-player games, commonly called puzzles, can be shown to be NP-Complete. Indeed, this class of complexity contains hundreds of puzzles, since people particularly appreciate completing an intractable puzzle, such as Sudoku, but also enjoy the ability to check their solution easily once it’s done. For this reason, using constraint programming is naturally suited to solve them. In this paper, we focus on logic puzzles described in the Ludii general game system and we propose using the XCSP formalism in order to solve them with any CSP solver.
Solving Zebra Puzzles Using Constraint-Guided Multi-Agent Systems

Shmuel Berman,Kathleen McKeown,Baishakhi Ray

2024-07-09

Abstract:Prior research has enhanced the ability of Large Language Models (LLMs) to solve logic puzzles using techniques such as chain-of-thought prompting or introducing a symbolic representation. These frameworks are still usually insufficient to solve complicated logical problems, such as Zebra puzzles, due to the inherent complexity of translating natural language clues into logical statements. We introduce a multi-agent system, ZPS, that integrates LLMs with an off the shelf theorem prover. This system tackles the complex puzzle-solving task by breaking down the problem into smaller, manageable parts, generating SMT (Satisfiability Modulo Theories) code to solve them with a theorem prover, and using feedback between the agents to repeatedly improve their answers. We also introduce an automated grid puzzle grader to assess the correctness of our puzzle solutions and show that the automated grader is reliable by evaluating it in a user-study. Our approach shows improvement in all three LLMs we tested, with GPT-4 showing 166% improvement in the number of fully correct solutions.

Multiagent Systems,Computation and Language
Books, Hallways and Social Butterflies: A Note on Sliding Block Puzzles

Florestan Brunck,Matthew Kwan

2023-06-16

Abstract:Recall the classical 15-puzzle, consisting of 15 sliding blocks in a $4\times 4$ grid. Famously, the configuration space of this puzzle consists of two connected components, corresponding to the odd and even permutations of the symmetric group $S_{15}$. In 1974, Wilson generalised sliding block puzzles beyond the $4\times 4$ grid to arbitrary graphs (considering $n-1$ sliding blocks on a graph with $n$ vertices), and characterised the graphs for which the corresponding configuration space is connected. In this work, we extend Wilson's characterisation to sliding block puzzles with an arbitrary number of blocks (potentially leaving more than one empty vertex). For any graph, we determine how many empty vertices are necessary to connect the corresponding configuration space, and more generally we provide an algorithm to determine whether any two configurations are connected. Our work may also be interpreted within the framework of "Friends and Strangers graphs", where empty vertices correspond to "social butterflies" and sliding blocks to "asocial" people.

Combinatorics
Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning

Weili Nie,Zhiding Yu,Lei Mao,Ankit B. Patel,Yuke Zhu,Animashree Anandkumar

DOI: https://doi.org/10.48550/arXiv.2010.00763

2021-01-05

Abstract:Humans have an inherent ability to learn novel concepts from only a few samples and generalize these concepts to different situations. Even though today's machine learning models excel with a plethora of training data on standard recognition tasks, a considerable gap exists between machine-level pattern recognition and human-level concept learning. To narrow this gap, the Bongard problems (BPs) were introduced as an inspirational challenge for visual cognition in intelligent systems. Despite new advances in representation learning and learning to learn, BPs remain a daunting challenge for modern AI. Inspired by the original one hundred BPs, we propose a new benchmark Bongard-LOGO for human-level concept learning and reasoning. We develop a program-guided generation technique to produce a large set of human-interpretable visual cognition problems in action-oriented LOGO language. Our benchmark captures three core properties of human cognition: 1) context-dependent perception, in which the same object may have disparate interpretations given different contexts; 2) analogy-making perception, in which some meaningful concepts are traded off for other meaningful concepts; and 3) perception with a few samples but infinite vocabulary. In experiments, we show that the state-of-the-art deep learning methods perform substantially worse than human subjects, implying that they fail to capture core human cognition properties. Finally, we discuss research directions towards a general architecture for visual reasoning to tackle this benchmark.

Artificial Intelligence,Computer Vision and Pattern Recognition,Machine Learning
Pictorial and apictorial polygonal jigsaw puzzles: The lazy caterer model, properties, and solvers

Peleg Harel,Ohad Ben-Shahar

DOI: https://doi.org/10.48550/arXiv.2008.07644

2021-12-16

Abstract:Jigsaw puzzle solving, the problem of constructing a coherent whole from a set of non-overlapping unordered visual fragments, is fundamental to numerous applications and yet most of the literature of the last two decades has focused thus far on less realistic puzzles whose pieces are identical squares. Here we formalize a new type of jigsaw puzzle where the pieces are general convex polygons generated by cutting through a global polygonal shape/image with an arbitrary number of straight cuts, a generation model inspired by the celebrated Lazy caterer's sequence. We analyze the theoretical properties of such puzzles, including the inherent challenges in solving them once pieces are contaminated with geometrical noise. To cope with such difficulties and obtain tractable solutions, we abstract the problem as a multi-body spring-mass dynamical system endowed with hierarchical loop constraints and a layered reconstruction process. We define evaluation metrics and present experimental results on both apictorial and pictorial puzzles to show that they are solvable completely automatically.

Computer Vision and Pattern Recognition,Artificial Intelligence,Computational Geometry
Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning

Deepanway Ghosal,Vernon Toh Yan Han,Chia Yew Ken,Soujanya Poria

2024-03-13

Abstract:This paper introduces the novel task of multimodal puzzle solving, framed within the context of visual question-answering. We present a new dataset, AlgoPuzzleVQA designed to challenge and evaluate the capabilities of multimodal language models in solving algorithmic puzzles that necessitate both visual understanding, language understanding, and complex algorithmic reasoning. We create the puzzles to encompass a diverse array of mathematical and algorithmic topics such as boolean logic, combinatorics, graph theory, optimization, search, etc., aiming to evaluate the gap between visual data interpretation and algorithmic problem-solving skills. The dataset is generated automatically from code authored by humans. All our puzzles have exact solutions that can be found from the algorithm without tedious human calculations. It ensures that our dataset can be scaled up arbitrarily in terms of reasoning complexity and dataset size. Our investigation reveals that large language models (LLMs) such as GPT4V and Gemini exhibit limited performance in puzzle-solving tasks. We find that their performance is near random in a multi-choice question-answering setup for a significant number of puzzles. The findings emphasize the challenges of integrating visual, language, and algorithmic knowledge for solving complex reasoning problems.

Computer Vision and Pattern Recognition,Artificial Intelligence
BRAINTEASER: Lateral Thinking Puzzles for Large Language Models

Yifan Jiang,Filip Ilievski,Kaixin Ma,Zhivar Sourati

DOI: https://doi.org/10.48550/arXiv.2310.05057

2023-11-10

Abstract:The success of language models has inspired the NLP community to attend to tasks that require implicit and complex reasoning, relying on human-like commonsense mechanisms. While such vertical thinking tasks have been relatively popular, lateral thinking puzzles have received little attention. To bridge this gap, we devise BRAINTEASER: a multiple-choice Question Answering task designed to test the model's ability to exhibit lateral thinking and defy default commonsense associations. We design a three-step procedure for creating the first lateral thinking benchmark, consisting of data collection, distractor generation, and generation of adversarial examples, leading to 1,100 puzzles with high-quality annotations. To assess the consistency of lateral reasoning by models, we enrich BRAINTEASER based on a semantic and contextual reconstruction of its questions. Our experiments with state-of-the-art instruction- and commonsense language models reveal a significant gap between human and model performance, which is further widened when consistency across adversarial formats is considered. We make all of our code and data available to stimulate work on developing and evaluating lateral thinking models.

Computation and Language

10 Questions about Boggle Logic Puzzles

How to Solve "The Hardest Logic Puzzle Ever" and Its Generalization

Solving probability puzzles with logic toolkit

What is the Title of this Paper? Solving logic puzzles using algorithms

Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad?

Reasoning about Agent Types and the Hardest Logic Puzzle Ever

Making New Connections: LLMs as Puzzle Generators for The New York Times' Connections Word Game

Latin Puzzles

Pictorial and Apictorial Polygonal Jigsaw Puzzles from Arbitrary Number of Crossing Cuts

Number Jigsaw Puzzle: A Mathematical Puzzle Game for Facilitating Players' Problem-Solving Strategies

Playing Codenames with Language Graphs and Word Embeddings

Recursive Interlocking Puzzles.

A Mathematical Foundation for the Numberlink Game

PUZZLES: A Benchmark for Neural Algorithmic Reasoning

Ludii and XCSP: Playing and Solving Logic Puzzles

Solving Zebra Puzzles Using Constraint-Guided Multi-Agent Systems

Books, Hallways and Social Butterflies: A Note on Sliding Block Puzzles

Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning

Pictorial and apictorial polygonal jigsaw puzzles: The lazy caterer model, properties, and solvers

Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning

BRAINTEASER: Lateral Thinking Puzzles for Large Language Models