Introduction to Symbolic Plan and Goal Recognition

Reuth Mirsky,Sarah Keren,Christopher Geib

DOI: https://doi.org/10.2200/S01062ED1V01Y202012AIM047

2021-01-27

Synthesis Lectures on Artificial Intelligence and Machine Learning

Abstract:Synthesis Lectures on Artificial Intelligence and Machine Learning, Volume 15, Issue 1 , Page 1-190, January 2021.

What problem does this paper attempt to address?

Robust Neuro-Symbolic Goal and Plan Recognition

Leonardo Amado,Ramon Fraga Pereira,Felipe Meneguzzi

DOI: https://doi.org/10.1609/aaai.v37i10.26408

2023-06-26

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Goal Recognition is the task of discerning the intended goal of an agent given a sequence of observations, whereas Plan Recognition consists of identifying the plan to achieve such intended goal. Regardless of the underlying techniques, most recognition approaches are directly affected by the quality of the available observations. In this paper, we develop neuro-symbolic recognition approaches that can combine learning and planning techniques, compensating for noise and missing observations using prior data. We evaluate our approaches in standard human-designed planning domains as well as domain models automatically learned from real-world data. Empirical experimentation shows that our approaches reliably infer goals and compute correct plans in the experimental datasets. An ablation study shows that outperform approaches that rely exclusively on the domain model, or exclusively on machine learning in problems with both noisy observations and low observability.
Combining Symbolic and Statistical Knowledge for Goal Recognition in Smart Home Environments

Nils Wilken,H. Stuckenschmidt

DOI: https://doi.org/10.1109/PerComWorkshops51409.2021.9431145

2021-03-22

Abstract:An essential feature of pervasive, intelligent systems is the ability to dynamically adapt to their users' current needs. Hence, it is critical for such systems to be able to recognize the current goals and needs of the users based on observed past and current actions. This work addresses the problem of goal recognition in smart home environments. We investigate whether approaches for the plan recognition problem, which is a long-standing research area in the Artificial Intelligence community, can also be applied to the goal recognition problem in smart home environments. Therefore, we evaluate the application of a well-known symbolic plan recognition approach, which is based on classical planning methods, and propose to extend this approach through additional statistical knowledge to overcome some identified shortcomings of the planning-based approach. We show that the planning-based plan recognition approach indeed can be used to solve the goal recognition problem in smart home environments and show that the proposed extension outperforms the original approach as well as purely statistical goal recognition methods.

Computer Science
Evaluation of Goal Recognition Systems on Unreliable Data and Uninspectable Agents

Irina Rabkina,Pavan Kantharaju,Jason R. Wilson,Mark Roberts,Laura M. Hiatt

DOI: https://doi.org/10.3389/frai.2021.734521

2022-02-02

Frontiers in Artificial Intelligence

Abstract:Goal or intent recognition, where one agent recognizes the goals or intentions of another, can be a powerful tool for effective teamwork and improving interaction between agents. Such reasoning can be challenging to perform, however, because observations of an agent can be unreliable and, often, an agent does not have access to the reasoning processes and mental models of the other agent. Despite this difficulty, recent work has made great strides in addressing these challenges. In particular, two Artificial Intelligence (AI)-based approaches to goal recognition have recently been shown to perform well: goal recognition as planning, which reduces a goal recognition problem to the problem of plan generation; and Combinatory Categorical Grammars (CCGs), which treat goal recognition as a parsing problem. Additionally, new advances in cognitive science with respect to Theory of Mind reasoning have yielded an approach to goal recognition that leverages analogy in its decision making. However, there is still much unknown about the potential and limitations of these approaches, especially with respect to one another. Here, we present an extension of the analogical approach to a novel algorithm, Refinement via Analogy for Goal Reasoning (RAGeR). We compare RAGeR to two state-of-the-art approaches which use planning and CCGs for goal recognition, respectively, along two different axes: reliability of observations and inspectability of the other agent's mental model. Overall, we show that no approach dominates across all cases and discuss the relative strengths and weaknesses of these approaches. Scientists interested in goal recognition problems can use this knowledge as a guide to select the correct starting point for their specific domains and tasks.
Cost-Based Goal Recognition Meets Deep Learning

Mariane Maynard,Thibault Duhamel,Froduald Kabanza

DOI: https://doi.org/10.48550/arXiv.1911.10074

2019-11-22

Abstract:The ability to observe the effects of actions performed by others and to infer their intent, most likely goals, or course of action, is known as a plan or intention recognition cognitive capability and has long been one of the fundamental research challenges in AI. Deep learning has recently been making significant inroads on various pattern recognition problems, except for intention recognition. While extensively explored since the seventies, the problem remains unsolved for most interesting cases in various areas, ranging from natural language understanding to human behavior understanding based on video feeds. This paper compares symbolic inverse planning, one of the most investigated approaches to goal recognition, to deep learning using CNN and LTSM neural network architectures, on five synthetic benchmarks often used in the literature. The results show that the deep learning approach achieves better goal-prediction accuracy and timeliness than the symbolic cost-based plan recognizer in these domains. Although preliminary, these results point to interesting future research avenues.

Artificial Intelligence,Machine Learning
Activity, Plan, and Goal Recognition: A Review

Franz A. Van-Horenbeke,Angelika Peer

DOI: https://doi.org/10.3389/frobt.2021.643010

2021-05-10

Frontiers in Robotics and AI

Abstract:Recognizing the actions, plans, and goals of a person in an unconstrained environment is a key feature that future robotic systems will need in order to achieve a natural human-machine interaction. Indeed, we humans are constantly understanding and predicting the actions and goals of others, which allows us to interact in intuitive and safe ways. While action and plan recognition are tasks that humans perform naturally and with little effort, they are still an unresolved problem from the point of view of artificial intelligence. The immense variety of possible actions and plans that may be encountered in an unconstrained environment makes current approaches be far from human-like performance. In addition, while very different types of algorithms have been proposed to tackle the problem of activity, plan, and goal (intention) recognition, these tend to focus in only one part of the problem (e.g., action recognition), and techniques that address the problem as a whole have been not so thoroughly explored. This review is meant to provide a general view of the problem of activity, plan, and goal recognition as a whole. It presents a description of the problem, both from the human perspective and from the computational perspective, and proposes a classification of the main types of approaches that have been proposed to address it (logic-based, classical machine learning, deep learning, and brain-inspired), together with a description and comparison of the classes. This general view of the problem can help on the identification of research gaps, and may also provide inspiration for the development of new approaches that address the problem in a unified way.
Plan-Similarity Based Heuristics for Goal Recognition

Nils Wilken,H. Stuckenschmidt,Lea Cohausz

DOI: https://doi.org/10.1109/PerComWorkshops53856.2022.9767517

2022-03-21

Abstract:Plan and goal recognition are important tasks in constructing smart assistants and can be used to support activity recognition. However, all current approaches have the disadvantage of either being slow and inefficient regarding both online computation time and prior manual modelling effort tackled by human experts due to using domains which makes them infeasible for real-life settings; or requiring large amounts of annotated observation sequences which is not realistic as data annotation is expensive. This paper introduces a new approach requiring neither annotated observation data nor domains but only exemplary plans for each possible goal. It is based on plan-similarity based heuristics which makes it fast, yet is still able to achieve good results. This leads to new possibilities regarding the applicability in real-life settings and increases the usefulness for supporting activity recognition.

Computer Science
Symbolic Behaviour in Artificial Intelligence

Adam Santoro,Andrew Lampinen,Kory Mathewson,Timothy Lillicrap,David Raposo

DOI: https://doi.org/10.48550/arXiv.2102.03406

IF: 14.4

2021-02-05

Artificial Intelligence

Abstract:The ability to use symbols is the pinnacle of human intelligence, but has yet to be fully replicated in machines. Here we argue that the path towards symbolically fluent artificial intelligence (AI) begins with a reinterpretation of what symbols are, how they come to exist, and how a system behaves when it uses them. We begin by offering an interpretation of symbols as entities whose meaning is established by convention. But crucially, something is a symbol only for those who demonstrably and actively participate in this convention. We then outline how this interpretation thematically unifies the behavioural traits humans exhibit when they use symbols. This motivates our proposal that the field place a greater emphasis on symbolic behaviour rather than particular computational mechanisms inspired by more restrictive interpretations of symbols. Finally, we suggest that AI research explore social and cultural engagement as a tool to develop the cognitive machinery necessary for symbolic behaviour to emerge. This approach will allow for AI to interpret something as symbolic on its own rather than simply manipulate things that are only symbols to human onlookers, and thus will ultimately lead to AI with more human-like symbolic fluency.
Imagination-Augmented Deep Learning for Goal Recognition

Thibault Duhamel,Mariane Maynard,Froduald Kabanza

DOI: https://doi.org/10.48550/arXiv.2003.09529

2020-03-21

Abstract:Being able to infer the goal of people we observe, interact with, or read stories about is one of the hallmarks of human intelligence. A prominent idea in current goal-recognition research is to infer the likelihood of an agent's goal from the estimations of the costs of plans to the different goals the agent might have. Different approaches implement this idea by relying only on handcrafted symbolic representations. Their application to real-world settings is, however, quite limited, mainly because extracting rules for the factors that influence goal-oriented behaviors remains a complicated task. In this paper, we introduce a novel idea of using a symbolic planner to compute plan-cost insights, which augment a deep neural network with an imagination capability, leading to improved goal recognition accuracy in real and synthetic domains compared to a symbolic recognizer or a deep-learning goal recognizer alone.

Artificial Intelligence
Goal and Plan Recognition Design for Plan Libraries

Reuth Mirsky,Kobi Gal,Roni Stern,Meir Kalech

DOI: https://doi.org/10.1145/3234464

IF: 5

2019-03-31

ACM Transactions on Intelligent Systems and Technology

Abstract:This article provides new techniques for optimizing domain design for goal and plan recognition using plan libraries. We define two new problems: Goal Recognition Design for Plan Libraries (GRD-PL) and Plan Recognition Design (PRD). Solving the GRD-PL helps to infer which goal the agent is trying to achieve, while solving PRD can help to infer how the agent is going to achieve its goal. For each problem, we define a worst-case distinctiveness measure that is an upper bound on the number of observations that are necessary to unambiguously recognize the agent’s goal or plan. This article studies the relationship between these measures, showing that the worst-case distinctiveness of GRD-PL is a lower bound of the worst-case plan distinctiveness of PRD and that they are equal under certain conditions. We provide two complete algorithms for minimizing the worst-case distinctiveness of plan libraries without reducing the agent’s ability to complete its goals: One is a brute-force search over all possible plans and one is a constraint-based search that identifies plans that are most difficult to distinguish in the domain. These algorithms are evaluated in three hierarchical plan recognition settings from the literature. We were able to reduce the worst-case distinctiveness of the domains using our approach, in some cases reaching 100% improvement within a predesignated time window. Our iterative algorithm outperforms the brute-force approach by an order of magnitude in terms of runtime.

computer science, information systems, artificial intelligence
Goal Recognition as Reinforcement Learning

Leonardo Rosa Amado,Reuth Mirsky,Felipe Meneguzzi

DOI: https://doi.org/10.1609/aaai.v36i9.21198

2022-02-14

Abstract:Most approaches for goal recognition rely on specifications of the possible dynamics of the actor in the environment when pursuing a goal. These specifications suffer from two key issues. First, encoding these dynamics requires careful design by a domain expert, which is often not robust to noise at recognition time. Second, existing approaches often need costly real-time computations to reason about the likelihood of each potential goal. In this paper, we develop a framework that combines model-free reinforcement learning and goal recognition to alleviate the need for careful, manual domain design, and the need for costly online executions. This framework consists of two main stages: Offline learning of policies or utility functions for each potential goal, and online inference. We provide a first instance of this framework using tabular Q-learning for the learning stage, as well as three measures that can be used to perform the inference stage. The resulting instantiation achieves state-of-the-art performance against goal recognizers on standard evaluation domains and superior performance in noisy environments.

Artificial Intelligence,Machine Learning
Synthesizing Evolving Symbolic Representations for Autonomous Systems

Gabriele Sartor,Angelo Oddi,Riccardo Rasconi,Vieri Giuliano Santucci,Rosa Meo

2024-09-18

Abstract:Recently, AI systems have made remarkable progress in various tasks. Deep Reinforcement Learning(DRL) is an effective tool for agents to learn policies in low-level state spaces to solve highly complex tasks. Researchers have introduced Intrinsic Motivation(IM) to the RL mechanism, which simulates the agent's curiosity, encouraging agents to explore interesting areas of the environment. This new feature has proved vital in enabling agents to learn policies without being given specific goals. However, even though DRL intelligence emerges through a sub-symbolic model, there is still a need for a sort of abstraction to understand the knowledge collected by the agent. To this end, the classical planning formalism has been used in recent research to explicitly represent the knowledge an autonomous agent acquires and effectively reach extrinsic goals. Despite classical planning usually presents limited expressive capabilities, PPDDL demonstrated usefulness in reviewing the knowledge gathered by an autonomous system, making explicit causal correlations, and can be exploited to find a plan to reach any state the agent faces during its experience. This work presents a new architecture implementing an open-ended learning system able to synthesize from scratch its experience into a PPDDL representation and update it over time. Without a predefined set of goals and tasks, the system integrates intrinsic motivations to explore the environment in a self-directed way, exploiting the high-level knowledge acquired during its experience. The system explores the environment and iteratively: (a) discover options, (b) explore the environment using options, (c) abstract the knowledge collected and (d) plan. This paper proposes an alternative approach to implementing open-ended learning architectures exploiting low-level and high-level representations to extend its knowledge in a virtuous loop.

Artificial Intelligence,Symbolic Computation
Intersymbolic AI: Interlinking Symbolic AI and Subsymbolic AI

André Platzer

2024-07-26

Abstract:This perspective piece calls for the study of the new field of Intersymbolic AI, by which we mean the combination of symbolic AI, whose building blocks have inherent significance/meaning, with subsymbolic AI, whose entirety creates significance/effect despite the fact that individual building blocks escape meaning. Canonical kinds of symbolic AI are logic, games and planning. Canonical kinds of subsymbolic AI are (un)supervised machine and reinforcement learning. Intersymbolic AI interlinks the worlds of symbolic AI with its compositional symbolic significance and meaning and of subsymbolic AI with its summative significance or effect to enable culminations of insights from both worlds by going between and across symbolic AI insights with subsymbolic AI techniques that are being helped by symbolic AI principles. For example, Intersymbolic AI may start with symbolic AI to understand a dynamic system, continue with subsymbolic AI to learn its control, and end with symbolic AI to safely use the outcome of the learned subsymbolic AI controller in the dynamic system. The way Intersymbolic AI combines both symbolic and subsymbolic AI to increase the effectiveness of AI compared to either kind of AI alone is likened to the way that the combination of both conscious and subconscious thought increases the effectiveness of human thought compared to either kind of thought alone. Some successful contributions to the Intersymbolic AI paradigm are surveyed here but many more are considered possible by advancing Intersymbolic AI.

Artificial Intelligence
A Survey on Goal Recognition as Planning

Felipe Meneguzzi,Ramon Fraga Pereira

DOI: https://doi.org/10.24963/ijcai.2021/616

2021-08-01

Abstract:Goal Recognition is the task of inferring an agent's goal, from a set of hypotheses, given a model of the environment dynamic, and a sequence of observations of such agent's behavior. While research on this problem gathered momentum as an offshoot of plan recognition, recent research has established it as a major subject of research on its own, leading to numerous new approaches that both expand the expressivity of domains in which to perform goal recognition and substantial advances to the state-of-the-art on established domain types. In this survey, we focus on the advances to goal recognition achieved in the last decade, categorizing the resulting techniques and identifying a number of opportunities for further breakthrough research.
Team Plan Recognition: A Review of the State of the Art

Loren Rieffer-Champlin

DOI: https://doi.org/10.54941/ahfe1003557

2023-01-31

Abstract:There is an increasing need to develop artificial intelligence systems that assist groups of humans working on coordinated tasks. These systems must recognize and understand the plans and relationships between actions for a team of humans working toward a common objective. This article reviews the literature on team plan recognition and surveys the most recent logic-based approaches for implementing it. First, we provide some background knowledge, including a general definition of plan recognition in a team setting and a discussion of implementation challenges. Next, we explain our reasoning for focusing on logic-based methods. Finally, we survey recent approaches from two primary classes of logic-based methods (plan library-based and domain theory-based). We aim to bring more attention to this sparse but vital topic and inspire new directions for implementing team plan recognition.

Artificial Intelligence,Multiagent Systems
Neurosymbolic AI -- Why, What, and How

Amit Sheth,Kaushik Roy,Manas Gaur

2023-05-01

Abstract:Humans interact with the environment using a combination of perception - transforming sensory inputs from their environment into symbols, and cognition - mapping symbols to knowledge about the environment for supporting abstraction, reasoning by analogy, and long-term planning. Human perception-inspired machine perception, in the context of AI, refers to large-scale pattern recognition from raw data using neural networks trained using self-supervised learning objectives such as next-word prediction or object recognition. On the other hand, machine cognition encompasses more complex computations, such as using knowledge of the environment to guide reasoning, analogy, and long-term planning. Humans can also control and explain their cognitive functions. This seems to require the retention of symbolic mappings from perception outputs to knowledge about their environment. For example, humans can follow and explain the guidelines and safety constraints driving their decision-making in safety-critical applications such as healthcare, criminal justice, and autonomous driving. This article introduces the rapidly emerging paradigm of Neurosymbolic AI combines neural networks and knowledge-guided symbolic approaches to create more capable and flexible AI systems. These systems have immense potential to advance both algorithm-level (e.g., abstraction, analogy, reasoning) and application-level (e.g., explainable and safety-constrained decision-making) capabilities of AI systems.

Artificial Intelligence
Method of Intelligent Plan Recognition

Zhang Lin,Liu Huayun,Cheng Weiming

DOI: https://doi.org/10.2991/icmra-15.2015.215

2015-01-01

Abstract:Plan recognition as an important research direction of artificial intelligence, are widely used in many aspects of the intelligent system. This article from the concept, classification, methods, research situation and application field, introduces the research of plan recognition. In this article, provide a certain theoretical basis for the further research plan recognition.
Symbolic Learning Enables Self-Evolving Agents

Wangchunshu Zhou,Yixin Ou,Shengwei Ding,Long Li,Jialong Wu,Tiannan Wang,Jiamin Chen,Shuai Wang,Xiaohua Xu,Ningyu Zhang,Huajun Chen,Yuchen Eleanor Jiang

2024-06-27

Abstract:The AI community has been exploring a pathway to artificial general intelligence (AGI) by developing "language agents", which are complex large language models (LLMs) pipelines involving both prompting techniques and tool usage methods. While language agents have demonstrated impressive capabilities for many real-world tasks, a fundamental limitation of current language agents research is that they are model-centric, or engineering-centric. That's to say, the progress on prompts, tools, and pipelines of language agents requires substantial manual engineering efforts from human experts rather than automatically learning from data. We believe the transition from model-centric, or engineering-centric, to data-centric, i.e., the ability of language agents to autonomously learn and evolve in environments, is the key for them to possibly achieve AGI. In this work, we introduce agent symbolic learning, a systematic framework that enables language agents to optimize themselves on their own in a data-centric way using symbolic optimizers. Specifically, we consider agents as symbolic networks where learnable weights are defined by prompts, tools, and the way they are stacked together. Agent symbolic learning is designed to optimize the symbolic network within language agents by mimicking two fundamental algorithms in connectionist learning: back-propagation and gradient descent. Instead of dealing with numeric weights, agent symbolic learning works with natural language simulacrums of weights, loss, and gradients. We conduct proof-of-concept experiments on both standard benchmarks and complex real-world tasks and show that agent symbolic learning enables language agents to update themselves after being created and deployed in the wild, resulting in "self-evolving agents".

Computation and Language,Artificial Intelligence,Machine Learning
SGL: Symbolic Goal Learning in a Hybrid, Modular Framework for Human Instruction Following

Ruinian Xu,Hongyi Chen,Yunzhi Lin,Patricio A. Vela

DOI: https://doi.org/10.1109/lra.2022.3190076

IF: 5.2

2022-10-01

IEEE Robotics and Automation Letters

Abstract:This paper investigates human instruction following for robotic manipulation via a hybrid, modular system with symbolic and connectionist elements. Symbolic methods build modular systems with semantic parsing and task planning modules for producing sequences of actions from natural language requests. Modern connectionist methods employ deep neural networks that learn visual and linguistic features for mapping inputs to a sequence of low-level actions, in an end-to-end fashion. The hybrid, modular system blends these two approaches to create a modular framework: it formulates instruction following as symbolic goal learning via deep neural networks followed by task planning via symbolic planners. Connectionist and symbolic modules are bridged with Planning Domain Definition Language. The vision-and-language learning network predicts its goal representation, which is sent to a planner for producing a task-completing action sequence. For improving the flexibility of natural language, we further incorporate implicit human intents with explicit human instructions. To learn generic features for vision and language, we propose to separately pretrain vision and language encoders on scene graph parsing and semantic textual similarity tasks. Benchmarking evaluates the impacts of different components of, or options for, the vision-and-language learning model and shows the effectiveness of pretraining strategies. Manipulation experiments conducted in the simulator AI2THOR show the robustness of the framework to novel scenarios.

robotics
From Gameplay to Symbolic Reasoning: Learning SAT Solver Heuristics in the Style of Alpha(Go) Zero

Fei Wang,Tiark Rompf

DOI: https://doi.org/10.48550/arXiv.1802.05340

2018-02-15

Abstract:Despite the recent successes of deep neural networks in various fields such as image and speech recognition, natural language processing, and reinforcement learning, we still face big challenges in bringing the power of numeric optimization to symbolic reasoning. Researchers have proposed different avenues such as neural machine translation for proof synthesis, vectorization of symbols and expressions for representing symbolic patterns, and coupling of neural back-ends for dimensionality reduction with symbolic front-ends for decision making. However, these initial explorations are still only point solutions, and bear other shortcomings such as lack of correctness guarantees. In this paper, we present our approach of casting symbolic reasoning as games, and directly harnessing the power of deep reinforcement learning in the style of Alpha(Go) Zero on symbolic problems. Using the Boolean Satisfiability (SAT) problem as showcase, we demonstrate the feasibility of our method, and the advantages of modularity, efficiency, and correctness guarantees.

Artificial Intelligence
Neurosymbolic Artificial Intelligence (Why, What, and How)

Amit Sheth,Kaushik Roy,Manas Gaur

DOI: https://doi.org/10.1109/mis.2023.3268724

IF: 6.744

2023-06-13

IEEE Intelligent Systems

Abstract:Humans interact with the environment using a combination of perception—transforming sensory inputs from their environment into symbols, and cognition—mapping symbols to knowledge about the environment for supporting abstraction, reasoning by analogy, and long-term planning. Human perception-inspired machine perception, in the context of artificial intelligence (AI), refers to large-scale pattern recognition from raw data using neural networks trained using self-supervised learning objectives such as next-word prediction or object recognition. On the other hand, machine cognition encompasses more complex computations, such as using knowledge of the environment to guide reasoning, analogy, and long-term planning. Humans can also control and explain their cognitive functions. This seems to require the retention of symbolic mappings from perception outputs to knowledge about their environment. For example, humans can follow and explain the guidelines and safety constraints driving their decision making in safety-critical applications such as health care, criminal justice, and autonomous driving.

computer science, artificial intelligence,engineering, electrical & electronic

Introduction to Symbolic Plan and Goal Recognition

Robust Neuro-Symbolic Goal and Plan Recognition

Combining Symbolic and Statistical Knowledge for Goal Recognition in Smart Home Environments

Evaluation of Goal Recognition Systems on Unreliable Data and Uninspectable Agents

Cost-Based Goal Recognition Meets Deep Learning

Activity, Plan, and Goal Recognition: A Review

Plan-Similarity Based Heuristics for Goal Recognition

Symbolic Behaviour in Artificial Intelligence

Imagination-Augmented Deep Learning for Goal Recognition

Goal and Plan Recognition Design for Plan Libraries

Goal Recognition as Reinforcement Learning

Synthesizing Evolving Symbolic Representations for Autonomous Systems

Intersymbolic AI: Interlinking Symbolic AI and Subsymbolic AI

A Survey on Goal Recognition as Planning

Team Plan Recognition: A Review of the State of the Art

Neurosymbolic AI -- Why, What, and How

Method of Intelligent Plan Recognition

Symbolic Learning Enables Self-Evolving Agents

SGL: Symbolic Goal Learning in a Hybrid, Modular Framework for Human Instruction Following

From Gameplay to Symbolic Reasoning: Learning SAT Solver Heuristics in the Style of Alpha(Go) Zero

Neurosymbolic Artificial Intelligence (Why, What, and How)