Abstract:There have been impressive advancements in the field of natural language processing (NLP) in recent years, largely driven by innovations in the development of transformer-based large language models (LLM) that utilize "attention." This approach employs masked self-attention to establish (via similarly) different positions of tokens (words) within an inputted sequence of tokens to compute the most appropriate response based on its training corpus. However, there is speculation as to whether this approach alone can be scaled up to develop emergent artificial general intelligence (AGI), and whether it can address the alignment of AGI values with human values (called the alignment problem). Some researchers exploring the alignment problem highlight three aspects that AGI (or AI) requires to help resolve this problem: (1) an interpretable values specification; (2) a utility function; and (3) a dynamic contextual account of behavior. Here, a neurosymbolic model is proposed to help resolve these issues of human value alignment in AI, which expands on the transformer-based model for NLP to incorporate symbolic reasoning that may allow AGI to incorporate perspective-taking reasoning (i.e., resolving the need for a dynamic contextual account of behavior through deictics) as defined by a multilevel evolutionary and neurobiological framework into a functional contextual post-Skinnerian model of human language called "Neurobiological and Natural Selection Relational Frame Theory" (N-Frame). It is argued that this approach may also help establish a comprehensible value scheme, a utility function by expanding the expected utility equation of behavioral economics to consider functional contextualism, and even an observer (or witness) centric model for consciousness. Evolution theory, subjective quantum mechanics, and neuroscience are further aimed to help explain consciousness, and possible implementation within an LLM through correspondence to an interface as suggested by N-Frame. This argument is supported by the computational level of hypergraphs, relational density clusters, a conscious quantum level defined by QBism, and real-world applied level (human user feedback). It is argued that this approach could enable AI to achieve consciousness and develop deictic perspective-taking abilities, thereby attaining human-level self-awareness, empathy, and compassion toward others. Importantly, this consciousness hypothesis can be directly tested with a significance of approximately 5-sigma significance (with a 1 in 3.5 million probability that any identified AI-conscious observations in the form of a collapsed wave form are due to chance factors) through double-slit intent-type experimentation and visualization procedures for derived perspective-taking relational frames. Ultimately, this could provide a solution to the alignment problem and contribute to the emergence of a theory of mind (ToM) within AI.

Neuro-Symbolic VQA: A review from the perspective of AGI desiderata

Confidence-based Interactable Neural-Symbolic Visual Question Answering.

Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding

Neuro-Symbolic Visual Reasoning: Disentangling "Visual" from "Reasoning"

A Symbolic-Neural Reasoning Model for Visual Question Answering

Neuro-symbolic artificial intelligence: a survey

Neurosymbolic Value-Inspired Artificial Intelligence (Why, What, and How)

Neurosymbolic Value-Inspired AI (Why, What, and How)

Is neuro-symbolic AI meeting its promises in natural language processing? A structured review

Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Review

Neurosymbolic AI: the 3rd wave

A Survey on Verification and Validation, Testing and Evaluations of Neurosymbolic Artificial Intelligence

VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges

Towards Cognitive AI Systems: a Survey and Prospective on Neuro-Symbolic AI

Guiding Vision-Language Model Selection for Visual Question-Answering Across Tasks, Domains, and Knowledge Types

A functional contextual, observer-centric, quantum mechanical, and neuro-symbolic approach to solving the alignment problem of artificial general intelligence: safe AI through intersecting computational psychological neuroscience and LLM architecture for emergent theory of mind

A Vertical-Horizontal Integrated Neuro-Symbolic Framework Towards Artificial General Intelligence.

VisQA: X-raying Vision and Language Reasoning in Transformers

Visual question answering: Datasets, algorithms, and future challenges

Explicit Reasoning over End-to-End Neural Architectures for Visual Question Answering

Neural-Symbolic VideoQA: Learning Compositional Spatio-Temporal Reasoning for Real-world Video Question Answering