Abstract:How do people learn to talk about the causal and temporal relations between events, and the motivation behind why people do what they do? The narrative practice hypothesis of Hutto and Gallagher holds that children are exposed to narratives that provide training for understanding and expressing reasons for why people behave as they do. In this context, we have recently developed a model of narrative processing where a structured model of the developing situation (the situation model) is built up from experienced events, and enriched by sentences in a narrative that describe event meanings. The main interest is to develop a proof of concept for how narrative can be used to structure, organize and describe experience. Narrative sentences describe events, and they also define temporal and causal relations between events. These relations are specified by a class of narrative function words, including “because, before, after, first, finally.” The current research develops a proof of concept that by observing how people describe social events, a developmental robotic system can begin to acquire early knowledge of how to explain the reasons for events. We collect data from naïve subjects who use narrative function words to describe simple scenes of human-robot interaction, and then employ algorithms for extracting the statistical structure of how narrative function words link events in the situation model. By using these statistical regularities, the robot can thus learn from human experience about how to properly employ in question-answering dialogues with the human, and in generating canonical narratives for new experiences. The behavior of the system is demonstrated over several behavioral interactions, and associated narrative interaction sessions, while a more formal extended evaluation and user study will be the subject of future research. Clearly this is far removed from the power of the full blown narrative practice capability, but it provides a first step in the development of an experimental infrastructure for the study of socially situated narrative practice in human-robot interaction.

Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks

Interactive Natural Language Acquisition in a Multi-modal Recurrent Neural Architecture

Development of Compositionality and Generalization through Interactive Learning of Language and Action of Robots

Imitation learning of motor primitives and language bootstrapping in robots

Crossmodal Language Grounding in an Embodied Neurocognitive Model

Towards Understanding Language through Perception in Situated Human-Robot Interaction: From Word Grounding to Grammar Induction

Learning to Use Narrative Function Words for the Organization and Communication of Experience

Interactive Robot Learning of Gestures, Language and Affordances

Narrative Constructions for the Organization of Self Experience: Proof of Concept via Embodied Robotics

Collaborative Language Grounding Toward Situated Human‐Robot Dialogue

Language-Conditioned Imitation Learning for Robot Manipulation Tasks

Incremental Learning of Humanoid Robot Behavior from Natural Interaction and Large Language Models

Natural Language for Human-Robot Collaboration: Problems Beyond Language Grounding

Modelling constructivist language acquisition through syntactico-semantic pattern finding

Language bootstrapping: learning word meanings from perception-action association

Conversational Language Models for Human-in-the-Loop Multi-Robot Coordination

SGL: Symbolic Goal Learning in a Hybrid, Modular Framework for Human Instruction Following

Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions

Learning to generate pointing gestures in situated embodied conversational agents

Learning from humans to build social cognition among robots

Timed Petri nets for fluent turn-taking over multimodal interaction resources in human-robot collaboration