Frank Förster,Marta Romeo,Patrick Holthaus,Luke J Wood,Christian Dondrup,Joel E Fischer,Farhana Ferdousi Liza,Sara Kaszuba,Julian Hough,Birthe Nesset,Daniel Hernández García,Dimosthenis Kontogiorgos,Jennifer Williams,Elif Ecem Özkan,Pepita Barnard,Gustavo Berumen,Dominic Price,Sue Cobb,Martina Wiltschko,Lucien Tisserand,Martin Porcheron,Manuel Giuliani,Gabriel Skantze,Patrick G T Healey,Ioannis Papaioannou,Dimitra Gkatzia,Saul Albert,Guanyu Huang,Vladislav Maraev,Epaminondas Kapetanios

Abstract:This paper summarizes the structure and findings from the first Workshop on Troubles and Failures in Conversations between Humans and Robots. The workshop was organized to bring together a small, interdisciplinary group of researchers working on miscommunication from two complementary perspectives. One group of technology-oriented researchers was made up of roboticists, Human-Robot Interaction (HRI) researchers and dialogue system experts. The second group involved experts from conversation analysis, cognitive science, and linguistics. Uniting both groups of researchers is the belief that communication failures between humans and machines need to be taken seriously and that a systematic analysis of such failures may open fruitful avenues in research beyond current practices to improve such systems, including both speech-centric and multimodal interfaces. This workshop represents a starting point for this endeavour. The aim of the workshop was threefold: Firstly, to establish an interdisciplinary network of researchers that share a common interest in investigating communicative failures with a particular view towards robotic speech interfaces; secondly, to gain a partial overview of the "failure landscape" as experienced by roboticists and HRI researchers; and thirdly, to determine the potential for creating a robotic benchmark scenario for testing future speech interfaces with respect to the identified failures. The present article summarizes both the "failure landscape" surveyed during the workshop as well as the outcomes of the attempt to define a benchmark scenario.

Troubles and Failures in Interactional Language. Towards a Linguistically Informed Taxonomy

Dialogue Learning with Human-in-the-Loop.

Unraveling the thread: understanding and addressing sequential failures in human-robot interaction

LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models

Towards Interactive Language Modeling

What should I say? -- Interacting with AI and Natural Language Interfaces

Evaluating Human-Language Model Interaction

An Interactional Account of Empathy in Human-Machine Communication

Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs

Working with roubles and failures in conversation between humans and robots: workshop report

Mapping Perceptions of Humanness in Speech-Based Intelligent Personal Assistant Interaction

The Grammar of Interactional Language

Talking about interaction*

Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)

Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred on respect

Listen, Interact and Talk: Learning to Speak via Interaction

User or Labor: An Interaction Framework for Human-Machine Relationships in NLP

Exploring Links between Conversational Agent Design Challenges and Interdisciplinary Collaboration

A Survey on Dialogue Management in Human-Robot Interaction

Language Models in Dialogue: Conversational Maxims for Human-AI Interactions

Intelligent Collaboration of Humans and Language-Based Assistants (INSTANT)