Abstract:Abstract Speech interfaces are growing in popularity. Through a review of 99 research papers this work maps the trends, themes, findings and methods of empirical research on speech interfaces in the field of human–computer interaction (HCI). We find that studies are usability/theory-focused or explore wider system experiences, evaluating Wizard of Oz, prototypes or developed systems. Measuring task and interaction was common, as was using self-report questionnaires to measure concepts like usability and user attitudes. A thematic analysis of the research found that speech HCI work focuses on nine key topics: system speech production, design insight, modality comparison, experiences with interactive voice response systems, assistive technology and accessibility, user speech production, using speech technology for development, peoples’ experiences with intelligent personal assistants and how user memory affects speech interface interaction. From these insights we identify gaps and challenges in speech research, notably taking into account technological advancements, the need to develop theories of speech interface interaction, grow critical mass in this domain, increase design work and expand research from single to multiple user interaction contexts so as to reflect current use contexts. We also highlight the need to improve measure reliability, validity and consistency, in the wild deployment and reduce barriers to building fully functional speech interfaces for research. RESEARCH HIGHLIGHTS Most papers focused on usability/theory-based or wider system experience research with a focus on Wizard of Oz and developed systems Questionnaires on usability and user attitudes often used but few were reliable or validated Thematic analysis showed nine primary research topics Challenges identified in theoretical approaches and design guidelines, engaging with technological advances, multiple user and in the wild contexts, critical research mass and barriers to building speech interfaces

Listening to the Voices: Describing Ethical Caveats of Conversational User Interfaces According to Experts and Frequent Users

Ethical Design of Conversational Agents: Towards Principles for a Value-Sensitive Design

Embrace your incompetence! Designing appropriate CUI communication through an ecological approach

CUI@CHI 2024: Building Trust in CUIs-From Design to Deployment

Ethical User Interfaces: Exploring the Effects of Dark Patterns on Facebook

Investigating Usability of Conversational User Interfaces for Integrated System-Physical Interactions: A Medical Device Perspective

Who are CUIs Really For? Representation and Accessibility in the Conversational User Interface Literature

Defending Against the Dark Arts: Recognising Dark Patterns in Social Media

From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UX

Computers as Bad Social Actors: Dark Patterns and Anti-Patterns in Interfaces that Act Socially

Revolution or Evolution? Speech Interaction and HCI Design Guidelines

About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services

Towards Responsible AI: A Design Space Exploration of Human-Centered Artificial Intelligence User Interfaces to Investigate Fairness

"It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agents

Ethical Considerations in AI-Driven User Interfaces

Beyond Dark Patterns: A Concept-Based Framework for Ethical Software Design

The State of Speech in HCI: Trends, Themes and Challenges

CUI@IUI: Theoretical and Methodological Challenges in Intelligent Conversational User Interface Interactions

From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agents

Characterizing and modeling harms from interactions with design patterns in AI interfaces

Designing a Dashboard for Transparency and Control of Conversational AI