Abstract:Previous work on player experience research has focused on identifying the major factors involving content creation and interaction. This has encouraged a large investment in new types of physical interaction artefacts (e.g. Wiimote™, Rock Band™, Kinect™). However, these artefacts still require custom interaction schemes to be developed for them, which critically limits the number of commercial videogames and multimedia applications that can benefit from those. Moreover, there is currently no agreement as to which factors better describe the impact that natural and complex multi-modal user interaction schemes have on users’ experiences—a gap in part created by the limitations in adapting this type of interaction to existing software. Thus, this paper presents a generic middleware framework for multi-modal natural interfaces which enables game-independent data acquisition that encourages further advancement on this domain. Furthermore, our framework can then redefine the interaction scheme of any software tool by mapping body poses and voice commands to traditional input means (keyboard and mouse). We have focused on digital games, where the use of physical interaction artefacts has become mainstream. The validation methods for this tool consisted of a series of increasing difficulty stress tests, with a total of 25 participants. Also, a pilot study was conducted on a further 16 subjects which demonstrated mainly positive impact of natural interfaces on player’s experience. The results supporting this were acquired when subjects played a complex commercial role-playing game whose mechanics were adapted using our framework; statistical tests on the obtained Fun ratings, along with subjective participant opinions indicate that this kind of natural interaction indeed has a significant impact on player’s experience and enjoyment. However, different impact patterns emerge from this analysis, which seem to fit with standing theories of player experience and immersion.

Crosston Tavern: Modulating Autonomous Characters Behaviour through Player-NPC Conversation

Emergent social NPC interactions in the Social NPCs Skyrim mod and beyond

Action-based Character AI in Video-games with CogBots Architecture: A Preliminary Report

New And Surprising Ways to Be Mean. Adversarial NPCs with Coupled Empowerment Minimisation

Managing the Personality of NPCs with Your Interactions: A Game Design System Based on Large Language Models

NPCs as People, Too: The Extreme AI Personality Engine

A generative model of group conversation

Collaborative Quest Completion with LLM-driven Non-Player Characters in Minecraft

Art critic: Multisignal vision and speech interaction system in a gaming context

Towards Interactive Training of Non-Player Characters in Video Games

Exploring Gameplay With AI Agents

Non-player character decision-making in computer games

NPC AI System Based on Gameplay Recordings

A Framework for Complementary Companion Character Behavior in Video Games

A Qualitative Investigation to Design Empathetic Agents as Conversation Partners for People with Autism Spectrum Disorder

Multi-modal natural interaction in game design: a comparative analysis of player experience in a large scale role-playing game

Informing a BDI Player Model for an Interactive Narrative

Exploring Data-Driven Components of Socially Intelligent AI through Cooperative Game Paradigms

AI & NPC IN GAMES

The NPC AI of The Last of Us: A case study

Learning to Speak and Act in a Fantasy Text Adventure Game