Abstract:(arXiv abridged abstract) In the last two decades, videogames have evolved in a nearly explosive way from the pixelated graphics to today's near-realistic 3D environments. The interaction devices traditionally used in videogames have not evolved with the same intensity, but recent HCI studies have explored biofeedback interaction - the explicit manipulation of a person's physiological data as input to a system - as an alternative to them. Traditional biofeedback prototypes apply 1 sensor to each game mechanic (unimodality). In this dissertation, we introduce the combination of 2 physiological sensors simultaneously per game mechanic (multimodality) and present a First-Person Shooter game comprised of 8 game mechanics with three interaction flavours (no biofeedback/vanilla, unimodal and multimodal). An empirical study with 32 regular players was employed to explore and study differences between the three interaction types and where they can be best employed. Players compared the three games in terms of Fun, Ease of Use, Originality, Playability and Favourite Condition. For the sake of completeness, other evaluation methods were used as well: IMI Questionnaire, keywords association and open-ended commentaries. The vanilla version was considered easier to use, but both biofeedback versions were considered the most fun. Both versions were praised differently: the unimodal version for its simplicity of use, and the multimodal for its realism, activation safety of game mechanics and depth added to the game. Our conclusion is that multimodal biofeedback can have a relevant impact in terms of added depth, depending on the way it is used inside the game. On a boundary case, it can be used to increase the feeling of empowerment on the player when using certain abilities, or to intentionally make in-game actions more difficult by demanding more physical effort from the player.

Investigating Perceived and Mechanical Challenge in Games Through Cognitive Activity

Study on the Change of Physiological Signals During Playing Body-Controlled Games

Affective Response to Volitional Input Perturbations in Obstacle Avoidance and Target Tracking Games

Difficulty-skill balance does not affect engagement and enjoyment: a pre-registered study using artificial intelligence-controlled difficulty

Investigation of the effects of game difficulty on the engagement level of patient with brain injury during rehabilitation exercise

Evaluation of an Adaptive Game that Uses EEG Measures Validated during the Design Process as Inputs to a Biocybernetic Loop

Neuronal Correlates of Cognitive Control during Gaming Revealed by Near-Infrared Spectroscopy

Player involvement as a result of difficulty: An introductory study to test the suitability of the motivational intensity approach to video game research

Assessing the Effects of Various Gaming Platforms on Players' Affective States and Workloads through Electroencephalogram

Multimodal vs. Unimodal Physiological Control in Videogames for Enhanced Realism and Depth

Dynamic difficulty adjustment approaches in video games: a systematic literature review

Exploring Dynamic Difficulty Adjustment in Videogames

Effects of the self-perceived sensorimotor demand and immersion during video gaming on visual-attention skills

Manipulating Interface Design Features Affects Children's Stop-And-Think Behaviours in a Counterintuitive-Problem Game

A Multimodal Analysis Combining Behavioral Experiments and Survey-Based Methods to Assess the Cognitive Effect of Video Game Playing: Good or Evil?

Effects of player-video game interaction on the mental effort of older adults with the use of electroencephalography and NASA-TLX

Shooting Your Accuracy in the Foot? Examining the Short-Term Effect of Playing an Action or Strategy Video Game on Cognitive Control

Player Dominance Adjustment in Games

Acute and long-lasting cortical thickness changes following intensive first-person action videogame practice

Modeling cognitive load and physiological arousal through pupil diameter and heart rate

Changes in Mental Workload and Motor Performance Throughout Multiple Practice Sessions Under Various Levels of Task Difficulty.