Embracing Non-Natural Design in Human-Computer Interaction
Radu-Daniel Vatavu
DOI: https://doi.org/10.1145/3656650.3660545
2024-06-03
Abstract:Decades ago, the natural interaction design paradigm has brought about a revolutionary shift in perspective regarding how interactions with computer systems could and should take place. By promoting intuition, familiarity, and context matching, natural interactions leverage users’ best capabilities to engage in effective dialogue with their computer interlocutors. Natural interaction has prevailed and transpires today in the way we use gestures, voice, or eye gaze to interact with mobile and wearable devices, communicate with personal assistants, play video games through whole-body movements, and engage with public ambient displays. However, recent contexts of use, represented by novel extended reality environments, computer systems designed to augment the human body, and creative designs of assistive technology, have resulted in interactions that can no longer be characterized as “natural.” In fact, the opposite of natural is true for them. An interaction technique for retrieving digital files from thin air, without any feedback other than within users’ own imagination, does not follow natural design guidelines, but can nevertheless prove effective. Alternating between normal and whispered voices is not a natural speech behavior, yet it enables effective discrimination between commands addressed to the system and actual speech to be transformed into text input. Eyelid gestures, reproducing movement patterns, are not natural for how we normally close and open our eyes, but are effective input for users with motor impairments. In this context, I will discuss non-natural interaction design [5], a transformative and creative process in Human-Computer Interaction research and practice that leads to highly usable and effective interactions with computer systems by deliberately deviating from users’ expectations and their experience of engaging with the natural, physical world. Non-natural interactions are surprising, unexpected, thought-provoking and, by design, non natural. Yet, they foster usability, accessibility, and efficiency for users. In my talk, I will exemplify the paradigm of non-natural interaction design through practical use cases developed and examined in my lab, spanning from wearable devices that challenge user agency [1] to smart buildings featuring invisible layers of digital content anchored in thin air [3], augmenting and extending the human body with virtual limbs [4], and computer-supported worlds that enable switching between different reality augmentations [2].
Computer Science