Against Interaction Design

Tim Murray-Browne

DOI: https://doi.org/10.48550/arXiv.2210.06467

IF: 6.4588

2022-09-30

Human-Computer Interaction

Abstract:Against Interaction Design is a short manifesto that distils a position that's emerged through a decade of creating interactive art. I intend it here as a provocation and a speculation on an alternative future relationship between people and machines.

What problem does this paper attempt to address?

Interactivity by design : creating & communicating with new media

R. Kristof,Amy Satran

Abstract:What is interactivity? Introduction. I. INFORMATION DESIGN. Product definition. Audience and environment. What do users want? Development choices. Raw Materials. Planning. Organization. The flowchart. II. INTERACTION DESIGN. Orientation. Image maps and metaphors. Navigation. Usability. Functionality. The storyboard. III. PRESENTATION DESIGN. Digital media survival kit. Resolution. Anti-aliasing. Color and palettes. Compression is your friend. Laws of survival. Setting the style. How content defines style. Stylistic unity. Interface families. Layout. Layout conventions. Grids. Backgrounds. Windows and panels. Buttons and other controls. Images. Text. Video. Sound. Animating the screen. Putting it all together. The Prototype. Conclusion. Resource Guide. Credits. Index.

Computer Science,Art
Post-human interaction design, yes, but cautiously

Jelle van Dijk

DOI: https://doi.org/10.48550/arXiv.2005.05019

2020-05-08

Abstract:Post-human design runs the risk of obscuring the fact that AI technology actually imports a Cartesian humanist logic, which subsequently influences how we design and conceive of so-called smart or intelligent objects. This leads to unwanted metaphorical attributions of human qualities to smart objects. Instead, starting from an embodied sensemaking perspective, designers should demand of engineers to radically transform the very structure of AI technology, in order to truly support critical posthuman values of collectivity, relationality and community building.

Human-Computer Interaction,Artificial Intelligence
Interaction and resistance: The recognition of intentions in new human-computer interaction

Vincent C. Müller

DOI: https://doi.org/10.1007/978-3-642-18184-9_1

2016-06-10

Abstract:Just as AI has moved away from classical AI, human-computer interaction (HCI) must move away from what I call 'good old fashioned HCI' to 'new HCI' - it must become a part of cognitive systems research where HCI is one case of the interaction of intelligent agents (we now know that interaction is essential for intelligent agents anyway). For such interaction, we cannot just 'analyze the data', but we must assume intentions in the other, and I suggest these are largely recognized through resistance to carrying out one's own intentions. This does not require fully cognitive agents but can start at a very basic level. New HCI integrates into cognitive systems research and designs intentional systems that provide resistance to the human agent.

Human-Computer Interaction
Interface Design Aesthetics of Interaction Design

Yan Liu,Qiong Zhang

DOI: https://doi.org/10.1007/978-3-030-23570-3_21

2019-01-01

Abstract:Esslinger believed that the 1950s was the era of production, the 1960s was the era of research and development, the 1970s was the era of marketing, the 1980s was the era of finance, and the 1990s was the era of integration, today is the era of intelligence. With the development of science and technology, human–computer interaction become an indispensable dynamic in life. How to strengthen human–computer interaction to make the product design more humanity is very important, so we need to think and research from the user’s perspective. Design plays an important role in artificial intelligence – every step from imagination to product cannot be separated from design. It is also very important for interface design in human–computer interaction design. No matter what kind of product it is, the first thing it will show people is the visual experience, and then it will produce interaction and deep experience. Therefore, design can be said to be the explorer, which must be ahead of the public thinking. In other words, design is the visual present one and design is the practitioner of imagination. Only in this way can we design works that satisfy the public. In intelligent interaction, what the design embodies is to allow users to have more in-depth experience and abandon the external form of design. Designers begin to think more deeply about what design means to people, cities and life. What does design shape the user experience? Esslinger once said, “the purpose of design is to create a more human environment. My goal has always been to design mainstream products as art.” According to the functions and characteristics of multi-sensory human–computer interaction interface, the design principles of simplicity and aesthetics, unity and diversity, ease of use and interactivity, static and dynamic, and rationality and sensibility are put forward.
The design of natural interaction

Alessandro Valli

DOI: https://doi.org/10.1007/s11042-007-0190-z

IF: 2.577

2008-01-06

Multimedia Tools and Applications

Abstract:This paper addresses the problem of the relationship between humans and technology-enhanced spaces and physical objects (later defined as artifacts). The class of cases here analyzed includes interactive digital signage, information kiosks, home media centers and interactive spaces whose purpose is the communication of a meaning. In this domain, complex interfaces are not needed, as common people interaction with information, content and media is in most cases extremely simple. The topic of specialized interfaces for expert users is not addressed here; the focus is on interfaces for the general public, whose main purpose is the basic fruition of digital information, although such information can be large and complex in its organization. This paper is centered on the need of conceiving computer sensing and information presentation as different aspects of the same interaction design problem, instead of separate research entities.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
AI Design, Design AI, Human-Centred AI and the Theatre of the Absurd the language, life and times of a UX designer

Rebekah Rousi

2023-04-21

Abstract:This article connects the concepts and phenomena of Design AI, AI in creative industries and AIs capacity for creativity. It links Design AI to UX design and UX designer discourse. Its vagueness and the prominence of UX designers as speakers and writers in the spectacle of cultural AI discourse. The article then, draws comparisons between the Theatre of the Absurd and the UX designer performances of design AI. It additionally sheds light on ToA and the human condition in terms of existentialism, present within the practice of engaging in design that intends to link human experience to technological system logic. This is a theoretical article that utilises examples from UX events published on Youtube, as well as UX designer blogs, in order to illustrate the mechanics of the ToA present within contemporary AI and UX designer discourse.

Human-Computer Interaction
Talking about interaction*

Stuart Reeves,Jordan Beck

DOI: https://doi.org/10.1016/j.ijhcs.2019.05.010

2019-05-28

Abstract:Recent research has exposed disagreements over the nature and usefulness of what may (or may not) be Human-Computer Interaction's fundamental phenomenon: 'interaction'. For some, HCI's theorising about interaction has been deficient, impacting its capacity to inform decisions in design, suggesting the need either to perform first-principles definition work or broader administrative clarification and formalisation of the multitude of formulations of the concepts of interaction and their particular uses. For others, there remain open questions over the continued relevance of certain 'versions' of interaction as a useful concept in HCI at all. We pursue a different perspective in this paper, reviewing how HCI treats interaction through examining its 'conceptual pragmatics' within HCI's discourse. We argue that articulations of the concepts of interaction can be a site of productive conflict for HCI that for many reasons may resist attempts of formalisation as well as attempts to dispense with them. The main contribution of this paper is in specifying how we might go about talking of interaction and the value of interaction language as promiscuous concepts.

Human-Computer Interaction
Sentient House: Designing for Discourse

Robert Collins

DOI: https://doi.org/10.48550/arxiv.2406.09419

IF: 6.4588

2024-02-14

Human-Computer Interaction

Abstract:The Sentient House project is an investigation into approaches that the artistdesigner can take to better involve the public in developing a critical perspective on pervasive technology in the home and the surrounding environment. Using Interaction Design approaches including workshops, surveys, rapidprototyping and critical thinking, this thesis suggests a framework for developing a more participatory atmosphere for Critical Design. As the world becomes more connected, and smarter, citizens concerns are being sidelined in favour of rapid progress and solutionism. Many of these initiatives are backed by government and commercial concerns who may not have the publics best interest at heart. The designs and approaches generated from this public participation seek to provide an outlet for a more agonistic debate and to develop tools and approaches to engage the public in questioning and addressing how technology affects them in the future. The outcomes of this research suggest that the public is receptive to a more active involvement in designing their digital future, and that the designer can be a critical component in revealing hidden consequences and alternative pathways for a more transparent and desirable future.
Exteraction

Jie Hao,Yuehan Pan,Qiheng Zhu,Zhiyong Fu

DOI: https://doi.org/10.1145/3202667.3202668

2018-01-01

Abstract:With the recent development of new interactive technologies we are witnessing a divide between human activities and the virtual world. After reaching its most glamorous period, the existing representation of interaction has been questioned from various perspectives. This article describes a new definition of Exteraction that explores the extent to which a combination of grounded theory and decentralization approaches can be useful in understanding the process of information exchanging activities. By analyzing the limitation through cross-sectional phenomenon including online services, art installation and film, this article helps formulate the characteristics of the following elements beyond interaction: the changeability and versatility of user experience; the greater accuracy of filtered information; holistic tolerance of reflecting both individual and entire value; re-evaluating people's position within the process and navigating the unknown data based on revealing the existing. All of these have provided a summary of the opportunities and gaps of both approaches that will later be identified as a highly flexible method -- Exteraction, which can adapt to many contexts and conditions. The mock-up projects which are illustrating the idea of Exteraction have been created based on the results of the initial case studies. It is expected that by doing so, the methodological understanding of the approach can be deepened to conduct research and design projects in the near future. In other words, this would enable people to validate the findings and would also broaden the understanding of how to best involve Exteraction in the process of developing a more sustainable framework.
Socio-technical systems and interaction design - 21st century relevance

Martin Maguire

DOI: https://doi.org/10.1016/j.apergo.2013.05.011

Abstract:This paper focuses on the relationship between the socio-technical system and the user-technology interface. It looks at specific aspects of the organisational context such as multiple user roles, job change, work processes and workflows, technical infrastructure, and the challenges they present for the interaction designer. The implications of trends such as more mobile and flexible working, the use of social media, and the growth of the virtual organisation, are also considered. The paper also reviews rapidly evolving technologies such as pervasive systems and artificial intelligence, and the skills that workers will need to engage with them.
Computer Interfaces to Organizations: Perspectives on Borg-Human Interaction Design

Claudio Pinhanez

DOI: https://doi.org/10.48550/arXiv.1712.03012

IF: 6.4588

2017-12-08

Human-Computer Interaction

Abstract:We use the term borg to refer to the complex organizations composed of people, machines, and processes with which users frequently interact using computer interfaces and websites. Unlike interfaces to pure machines, we contend that borg-human interaction (BHI) happens in a context combining the anthropomorphization of the interface, conflict with users, and dramatization of the interaction process. We believe this context requires designers to construct the human facet of the borg, a structure encompassing the borg's personality, social behavior, and embodied actions; and the strategies to co-create dramatic narratives with the user. To design the human facet of a borg, different concepts and models are explored and discussed, borrowing ideas from psychology, sociology, and arts. Based on those foundations, we propose six design methodologies to complement traditional computer-human interface design techniques, including play-and-freeze enactment of conflicts and the use of giant puppets as interface prototypes.
A Product Design Based on Interaction Design and Axiomatic Design Theory

Run-jie Lu,Yi-xiong Feng,Hao Zheng,Jian-rong Tan

DOI: https://doi.org/10.1016/j.procir.2016.07.061

2016-01-01

Procedia CIRP

Abstract:With the development of technology, the improvement of living standards, personalized designs that emphasize diversity and self-fulfillment are becoming more and more popular. As a result, designers must focus more on user needs. Traditionally, most of designers only focus on satisfying users’ functional needs and often ignore users’ emotional and psychological needs. This paper presents a design method that combines interaction design with axiomatic design. The proposed method first employs interaction design to acquire user needs with respect to three aspects: “people”, “products” and “environment” and then adopts axiomatic design to complete the conceptual design. The methodology is demonstrated and validated with a case study of children bicycle. The results show that the proposed method significantly enhances users’ experience of the product and meets more comprehensive user needs, especially in terms of users’ psychological and spiritual needs.
Discomfort: a New Material for Interaction Design

m.c. schraefel,Michael Jones

DOI: https://doi.org/10.48550/arXiv.2105.04015

2021-05-10

Abstract:This paper proposes discomfort as a new material for HCI researchers and designers to consider in any application that helps a person develop a new skill, practice or state. Discomfort is a fundamental precursor of adaptation and adaptation leads to new skill, practice or state. The way in which discomfort is perceived, and when it is experienced, is also often part of a rationale for rejecting or adopting a practice. Engaging effectively with discomfort may lead to increased personal development. We propose incorporating discomfort-as-material into our designs explicitly as a mechanism to make desired adaptations available to more of us, more effectively and more of the time. To explore this possibility, we offer an overview of the physiology and neurology of discomfort in adaptation and propose 3 issues related to incorporating discomfort into design: preparation for discomfort, need for recovery, and value of the practice. We look forward in the Workshop to exploring and developing ideas for specific Discomfortable Designs to insource discomfort as part of positive, resilient adaptation.

Human-Computer Interaction
Antagonistic AI

Alice Cai,Ian Arawjo,Elena L. Glassman

2024-02-12

Abstract:The vast majority of discourse around AI development assumes that subservient, "moral" models aligned with "human values" are universally beneficial -- in short, that good AI is sycophantic AI. We explore the shadow of the sycophantic paradigm, a design space we term antagonistic AI: AI systems that are disagreeable, rude, interrupting, confrontational, challenging, etc. -- embedding opposite behaviors or values. Far from being "bad" or "immoral," we consider whether antagonistic AI systems may sometimes have benefits to users, such as forcing users to confront their assumptions, build resilience, or develop healthier relational boundaries. Drawing from formative explorations and a speculative design workshop where participants designed fictional AI technologies that employ antagonism, we lay out a design space for antagonistic AI, articulating potential benefits, design techniques, and methods of embedding antagonistic elements into user experience. Finally, we discuss the many ethical challenges of this space and identify three dimensions for the responsible design of antagonistic AI -- consent, context, and framing.

Human-Computer Interaction
Exploring Natural Interaction: Using Real-World Materials to Inspire Interaction Design

Thomas Gründer

Abstract:Designers are often challenged to break free from the traditional interaction design for mouse and keyboard to create new and compelling user experiences for natural user interfaces. We conducted several workshops to inspire and provoke critical reflection on interaction and interface design for natural user interfaces based on physical substances that are used in everyday life [2, 3, 5]. The method used in these workshops has been developed as a hands-on alternative to the usual way of focusing on problems and solutions first in order to create new interfaces. We employ a playful experimental approach to generate ideas regarding visualization and interaction. In this paper, we detail our proposed method for exploring natural interaction and provide three examples from our previous workshops.

Materials Science,Engineering
Interaction Design for AI Systems: An oriented state-of-the-art

Firmino Silva,André Costa

DOI: https://doi.org/10.1109/HORA55278.2022.9800084

2022-06-09

Abstract:In recent years, new web-based technologies have emerged, and mobile devices and applications access have become widespread, resulting in new paradigms in Human-Computer Interaction (HCI). These paradigms created several challenges in interaction design regarding customization, adaptability, and accessibility. Over the lifetime of a digital product, the user must adapt to updates, changes in the interface, and new functions, while having to provide attention to customization and configuration tasks in interfaces created for millions of individuals worldwide. Simultaneously, users' conditions change, and the system must adjust to new requirements, preferences, and needs in a fast-paced digital environment. And new functions, interfaces, and technologies that meet current market directions, such as Artificial Intelligence, Augmented Reality, Virtual Reality, and even Design without physical interfaces must be developed and implemented. This research work explores the importance of Interaction Design (IxD) in the present and future Artificial Intelligence (AI) systems, highlighting the prominent authors of User-Centered Design and usability principles, guidelines, and heuristics. Moreover, researching appropriate design principles for developing a positive, effective, and safe interaction between humans and computers. This study will also deepen and orient the study of the state-of-the-art to promote the exploration of HCI in a period of enormous challenges and opportunities in AI. As a result of this research work, a table summarizes, compares, and classifies the state of the art according to Usability & Design Principles. Outputting a matrix that aggregates the fundamental principles for designing interfaces in artificial intelligence systems, regardless of their interface. This matrix serves as a base for a framework to create a prototype, in future work, based on the guidelines suggested.

Computer Science
Interfacing the human/machine

Benjamin Lipp,Sascha Dickel

DOI: https://doi.org/10.1080/1600910X.2021.2012709

2022-01-25

Distinktion

Abstract:Contemporary discourse on information and communication technology suggests that humans and machines are increasingly converging. However, in this article, we argue that for analysts of digital society it is necessary to understand the simultaneity with which humans and machines are both interconnected and separated from one another. Here, we propose to follow and trace human/machine interfacing , i.e. the manifold practices, by which humans and machines become interconnected, by being kept apart. Drawing on theoretical resources from feminist science and technology studies and the philosophy of technology, we extend common 'objective' notions of the interface and propose a performative and ecological framework for human-machine interfacing. We illustrate this framework with two contrasting cases, embodied social robotics and communicative software bots. Social robots denote a rather fragile technology, showing the precariousness of efforts to engender phenomena of human-machine communication. By contrast, communicative software bots can rely on vast digital infrastructures, which create the impression of symmetry between humans and machines by rendering ontological differences invisible.
Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivation

Priyan Vaithilingam, Ian Arawjo, Elena L. Glassman

2024-02-12

Abstract:We ideate a future design workflow that involves AI technology. Drawing from activity and communication theory, we attempt to isolate the new value large AI models can provide design compared to past technologies. We arrive at three affordances -- dynamic grounding, constructive negotiation, and sustainable motivation -- that summarize latent qualities of natural language-enabled foundation models that, if explicitly designed for, can support the process of design. Through design fiction, we then imagine a future interface as a diegetic prototype, the story of Squirrel Game, that demonstrates each of our three affordances in a realistic usage scenario. Our design process, terminology, and diagrams aim to contribute to future discussions about the relative affordances of AI technology with regard to collaborating with human designers.

Artificial Intelligence,Human-Computer Interaction
Rethinking (Dis)engagement in human-computer interaction

Heather L. O'Brien,Ido Roll,Andrea Kampen,Nilou Davoudi

DOI: https://doi.org/10.1016/j.chb.2021.107109

IF: 9.9

2022-03-01

Computers in Human Behavior

Abstract:User engagement has become a much-cited construct in human-computer interaction (HCI) design and evaluation research and practice. Constructed as a positive and desirable outcome of users' interactions, more frequent and longer interactions are considered evidence of engagement. Disengagement, when discussed, is considered a best avoided outcome of technology use or a solution to problematic technology use. In the case of the former, disengagement may signal usability issues or user disinterest, while the latter emphasizes that some engaging interactions can result in negative consequences (e.g., addiction) for end-users. In this paper, we draw upon examples from HCI research and digital tools to present a more nuanced understanding of the symbiotic relationship between engagement and disengagement in order to propose a new definition and novel ways to model disengagement. Further, we challenge generalizations that dichotomize engagement (positive, continuous, accompanied by high interactivity and beneficial to end-users) and disengagement (negative, stopping use or detrimental use) and invite readers to interpret engagement in the context of desirability with respect to users' goals and perceived agency. We concluded with implications that invite the reader to make space for disengagement and move beyond usage data in the evaluation of engagement. This paper is a call to step away from the practice of engagement-for-engagement's sake, and to reflect on whether and when engagement is meaningful and desirable for end users.

psychology, multidisciplinary, experimental
Human-computer intra-action: a relational approach to digital media and technologies

Luke Hespanhol

DOI: https://doi.org/10.3389/fcomp.2023.1083800

2023-08-11

Frontiers in Computer Science

Abstract:The growing pervasiveness of digital technologies has exposed the entanglements of Human-Computer Interaction (HCI) with its surrounding context, from the immediate vicinity of interfaces to global issues. While often providing solutions to societal issues, interactive technologies also many times contribute to them. They impact and are impacted by the world, in a process of continuous mutual influence and co-constitution that raises important implications not only to user experience, effectiveness and efficiency, but also to ethics, social responsibility and environmental health. In this article, I draw on the new materialism notion of intra-action to propose a conceptual shift to a relational approach for HCI, which I refer to as Human-Computer Intra-Action (HCIA), capable of capturing from the outset the inherent relationships with the world that inform the design of interactive technology. To that end, I propose the notion of relationalities to reflect the synergies and antagonisms around those relationships, and discuss emerging notions of spatiality and temporality by considering the increasing hybridity of socio-technical engagements both in space (local vs. remote) and in time (immediate vs. stretched). Based on that, I propose a preliminary method for mapping intra-actions associated to interactive technologies, envisaged as a starting point to a relational take on their design process.

Against Interaction Design

Interactivity by design : creating & communicating with new media

Post-human interaction design, yes, but cautiously

Interaction and resistance: The recognition of intentions in new human-computer interaction

Interface Design Aesthetics of Interaction Design

The design of natural interaction

AI Design, Design AI, Human-Centred AI and the Theatre of the Absurd the language, life and times of a UX designer

Talking about interaction*

Sentient House: Designing for Discourse

Exteraction

Socio-technical systems and interaction design - 21st century relevance

Computer Interfaces to Organizations: Perspectives on Borg-Human Interaction Design

A Product Design Based on Interaction Design and Axiomatic Design Theory

Discomfort: a New Material for Interaction Design

Antagonistic AI

Exploring Natural Interaction: Using Real-World Materials to Inspire Interaction Design

Interaction Design for AI Systems: An oriented state-of-the-art

Interfacing the human/machine

Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivation

Rethinking (Dis)engagement in human-computer interaction

Human-computer intra-action: a relational approach to digital media and technologies