Abstract:This article looks at the use of embodied music controllers for gestural interaction with sound. The technology for embodied interaction involves microchip “enhancement” of the human body, enabling the body as the music controller or musical actuator and connecting the performer with a networked (wireless) sonic performance environment. To examine the ways that the audience and performer respond to this new performance paradigm, this article first looks at some interpretations and understandings of posthumanisim and cyborgism and its effects for the music performer and audience. The influential body modifying and skin boundary cultures that colour audience perception and motivate cyborg processes, the body as expressive canvas and politicising cyborgism are considered in relation to alterity, community, marking and anthropology. The further social implications of radiofrequency identification tag technology and computing technologies that transfigure our body-limits and sense of self, privacy and human–machine integration are considered, particularly as contemporary posthuman tele-tactile technologies challenge conventional notions of touch and control. The Virtual Gamelan performance environment is presented as a test-bed for precision gestural interaction with sound, and to gauge audience feedback about these contentious contemporary issues that bleed into other pervasive technologies of the imminent future. This research was developed from the perspective of the music composer/performer and the motivation to explore posthuman cyborg notions through the embodiment of sensors in the disciplines of music, human–computer interaction, and design in a technological cyborg discussion that positions it differently to “mythological” cyborg discourse. The embodiment and permeation of the body are integral to the research goal of altering music performance paradigms. While utilising gesture, proprioception and spatial interaction, the embodiment of part of the system differentiates this approach from the Theremin or virtual interfaces with a physical controller (such as Guitar Hero or six-degrees-of-freedom devices with buttons and touch as well as motion, e.g. a Nintendo Wii controller) or the Xbox 360 Kinect, which uses low-latency life-like motion control of the on-screen avatar remote from the body of the performer.

We Are All Cyborgs: Body-Machine And Body-Information In Virtual Reality Systems

Metaphors And Embodiment In Virtual Reality Systems

Is reality real? thoughts and conjectures about culture, self, intersubjectivity and parallel worlds in digital technologies

Review of Virtual Reality Technology: an Ergonomic Approach and Current Challenges

Multimodal Human Machine Interactions in Virtual and Augmented Reality.

Multi-Embodiment of Digital Humans in Virtual Reality for Assisting Human-Centered Ergonomics Design

Bodioid: philosophical reflections on the hybrid of bodies and artefacts towards post-human

Study on Virtual Human for Art and Design

The virtual body in a design exercise: a conceptual framework for embodied cognition

A review on ergonomics evaluations of virtual reality

Methods and Procedures to Usability Testing in Virtual Reality Systems

Dialogical Self on Virtual Reality Systems: Presence and Embodiment in Human Situated Interaction ☆

Virtual Reality and Digital Human Modeling for Ergonomic Assessment in Industrial Product Development: A Patent and Literature Review

Cyborgian Approach of Eco-interaction Design Based on Machine Intelligence and Embodied Experience

The State of the Art in Virtual Reality Applied to Digital Games: A Literature Review

Characterizing first and third person viewpoints and their alternation for embodied interaction in virtual reality

Tele-touch embodied controllers: posthuman gestural interaction in music performance

Haptic Perception, Mechanics, and Material Technologies for Virtual Reality

Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual Reality

Interfacing the human/machine

Digital Proxemics: Designing Social and Collaborative Interaction in Virtual Environments