Abstract:Reverb-Resonate: Sounding the Affective Frequencies of Migration operates at the intersection of art, science, and technology to articulate an emotional landscape of migration and exile. Rooted in the methodology of research-creation (RC) and grounded in the interdisciplinary field of Art, Science, and Technology Studies (ASTS), the project transcends conventional disciplinary boundaries to offer speculative possibilities through human-machine listening. Drawing on the body is an already augmented site, the project makes audible physiological sensors that capture micro-level intricacies responsible for stress regulation. Listening, is, thus, foregrounded as the core public engagement strategy, creating a layered sound collage that interweaves somatic registers of recorded breathing samples and physiological sensor values with machine listening to recreate new forms of sound. Engagement with ASTS is, hence, in the form of a method that traverses transforming sensor application, generating technicized sound and composing an acoustic experience capable of affective engagement. Through machine learning-a subfield of artificial intelligence-the notion of 'machine listening' extends beyond human hearing limitations, introducing non-normative structures to challenge and expand habitual forms of human listening. Reverb-Resonate, hence, leverages artistic strategies and techno-augmentations to address the crisis of imagination that hinders opening up to realities far from the familiar and the personal to imagine 'what could be' as a way of future-making. It underscores the critical edge of RC and ASTS in addressing complex critical issues, proposing a speculative space where the human-machine hybrid puts forth a socio-technical assemblage of listening to understand 'otherly' experiences. The project, thus, advances a critical inquiry into the mediation and augmentation of listening to imagine new possibilities for embodied engagement with unfamiliar emotional spaces and experiences.

Resonate - a social musical installation which integrates tangible multiuser interaction

Let's Resonate! How to Elicit Improvisation and Letting Go in Interactive Digital Art

Vrengt: A Shared Body-Machine Instrument for Music-Dance Performance

Transitioning Between Audience and Performer: Co-Designing Interactive Music Performances with Children

MOONMENT: Designing Gesture-based Interaction with Acousto-Optic Feedbacks

The “rebirth” of traditional musical instrument: An interactive installation based on augmented reality and somatosensory technology to empower the exhibition of chimes

Entering hyper-reality: “Resonance-In-Sight,” a mixed-reality art installation

Future-making through eventing human-machine listening

Using Tangible Interaction to Design Musicking Artifacts for Non-musicians

Materialising contexts: virtual soundscapes for real-world exploration

Transhuman Ansambl - Voice Beyond Language

Large-scale audience participation in live music using smartphones

Using embodied audio-visual interaction to promote social encounters around large media façades

Sonic Sculpture: Activating Engagement with Head-Mounted Augmented Reality

Sound Space: Communicating Acoustics Through Interactive Visualization

Entangling Practice with Artistic and Educational Aims: Interviews on Technology-based Movement Sound Interactions

Designing an augmented experience for a music archive: What does the audience need beyond the sense of hearing?

Sonic interaction with a virtual orchestra of factory machinery

Comprehensive Framework for Describing Interactive Sound Installations: Highlighting Trends through a Systematic Review

Collaboration Between Robots, Interfaces and Humans: Practice-Based and Audience Perspectives

A Study on the Application of Multi-sensory Interaction Technology in Enhancing Concert Audience Immersion