Abstract:This article describes a collaborative project between researchers in theChampaign. The project focuses on the use of sound for the exploration and analysis of complex data sets in scientiic computing. The article addresses digital sound synthesis in the context of DIASS (Digital Instrument for Additive Sound Synthesis) and sound visualization in a virtual-reality environment by means of M4CAVE. It describes the procedures and preliminary results of some experiments in scientiic soniication and sound visualization. While most computational scientists routinely use visual imaging techniques to explore and analyze large data sets, they tend to be much less familiar with the use of sound. Yet, sound signals carry signiicant amounts of information and can be used advantageously to increase the bandwidth of the human/computer interface. The project described in this article focuses on scientiic soniication|the faithful rendering of scientiic data in sounds|and the visualization of sounds in a virtual-reality environment. The project, which grew out of an eeort to apply the latest super-computing technology to the process of music composition (see Box 1), is a joint Digital sound synthesis is addressed in Section 1; the discussion centers on DI-ASS (Digital Instrument for Additive Sound Synthesis). Section 2 describes some experiments in scientiic soniication. Sound visualization in a virtual-reality (VR) environment is discussed in Section 3; here, the main tool is M4CAVE, a program to visualize sounds from a score le. Section 4 contains some general observations about the project. Digital sound synthesis is a way to generate a stream of numbers representing the sampled values of an audio waveform. To realize the sounds, one sends these samples through a digital-to-analog converter (DAC), which converts the numbers to a continuously varying voltage that can be ampliied and sent to a loudspeaker. One way of viewing the digital sound-synthesis process is to imagine a computer program that calculates the sample values according to a mathematical formula and sends those samples, one after the other, to the DAC. All the calculations are carried out by a program, which can be changed in arbitrary ways by the user. From this point of view, digital synthesis is the same as software synthesis. Software synthesis contrasts with hardware synthesis, where the calculations are carried out in special circuitry. Hardware synthesis has the advantage of high-speed operation but lacks the exibility of software synthesis. Software synthesis is the technique of choice if one wishes to develop an instrument for …

Interactive-compositional Authoring of Sound Spatialization

Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies

A General Framework for Visualization of Sound Collections in Musical Interfaces

Embodying Spatial Sound Synthesis with AI in Two Compositions for Instruments and 3-D Electronics

Interactive Spatial Sonification of Multidimensional Data for Composition and Auditory Display

Rendering Spatial Sound for Interoperable Experiences in the Audio Metaverse

SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning

Using soundscape simulation to evaluate compositions for a public space sound installationa)

Sound Space: Communicating Acoustics Through Interactive Visualization

Sound feedback control model for live electronic performance in the Ecos Study

VisibleSound: Perceiving Environmental Sound with 4D Form

Instrumental genesis through interdisciplinary collaboration -- reflections on the emergence of a visualisation framework for video annotation data

Comprehensive Framework for Describing Interactive Sound Installations: Highlighting Trends through a Systematic Review

Electronic music composition thinking using visual learning and visual sensing technology

Data Soni cation and Sound Visualization

A Scene Representation for Online Spatial Sonification

Using perceptive subbands analysis to perform audio scenes cartography

The Virtual Theremin: Designing an Interactive Digital Music Instrument for Film Scene Scoring

Auditory-visual scenes for hearing research

Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation

Intersensoriality, immersion and environment in digital art: Paroles trouvées, a spatialised musical, videochoreographic, optical installation