Abstract:This article describes a collaborative project between researchers in theChampaign. The project focuses on the use of sound for the exploration and analysis of complex data sets in scientiic computing. The article addresses digital sound synthesis in the context of DIASS (Digital Instrument for Additive Sound Synthesis) and sound visualization in a virtual-reality environment by means of M4CAVE. It describes the procedures and preliminary results of some experiments in scientiic soniication and sound visualization. While most computational scientists routinely use visual imaging techniques to explore and analyze large data sets, they tend to be much less familiar with the use of sound. Yet, sound signals carry signiicant amounts of information and can be used advantageously to increase the bandwidth of the human/computer interface. The project described in this article focuses on scientiic soniication|the faithful rendering of scientiic data in sounds|and the visualization of sounds in a virtual-reality environment. The project, which grew out of an eeort to apply the latest super-computing technology to the process of music composition (see Box 1), is a joint Digital sound synthesis is addressed in Section 1; the discussion centers on DI-ASS (Digital Instrument for Additive Sound Synthesis). Section 2 describes some experiments in scientiic soniication. Sound visualization in a virtual-reality (VR) environment is discussed in Section 3; here, the main tool is M4CAVE, a program to visualize sounds from a score le. Section 4 contains some general observations about the project. Digital sound synthesis is a way to generate a stream of numbers representing the sampled values of an audio waveform. To realize the sounds, one sends these samples through a digital-to-analog converter (DAC), which converts the numbers to a continuously varying voltage that can be ampliied and sent to a loudspeaker. One way of viewing the digital sound-synthesis process is to imagine a computer program that calculates the sample values according to a mathematical formula and sends those samples, one after the other, to the DAC. All the calculations are carried out by a program, which can be changed in arbitrary ways by the user. From this point of view, digital synthesis is the same as software synthesis. Software synthesis contrasts with hardware synthesis, where the calculations are carried out in special circuitry. Hardware synthesis has the advantage of high-speed operation but lacks the exibility of software synthesis. Software synthesis is the technique of choice if one wishes to develop an instrument for …

Creating Aesthetic Sonifications on the Web with SIREN

Erie: A Declarative Grammar for Data Sonification

SonoUno web: an innovative user centred web interface

Data sonification: do you see what I hear?

PlugSonic: a web- and mobile-based platform for binaural audio and sonic narratives

SonifEye: Sonification of Visual Information Using Physical Modeling Sound Synthesis

Interactive Sonification for Health and Energy using ChucK and Unity

Interactive Sonification for Data Exploration: How listening modes and display purposes define design guidelines

Sonification in an Artistic Context

VisibleSound: Perceiving Environmental Sound with 4D Form

Interactive Multimodal Integral Field Spectroscopy

Integrating Annotations into the Design Process for Sonifications and Physicalizations

Data Soni cation and Sound Visualization

Development of a data sonification toolkit and case study sonifying astrophysical phenomena for visually imparied individuals

SynthScribe: Deep Multimodal Tools for Synthesizer Sound Retrieval and Exploration

The Design of a Smart City Sonification System Using a Conceptual Blending and Musical Framework, Web Audio and Deep Learning Techniques

The aesthetic turn in sonification towards a social and cultural medium

Interactive Spatial Sonification of Multidimensional Data for Composition and Auditory Display

herakoi: a sonification experiment for astronomical data

Openspace Sonification: Complementing Visualization of the Solar System with Sound

Sonification of numerical data for education