Data Soni cation and Sound Visualization

H. Kaper,Elizabeth Wiebel

Abstract:This article describes a collaborative project between researchers in theChampaign. The project focuses on the use of sound for the exploration and analysis of complex data sets in scientiic computing. The article addresses digital sound synthesis in the context of DIASS (Digital Instrument for Additive Sound Synthesis) and sound visualization in a virtual-reality environment by means of M4CAVE. It describes the procedures and preliminary results of some experiments in scientiic soniication and sound visualization. While most computational scientists routinely use visual imaging techniques to explore and analyze large data sets, they tend to be much less familiar with the use of sound. Yet, sound signals carry signiicant amounts of information and can be used advantageously to increase the bandwidth of the human/computer interface. The project described in this article focuses on scientiic soniication|the faithful rendering of scientiic data in sounds|and the visualization of sounds in a virtual-reality environment. The project, which grew out of an eeort to apply the latest super-computing technology to the process of music composition (see Box 1), is a joint Digital sound synthesis is addressed in Section 1; the discussion centers on DI-ASS (Digital Instrument for Additive Sound Synthesis). Section 2 describes some experiments in scientiic soniication. Sound visualization in a virtual-reality (VR) environment is discussed in Section 3; here, the main tool is M4CAVE, a program to visualize sounds from a score le. Section 4 contains some general observations about the project. Digital sound synthesis is a way to generate a stream of numbers representing the sampled values of an audio waveform. To realize the sounds, one sends these samples through a digital-to-analog converter (DAC), which converts the numbers to a continuously varying voltage that can be ampliied and sent to a loudspeaker. One way of viewing the digital sound-synthesis process is to imagine a computer program that calculates the sample values according to a mathematical formula and sends those samples, one after the other, to the DAC. All the calculations are carried out by a program, which can be changed in arbitrary ways by the user. From this point of view, digital synthesis is the same as software synthesis. Software synthesis contrasts with hardware synthesis, where the calculations are carried out in special circuitry. Hardware synthesis has the advantage of high-speed operation but lacks the exibility of software synthesis. Software synthesis is the technique of choice if one wishes to develop an instrument for …

Computer Science,Engineering