Abstract:This article addresses the question of synthesis and control of sound attributes from a perceptual point of view. We focused on an attribute related to the general concept of motion evoked by sounds. To investigate this concept, we tested 40 monophonic abstract sounds on listeners via a questionnaire and drawings, using a parametrized custom interface. This original procedure, which was defined with synthesis and control perspectives in mind, provides an alternative means of determining intuitive control parameters for synthesizing sounds evoking motion. Results showed that three main shape categories (linear, with regular oscillations, and with circular oscillations) and three types of direction (rising, descending, and horizontal) were distinguished by the listeners. In addition, the subjects were able to perceive the low-frequency oscillations (below 8 Hz) quite accurately. Three size categories (small, medium, and large) and three levels of randomness (none, low amplitude irregularities, and high amplitude irregularities) and speed (constant speed and speeds showing medium and large variations) were also observed in our analyses of the participants' drawings. We further performed a perceptual test to confirm the relevance of the contribution of some variables with synthesized sounds combined with visual trajectories. Based on these results, a general typology of evoked motion was drawn up and an intuitive control strategy was designed, based on a symbolic representation of continuous trajectories (provided by devices such as motion capture systems, pen tablets, etc.). These generic tools could be used in a wide range of applications such as sound design, virtual reality, sonification, and music.

Resonant Processing of Instrumental Sound Controlled by Spatial Position

Embodying Spatial Sound Synthesis with AI in Two Compositions for Instruments and 3-D Electronics

Musical instruments as dynamic sound sources

Controlling Sound in Non-Hermitian Acoustic Systems

Resonate - a social musical installation which integrates tangible multiuser interaction

Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulation

Use of speaker recognition approaches for learning and evaluating embedding representations of musical instrument sounds

Construction and Performance Applications of an Augmented Violin: TRAVIS II

Sound feedback control model for live electronic performance in the Ecos Study

Synthèse sonore de la clarinette avec modèle de résonateur à trous latéraux optimisé sur des impédances d'entrée d'une clarinette réelle

Object-based synthesis of scraping and rolling sounds based on non-linear physical constraints

Time-Frequency Scattering Accurately Models Auditory Similarities Between Instrumental Playing Techniques

Perceptual characterization of motion evoked by sounds for synthesis control purposes

Active control and adaptive structures for a smart violin

Intuitive Control of Scraping and Rubbing Through Audio-tactile Synthesis

Sonification of a juggling performance using spatial audio

Multiphonic modeling using Impulse Pattern Formulation (IPF)

Amplitude-dependent modal coefficients accounting for localized nonlinear losses in a time-domain integration of woodwind model

Analysis and Modeling of Timbre Perception Features in Musical Sounds

One-Shot Acoustic Matching Of Audio Signals -- Learning to Hear Music In Any Room/ Concert Hall

Quantifying sound colour of musical instruments – precise harmonic timbre coordinates of like instruments