Abstract:The visualisation systems are spread widely as personal computer’s software. The system, that are processing audio data are presented in this article. The system visualizes the ratio of spectrum amplitudes and has fixed frequency binding to colours. The technology of audio signals processing by the device and components of the device were considered. For the increasing information processing speed was used 32bit controller and graphic equalizer with seven passbands. Music visualization it is function, that are spread widely in mediaplayer’s software, on a different operation systems. This function shows animated images that are depends on music signal. Images are usually reproduced in the real time mode and synchronized with a played audio-track. Music and visualization are merges in the different kind of art: opera, ballett, music drama or movies. Dependencies of auditory and visual sensations are used for increasing the emotional perseption for ordinary listeners . In the systems, that are currently being actively promoted, are used several tools for personal computers, such as: After Effects – The Audio Spectrum Effect, VSDC Video Editor Free – Audio Spectrum Visualizer, Magic Music Visuals. The software, that are mentioned above, has a one disadvantage: the using of streaming video is not possible with the simultaneous receipt of audio and requires processing and rendering of the resulting video series. The purpose of the work is to determine the features of spectral analysis of music information and taking into account real-time data processing. Propose a variant of the music information visualization system, which displays the spectral composition of music and the amplitude of individual harmonics, and filling the LED-matrix with the appropriate color depending on the amplitude of the audio signal, with the possibility of wireless signal transmission from the music source to the visual effects device. The technology of frequency analysis of the spectrum with estimation of amplitude of spectrum’s components of the musical data, that is arriving on the device is chosen for this project. The method is based on the analysis of the spectrum in the selected frequency bands, which in turn simplifies the function of finding maxima at different frequencies. The proposed variant of the musical information visualization system provides display on the LED-matrix of colors that correspond to the frequencies spectrum’s components in the musical composition. Moreover, the number of involved LEDs is proportional to the ratio of the amplitudes of the signal’s frequency components. The desired result is achieved by using a Fast Fourier Transform and selecting Khan or Heming windows for providing a better analysis results of the signal spectrum. The amplitudes of the individual components of the spectrum are estimated additionally and each frequency band has its own color. The work of the system is to analyze the components of the spectrum and frequency of musical information. This information affects the display of colors on the LED matrix. The using of a 32-bit microcontroller provides sufficient speed of audio signal processing with minimal delays. For the increasing the accuracy and speed up the frequency analysis, the sound range is divided into seven bands. For this purpose was used seven-band graphic equalizer MSGEQ7. Music information is transmitted to the system via Bluetooth, which greatly simplifies the selection and connection of the music data source.

An Artistic Visualization of Music Modeling a Synesthetic Experience

Visualization of isomorphism-synesthesia of colour and music

VisibleSound: Perceiving Environmental Sound with 4D Form

Art of musical color: A synesthesia‐based mechanism of color art

Electronic music composition thinking using visual learning and visual sensing technology

From pixels to notes: a computational implementation of synaesthesia for cultural artefacts

Synesthesia AR: Creating Sound-to-Color Synesthesia in Augmented Reality

A Preliminary Model for the Design of Music Visualizations

SonifEye: Sonification of Visual Information Using Physical Modeling Sound Synthesis

Creating a Synthesizer from Schrödinger's Equation

MusicJam: Visualizing Music Insights via Generated Narrative Illustrations

The Relationship Between Music-Related Types of Synesthesia and Mental Imagery in Synesthete Musicians

Music Visualization Based on Spherical Projection With Adjustable Metrics

Musical Information Visualization System

Data Soni cation and Sound Visualization

Visual Music and Musical Vision

A General Framework for Visualization of Sound Collections in Musical Interfaces

Music and Color Synaesthesia with Visual Saliency Information

“Pool of Toys”: Multimodal Visual Music Rendering of Sequenced and Real-time Control Events

Exploring Real-Time Music-to-Image Systems for Creative Inspiration in Music Creation

Audiovisual integration system based on synesthesia for people with impaired hearing