SOMson -- Sonification of Multidimensional Data in Kohonen Maps

Simon Linke,Tim Ziemer
2024-05-22
Abstract:Kohonen Maps, aka. Self-organizing maps (SOMs) are neural networks that visualize a high-dimensional feature space on a low-dimensional map. While SOMs are an excellent tool for data examination and exploration, they inherently cause a loss of detail. Visualizations of the underlying data do not integrate well and, therefore, fail to provide an overall picture. Consequently, we suggest SOMson, an interactive sonification of the underlying data, as a data augmentation technique. The sonification increases the amount of information provided simultaneously by the SOM. Instead of a user study, we present an interactive online example, so readers can explore SOMson themselves. Its strengths, weaknesses, and prospects are discussed.
Human-Computer Interaction,Machine Learning
What problem does this paper attempt to address?
This paper proposes a method called SOMson to address the issue of visual detail loss in high-dimensional data visualization in Self-Organizing Maps (SOM). SOM is a neural network that maps high-dimensional feature space to a lower-dimensional map, commonly used for data exploration, browsing, and pattern recognition. However, traditional SOM visualization methods are unable to display all the feature information. SOMson enhances SOM through interactive sonification, using sound representation of the four-dimensional feature space to provide additional information. It sonifies each unit layer's node, allowing users to explore more aspects of the data in an integrated manner. The paper does not conduct user studies, but provides interactive online examples for readers to personally experience SOMson. The paper introduces the working principle of SOM, including the training process and how visualization is achieved through the U-matrix and component planes. Although these visualization tools are useful, they cannot present a complete picture. Therefore, SOMson improves data understanding by sonifying the features of each node, allowing users to hear different aspects of the data. The paper also describes in detail the sonification method of SOMson, based on psychoacoustic principles, mapping features to sound attributes such as timbre, roughness, sharpness, and loudness fluctuation. In addition, the paper provides an explanation of the SOMson interface, where users can explore and compare nodes through mouse interactions. In conclusion, this paper attempts to address the limitation of SOM's visualization by complementing it with sonification techniques, enhancing understanding and analysis capabilities for high-dimensional data.