Abstract:We explore the potential of a popular distributional semantics vector space model, word2vec, for capturing meaningful relationships in ecological (complex polyphonic) music. More precisely, the skip-gram version of word2vec is used to model slices of music from a large corpus spanning eight musical genres. In this newly learned vector space, a metric based on cosine distance is able to distinguish between functional chord relationships, as well as harmonic associations in the music. Evidence, based on cosine distance between chord-pair vectors, suggests that an implicit circle-of-fifths exists in the vector space. In addition, a comparison between pieces in different keys reveals that key relationships are represented in word2vec space. These results suggest that the newly learned embedded vector representation does in fact capture tonal and harmonic characteristics of music, without receiving explicit information about the musical content of the constituent slices. In order to investigate whether proximity in the discovered space of embeddings is indicative of ‘semantically-related’ slices, we explore a music generation task, by automatically replacing existing slices from a given piece of music with new slices. We propose an algorithm to find substitute slices based on spatial proximity and the pitch class distribution inferred in the chosen subspace. The results indicate that the size of the subspace used has a significant effect on whether slices belonging to the same key are selected. In sum, the proposed word2vec model is able to learn music-vector embeddings that capture meaningful tonal and harmonic relationships in music, thereby providing a useful tool for exploring musical properties and comparisons across pieces, as a potential input representation for deep learning models, and as a music generation device.

Musical Word Embedding: Bridging the Gap between Listening Contexts and Music

Musical Word Embedding for Music Tagging and Retrieval

From context to concept: exploring semantic relationships in music with word2vec

Learning to Embed Music and Metadata for Context-Aware Music Recommendation

Learning Music Embedding with Metadata for Context Aware Recommendation

Emotion Embedding Spaces for Matching Music to Stories

PiRhDy: Learning Pitch-, Rhythm-, and Dynamics-aware Embeddings for Symbolic Music.

Enriching Music Descriptions with a Finetuned-LLM and Metadata for Text-to-Music Retrieval

Exploiting Temporal Dependencies for Cross-Modal Music Piece Identification

Modeling Musical Context with Word2vec

MuLan: A Joint Embedding of Music Audio and Natural Language

Exploring Musical Roots: Applying Audio Embeddings to Empower Influence Attribution for a Generative Music Model

Multilingual Music Genre Embeddings for Effective Cross-Lingual Music Item Annotation

Content-Based Video-Music Retrieval Using Soft Intra-Modal Structure Constraint

Toward Universal Text-to-Music Retrieval

Systematic Analysis of Music Representations from BERT

Class-conditional Embeddings for Music Source Separation

I can listen but cannot read: An evaluation of two-tower multimodal systems for instrument recognition

Are we describing the same sound? An analysis of word embedding spaces of expressive piano performance

Towards Robust and Truly Large-Scale Audio-Sheet Music Retrieval

Passage Summarization with Recurrent Models for Audio-Sheet Music Retrieval