Abstract:Following the success of the transformer architecture in the natural language domain, transformer-like architectures have been widely applied to the domain of symbolic music recently. Symbolic music and text, however, are two different modalities. Symbolic music contains multiple attributes, both absolute attributes (e.g., pitch) and relative attributes (e.g., pitch interval). These relative attributes shape human perception of musical motifs. These important relative attributes, however, are mostly ignored in existing symbolic music modelling methods with the main reason being the lack of a musically-meaningful embedding space where both the absolute and relative embeddings of the symbolic music tokens can be efficiently represented. In this paper, we propose the Fundamental Music Embedding (FME) for symbolic music based on a bias-adjusted sinusoidal encoding within which both the absolute and the relative attributes can be embedded and the fundamental musical properties (e.g., translational invariance) are explicitly preserved. Taking advantage of the proposed FME, we further propose a novel attention mechanism based on the relative index, pitch and onset embeddings (RIPO attention) such that the musical domain knowledge can be fully utilized for symbolic music modelling. Experiment results show that our proposed model: RIPO transformer which utilizes FME and RIPO attention outperforms the state-of-the-art transformers (i.e., music transformer, linear transformer) in a melody completion task. Moreover, using the RIPO transformer in a downstream music generation task, we notice that the notorious degeneration phenomenon no longer exists and the music generated by the RIPO transformer outperforms the music generated by state-of-the-art transformer models in both subjective and objective evaluations. The code of the proposed method is available online: github.com/guozixunnicolas/FundamentalMusicEmbedding.

Systematic Analysis of Music Representations from BERT

BERT-like Pre-training for Symbolic Piano Music Classification Tasks

MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training

Adversarial-MidiBERT: Symbolic Music Understanding Model Based on Unbias Pre-training and Mask Fine-tuning

MMT-BERT: Chord-aware Symbolic Music Generation Based on Multitrack Music Transformer and MusicBERT

An Optimized Method for Large-Scale Pre-Training in Symbolic Music

PiRhDy: Learning Pitch-, Rhythm-, and Dynamics-aware Embeddings for Symbolic Music.

Symbolic Music Representations for Classification Tasks: A Systematic Evaluation

Practical and Reproducible Symbolic Music Generation by Large Language Models with Structural Embeddings

A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling

Self-Supervised Contrastive Learning for Robust Audio-Sheet Music Retrieval Systems

Using cognitive mapping to analyze the aesthetic value of music education in colleges and universities

Byte Pair Encoding for Symbolic Music

Musical Word Embedding: Bridging the Gap between Listening Contexts and Music

Analyzing Byte-Pair Encoding on Monophonic and Polyphonic Symbolic Music: A Focus on Musical Phrase Segmentation

Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Survey

Exploring modality-agnostic representations for music classification

MRBERT: Pre-Training of Melody and Rhythm for Automatic Music Generation

MuPT: A Generative Symbolic Music Pretrained Transformer

N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understanding