Abstract:Following the success of the transformer architecture in the natural language domain, transformer-like architectures have been widely applied to the domain of symbolic music recently. Symbolic music and text, however, are two different modalities. Symbolic music contains multiple attributes, both absolute attributes (e.g., pitch) and relative attributes (e.g., pitch interval). These relative attributes shape human perception of musical motifs. These important relative attributes, however, are mostly ignored in existing symbolic music modelling methods with the main reason being the lack of a musically-meaningful embedding space where both the absolute and relative embeddings of the symbolic music tokens can be efficiently represented. In this paper, we propose the Fundamental Music Embedding (FME) for symbolic music based on a bias-adjusted sinusoidal encoding within which both the absolute and the relative attributes can be embedded and the fundamental musical properties (e.g., translational invariance) are explicitly preserved. Taking advantage of the proposed FME, we further propose a novel attention mechanism based on the relative index, pitch and onset embeddings (RIPO attention) such that the musical domain knowledge can be fully utilized for symbolic music modelling. Experiment results show that our proposed model: RIPO transformer which utilizes FME and RIPO attention outperforms the state-of-the-art transformers (i.e., music transformer, linear transformer) in a melody completion task. Moreover, using the RIPO transformer in a downstream music generation task, we notice that the notorious degeneration phenomenon no longer exists and the music generated by the RIPO transformer outperforms the music generated by state-of-the-art transformer models in both subjective and objective evaluations. The code of the proposed method is available online: github.com/guozixunnicolas/FundamentalMusicEmbedding.

Symbolic Music Playing Techniques Generation as a Tagging Problem

Symbolic Music Generation with Fine-grained Interactive Textural Guidance

Generating High-quality Symbolic Music Using Fine-grained Discriminators

Practical and Reproducible Symbolic Music Generation by Large Language Models with Structural Embeddings

Flexible Control in Symbolic Music Generation via Musical Metadata

A Survey on Deep Learning for Symbolic Music Generation: Representations, Algorithms, Evaluations, and Challenges

MusicAOG: an Energy-Based Model for Learning and Sampling a Hierarchical Representation of Symbolic Music

Theoretical Aspects Of Music Definition Language And Music Manipulation Language

Generating Symbolic Music from Natural Language Prompts using an LLM-Enhanced Dataset

Personalized Popular Music Generation Using Imitation and Structure

Crafting Creative Melodies: A User-Centric Approach for Symbolic Music Generation

Symbolic music generation conditioned on continuous-valued emotions

Continuous Melody Generation via Disentangled Short-Term Representations and Structural Conditions

A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling

Musecoco: Generating symbolic music from text

SymPAC: Scalable Symbolic Music Generation With Prompts And Constraints

Multitrack Emotion-Based Music Generation Network Using Continuous Symbolic Features

2019 Formatting Instructions for Authors Using LaTeX

MeloTrans: A Text to Symbolic Music Generation Model Following Human Composition Habit