Abstract:The first step to apply deep learning techniques for symbolic music understanding is to transform musical pieces (mainly in MIDI format) into sequences of predefined tokens like note pitch, note velocity, and chords. Subsequently, the sequences are fed into a neural sequence model to accomplish specific tasks. Music sequences exhibit strong correlations between adjacent elements, making them prime candidates for N-gram techniques from Natural Language Processing (NLP). Consider classical piano music: specific melodies might recur throughout a piece, with subtle variations each time. In this paper, we propose a novel method, NG-Midiformer, for understanding symbolic music sequences that leverages the N-gram approach. Our method involves first processing music pieces into word-like sequences with our proposed unsupervised compoundation, followed by using our N-gram Transformer encoder, which can effectively incorporate N-gram information to enhance the primary encoder part for better understanding of music sequences. The pre-training process on large-scale music datasets enables the model to thoroughly learn the N-gram information contained within music sequences, and subsequently apply this information for making inferences during the fine-tuning stage. Experiment on various datasets demonstrate the effectiveness of our method and achieved state-of-the-art performance on a series of music understanding downstream tasks. The code and model weights will be released at <a class="link-external link-https" href="https://github.com/CinqueOrigin/NG-Midiformer" rel="external noopener nofollow">this https URL</a>.

Score Images as a Modality: Enhancing Symbolic Music Understanding through Large-Scale Multimodal Pre-Training

MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training

More Than Simply Masking: Exploring Pre-training Strategies for Symbolic Music Understanding.

BERT-like Pre-training for Symbolic Piano Music Classification Tasks

MelodyT5: A Unified Score-to-Score Transformer for Symbolic Music Processing

An Optimized Method for Large-Scale Pre-Training in Symbolic Music

Adversarial-MidiBERT: Symbolic Music Understanding Model Based on Unbias Pre-training and Mask Fine-tuning

Generating Symbolic Music from Natural Language Prompts using an LLM-Enhanced Dataset

MusicScore: A Dataset for Music Score Modeling and Generation

End-to-end Piano Performance-MIDI to Score Conversion with Transformers

Motif-Centric Representation Learning for Symbolic Music

MuseBarControl: Enhancing Fine-Grained Control in Symbolic Music Generation through Pre-Training and Counterfactual Loss

N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understanding

A Novel Multi-Task Learning Method for Symbolic Music Emotion Recognition

MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation

MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Response

Symbolic Music Representations for Classification Tasks: A Systematic Evaluation

Audio-to-symbolic Arrangement via Cross-modal Music Representation Learning

MuPT: A Generative Symbolic Music Pretrained Transformer

A Two-Stage Audio-Visual Fusion Piano Transcription Model Based on the Attention Mechanism

Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model