Abstract:The automated creation of accurate musical notation from an expressive human performance is a fundamental task in computational musicology. To this end, we present an end-to-end deep learning approach that constructs detailed musical scores directly from real-world piano performance-MIDI files. We introduce a modern transformer-based architecture with a novel tokenized representation for symbolic music data. Framing the task as sequence-to-sequence translation rather than note-wise classification reduces alignment requirements and annotation costs, while allowing the prediction of more concise and accurate notation. To serialize symbolic music data, we design a custom tokenization stage based on compound tokens that carefully quantizes continuous values. This technique preserves more score information while reducing sequence lengths by $3.5\times$ compared to prior approaches. Using the transformer backbone, our method demonstrates better understanding of note values, rhythmic structure, and details such as staff assignment. When evaluated end-to-end using transcription metrics such as MUSTER, we achieve significant improvements over previous deep learning approaches and complex HMM-based state-of-the-art pipelines. Our method is also the first to directly predict notational details like trill marks or stem direction from performance data. Code and models are available at <a class="link-external link-https" href="https://github.com/TimFelixBeyer/MIDI2ScoreTransformer" rel="external noopener nofollow">this https URL</a>

Encoding Performance Data in MEI with the Automatic Music Performance Analysis and Comparison Toolkit (AMPACT)

pyAMPACT: A Score-Audio Alignment Toolkit for Performance Data Estimation and Multi-modal Processing

The PMEmo Dataset for Music Emotion Recognition

LAMP, A Lyrics and Audio MandoPop Dataset for Music Mood Estimation: Dataset Compilation, System Construction, and Testing

PerTok: Expressive Encoding and Modeling of Symbolic Musical Ideas and Variations

Unaligned Supervision For Automatic Music Transcription in The Wild

MACE: Leveraging Audio for Evaluating Audio Captioning Systems

A data-driven approach to mid-level perceptual musical feature modeling

Data-to-music sonification and user engagement

End-to-end Piano Performance-MIDI to Score Conversion with Transformers

In-the-moment and Beyond: Combining Post-hoc and Real-Time Data for the Study of Audience Perception of Electronic Music Performance

An Interdisciplinary Review of Music Performance Analysis

Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset

Stem-JEPA: A Joint-Embedding Predictive Architecture for Musical Stem Compatibility Estimation

Introducing MEG-MASC a high-quality magneto-encephalography dataset for evaluating natural speech processing

The Musical Emotion Discrimination Task: A New Measure for Assessing the Ability to Discriminate Emotions in Music

InstructME: An Instruction Guided Music Edit And Remix Framework with Latent Diffusion Models

A Data-Driven Analysis of Robust Automatic Piano Transcription

Development of Large Annotated Music Datasets using HMM-based Forced Viterbi Alignment

YourMT3+: Multi-instrument Music Transcription with Enhanced Transformer Architectures and Cross-dataset Stem Augmentation

Musical Word Embedding for Music Tagging and Retrieval