Abstract:The automated creation of accurate musical notation from an expressive human performance is a fundamental task in computational musicology. To this end, we present an end-to-end deep learning approach that constructs detailed musical scores directly from real-world piano performance-MIDI files. We introduce a modern transformer-based architecture with a novel tokenized representation for symbolic music data. Framing the task as sequence-to-sequence translation rather than note-wise classification reduces alignment requirements and annotation costs, while allowing the prediction of more concise and accurate notation. To serialize symbolic music data, we design a custom tokenization stage based on compound tokens that carefully quantizes continuous values. This technique preserves more score information while reducing sequence lengths by $3.5\times$ compared to prior approaches. Using the transformer backbone, our method demonstrates better understanding of note values, rhythmic structure, and details such as staff assignment. When evaluated end-to-end using transcription metrics such as MUSTER, we achieve significant improvements over previous deep learning approaches and complex HMM-based state-of-the-art pipelines. Our method is also the first to directly predict notational details like trill marks or stem direction from performance data. Code and models are available at <a class="link-external link-https" href="https://github.com/TimFelixBeyer/MIDI2ScoreTransformer" rel="external noopener nofollow">this https URL</a>

Piano Transcription with Harmonic Attention.

DAFE-MSGAT: Dual-Attention Feature Extraction and Multi-Scale Graph Attention Network for Polyphonic Piano Transcription

Automatic Piano Transcription with Hierarchical Frequency-Time Transformer

Improved Architecture for High-resolution Piano Transcription to Efficiently Capture Acoustic Characteristics of Music Signals

Piano automatic transcription based on transformer

HPPNet: Modeling the Harmonic Structure and Pitch Invariance in Piano Transcription

High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Times

A Data-Driven Analysis of Robust Automatic Piano Transcription

Multi-Instrument Polyphonic Melody Transcription Based on Deep Learning

MFAE: Masked frame-level autoencoder with hybrid-supervision for low-resource music transcription

Harmonic Frequency-Separable Transformer for Instrument-Agnostic Music Transcription

End-to-end Piano Performance-MIDI to Score Conversion with Transformers

A Transformer-Based Visual Piano Transcription Algorithm

Scoring Time Intervals using Non-Hierarchical Transformer For Automatic Piano Transcription

High Resolution Guitar Transcription via Domain Adaptation

Reconstructing Human Expressiveness in Piano Performances with a Transformer Network

AMT-APC: Automatic Piano Cover by Fine-Tuning an Automatic Music Transcription Model

Improving Automatic Piano Transcription by Refined Feature Fusion and Weighted Loss

Unaligned Supervision For Automatic Music Transcription in The Wild

Machine Learning Techniques in Automatic Music Transcription: A Systematic Survey