Abstract:The availability of digital music data in various modalities provides opportunities both for music enjoyment and music research. Regarding the latter, the computer-assisted analysis of tonal structures is a central topic. For Western classical music, studies typically rely on machine-readable scores, which are tedious to create for large-scale works and comprehensive corpora. As an alternative, music audio recordings, which are readily available, can be analyzed with computational methods. With this paper, we want to bridge the gap between score- and audio-based measurements of tonal structures by leveraging the power of deep neural networks. Such networks are commonly trained in an end-to-end fashion, which introduces biases towards the training repertoire or towards specific annotators. To overcome these problems, we propose a multi-step strategy. First, we compute pitch-class representations of the audio recordings using networks trained on score–audio pairs. Second, we measure the presence of specific tonal structures using a pattern-matching technique that solely relies on music theory knowledge and does not require annotated training data. Third, we highlight these measurements with interactive visualizations, thus leaving the interpretation to the musicological experts. Our experiments on Richard Wagner's large-scale cycle Der Ring des Nibelungen indicate that deep pitch-class representations lead to a high similarity between score- and audio-based measurements of tonal structures, thus demonstrating how to leverage multimodal data for application scenarios in the computational humanities, where an explicit and interpretable methodology is essential.

Data Models of German Lute Tablature With TScore

MIDI-to-Tab: Guitar Tablature Inference via Masked Language Modeling

Critical Semantic Properties of Music Notation Datasets

Modeling Bends in Popular Music Guitar Tablatures

A Data-Driven Methodology for Considering Feasibility and Pairwise Likelihood in Deep Learning Based Guitar Tablature Transcription Systems

DadaGP: A Dataset of Tokenized GuitarPro Songs for Sequence Models

MusicScore: A Dataset for Music Score Modeling and Generation

Towards Musicologist-Driven Mining of Handwritten Scores.

SynthTab: Leveraging Synthesized Data for Guitar Tablature Transcription

From MIDI to Rich Tablatures: an Automatic Generative System incorporating Lead Guitarists' Fingering and Stylistic choices

From Music Scores to Audio Recordings: Deep Pitch-Class Representations for Measuring Tonal Structures

A New Dataset, Notation Software, and Representation for Computational Schenkerian Analysis

Musical Score Following and Audio Alignment

End-to-end Piano Performance-MIDI to Score Conversion with Transformers

Leveraging Real Electric Guitar Tones and Effects to Improve Robustness in Guitar Tablature Transcription Modeling

A multimodal approach to music transcription

Score Transformer: Generating Musical Score from Note-level Representation

A New Corpus for Computational Music Research and A Novel Method for Musical Structure Analysis

Modelling Symbolic Music: Beyond the Piano Roll

Computational music analysis from first principles

Notation as visual representation of sound-based music