Abstract:Real-time tracking of the position of a musical performance on a musical score, i.e. score following, can be useful in music practice, performance and production. Example applications of such technology include computer-aided accompaniment and automatic page turning. Score following is a challenging task, especially when considering deviations in performance data from the score stemming from mistakes or expressive choices. In this project, the extensive research present in the field is first explored before two open-source evaluation testbenches for score following--one quantitative and the other qualitative--are introduced. A new way of obtaining quantitative testbench data is proposed, and the QualScofo dataset for qualitative benchmarking is introduced. Subsequently, three different score followers, each of a different class, are implemented. First, a beat-based follower for an interactive conductor application--the TuneApp Conductor--is created to demonstrate an entertaining application of score following. Then, an Approximate String Matching (ASM) non-real-time follower is implemented to complement the quantitative testbench and provide more technical background details of score following. Finally, a Constant Q-Transform (CQT) Dynamic Time Warping (DTW) score follower robust against major challenges in score following (such as polyphonic music and performance deviations) is outlined and implemented; it is shown that this CQT-based approach consistently and significantly outperforms a commonly used FFT-based approach in extracting audio features for score following.

Score-Informed Source Separation Based on Real-Time Polyphonic Score-to-Audio Alignment and Bayesian Harmonic Model

A Unified Model for Zero-shot Music Source Separation, Transcription and Synthesis

Unsupervised Single-Channel Music Source Separation by Average Harmonic Structure Modeling

Multichannel Blind Music Source Separation Using Directivity-Aware MNMF With Harmonicity Constraints

Separation of Music Signals by Harmonic Structure Modeling.

Instrument Identification and Pitch Estimation in Multi-Timbre Polyphonic Musical Signals Based on Probabilistic Mixture Model Decomposition

Score-based Source Separation with Applications to Digital Communication Signals

Music source separation conditioned on 3D point clouds

Multi-Source Diffusion Models for Simultaneous Music Generation and Separation

Hierarchic Temporal Convolutional Network With Cross-Domain Encoder for Music Source Separation

Musical Score Following and Audio Alignment

Separation of Singing Voice Using Nonnegative Matrix Partial Co-Factorization for Singer Identification

SpaIn-Net: Spatially-Informed Stereophonic Music Source Separation

Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips

Content based singing voice source separation via strong conditioning using aligned phonemes

Vision-guided Music Source Separation Via a Fine-grained Cycle-Separation Network

End-to-end Music-mixed Speech Recognition

Source Separation & Automatic Transcription for Music

Music Separation Enhancement with Generative Modeling

Audio query-based music source separation

Multipitch estimation based on the iterative detection and separation of note events from single-channel polyphonic recordings