Abstract:Making a slight mistake during live music performance can easily be spotted by an astute listener, even if the performance is an improvisation or an unfamiliar piece. An example might be a highly dissonant chord played by mistake in a classical-era sonata, or a sudden off-key note in a recurring motif. The problem of identifying and correcting such errors can be approached with artificial intelligence -- if a trained human can easily do it, maybe a computer can be trained to spot the errors quickly and just as accurately. The ability to identify and auto-correct errors in real-time would be not only extremely useful to performing musicians, but also a valuable asset for producers, allowing much fewer overdubs and re-recording of takes due to small imperfections. This paper examines state-of-the-art solutions to related problems and explores novel solutions for music error detection and correction, focusing on their real-time applicability. The explored approaches consider error detection through music context and theory, as well as supervised learning models with no predefined musical information or rules, trained on appropriate datasets. Focusing purely on correcting musical errors, the presented solutions operate on a high-level representation of the audio (MIDI) instead of the raw audio domain, taking input from an electronic instrument (MIDI keyboard/piano) and altering it when needed before it is sent to the sampler. This work proposes multiple general recurrent neural network designs for real-time error correction and performance aid for MIDI instruments, discusses the results, limitations, and possible future improvements. It also emphasizes on making the research results easily accessible to the end user - music enthusiasts, producers and performers -- by using the latest artificial intelligence platforms and tools.

Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips

Musical Score Following and Audio Alignment

Just Label the Repeats for In-The-Wild Audio-to-Score Alignment

Real-time error correction and performance aid for MIDI instruments

A Study of Annotation and Alignment Accuracy for Performance Comparison in Complex Orchestral Music

Note Value Recognition for Piano Transcription Using Markov Random Fields

Automatic Music Accompanist

Towards Reliable Real-time Opera Tracking: Combining Alignment with Audio Event Detectors to Increase Robustness

Handling Structural Mismatches in Real-time Opera Tracking

A DTW ALGORITHM FOR SCORE FOLLOWING COMBINING ONSET DETECTION BEING ERROR NOTES DETECTABLE

Score-Informed Source Separation Based on Real-Time Polyphonic Score-to-Audio Alignment and Bayesian Harmonic Model

A Convolutional-Attentional Neural Framework for Structure-Aware Performance-Score Synchronization

Audio to Score Alignment Based on Chroma Features and Dynamic Time Warping Algorithm

MIDI-Sheet Music Alignment Using Bootleg Score Synthesis

A Hybrid Approach to Audio-to-Score Alignment

Rhythm Transcription of Polyphonic Piano Music Based on Merged-Output HMM for Multiple Voices

Monte Carlo Methods for Tempo Tracking and Rhythm Quantization

End-to-End Real-World Polyphonic Piano Audio-to-Score Transcription with Hierarchical Decoding

Addressing the Recitative Problem in Real-Time Opera Tracking

On-Line Audio-to-Lyrics Alignment Based on a Reference Performance

A Real-Time Lyrics Alignment System Using Chroma And Phonetic Features For Classical Vocal Performance