Abstract:Optical Music Recognition (OMR) automates the transcription of musical notation from images into machine-readable formats like MusicXML, MEI, or MIDI, significantly reducing the costs and time of manual transcription. This study explores knowledge discovery in OMR by applying instance segmentation using Mask R-CNN to enhance the detection and delineation of musical symbols in sheet music. Unlike Optical Character Recognition (OCR), OMR must handle the intricate semantics of Common Western Music Notation (CWMN), where symbol meanings depend on shape, position, and context. Our approach leverages instance segmentation to manage the density and overlap of musical symbols, facilitating more precise information retrieval from music scores. Evaluations on the DoReMi and MUSCIMA++ datasets demonstrate substantial improvements, with our method achieving a mean Average Precision (mAP) of up to 59.70\% in dense symbol environments, achieving comparable results to object detection. Furthermore, using traditional computer vision techniques, we add a parallel step for staff detection to infer the pitch for the recognised symbols. This study emphasises the role of pixel-wise segmentation in advancing accurate music symbol recognition, contributing to knowledge discovery in OMR. Our findings indicate that instance segmentation provides more precise representations of musical symbols, particularly in densely populated scores, advancing OMR technology. We make our implementation, pre-processing scripts, trained models, and evaluation results publicly available to support further research and development.

Proceedings of the 1st International Workshop on Reading Music Systems

Proceedings of the 2nd International Workshop on Reading Music Systems

Proceedings of the 3rd International Workshop on Reading Music Systems

Proceedings of the 4th International Workshop on Reading Music Systems

Proceedings of the 5th International Workshop on Reading Music Systems

Understanding Optical Music Recognition

Practical End-to-End Optical Music Recognition for Pianoform Music

Deep Watershed Detector for Music Object Recognition

End-to-End Full-Page Optical Music Recognition for Pianoform Sheet Music

A Unified Representation Framework for the Evaluation of Optical Music Recognition Systems

Knowledge Discovery in Optical Music Recognition: Enhancing Information Retrieval with Instance Segmentation

Sheet Music Transformer: End-To-End Optical Music Recognition Beyond Monophonic Transcription

Scorpiano -- A System for Automatic Music Transcription for Monophonic Piano Music

In Search of a Dataset for Handwritten Optical Music Recognition: Introducing MUSCIMA++

Optical Music Recognition in Manuscripts from the Ricordi Archive

Real-Time Optical Music Recognition System for Dulcimer Musical Robot

Automated Arrangements of Multi-Part Music for Sets of Monophonic Instruments

Introduction to The neurosciences and music IV: learning and memory

DoReMi: First glance at a universal OMR dataset

Multimodal image and audio music transcription

Musical Instruments in Extended Reality: A Systematic Review