Abstract:Optical Music Recognition (OMR) automates the transcription of musical notation from images into machine-readable formats like MusicXML, MEI, or MIDI, significantly reducing the costs and time of manual transcription. This study explores knowledge discovery in OMR by applying instance segmentation using Mask R-CNN to enhance the detection and delineation of musical symbols in sheet music. Unlike Optical Character Recognition (OCR), OMR must handle the intricate semantics of Common Western Music Notation (CWMN), where symbol meanings depend on shape, position, and context. Our approach leverages instance segmentation to manage the density and overlap of musical symbols, facilitating more precise information retrieval from music scores. Evaluations on the DoReMi and MUSCIMA++ datasets demonstrate substantial improvements, with our method achieving a mean Average Precision (mAP) of up to 59.70\% in dense symbol environments, achieving comparable results to object detection. Furthermore, using traditional computer vision techniques, we add a parallel step for staff detection to infer the pitch for the recognised symbols. This study emphasises the role of pixel-wise segmentation in advancing accurate music symbol recognition, contributing to knowledge discovery in OMR. Our findings indicate that instance segmentation provides more precise representations of musical symbols, particularly in densely populated scores, advancing OMR technology. We make our implementation, pre-processing scripts, trained models, and evaluation results publicly available to support further research and development.

A Unified Representation Framework for the Evaluation of Optical Music Recognition Systems

Research of Numbered Musical Notation Recognition Method

Multimodal image and audio music transcription

Toward a More Complete OMR Solution

Application and Research on Optical Music Recognition

Coordinate Embedding Transformer Model for Optical Music Recognition on Monophonic Scores

Understanding Optical Music Recognition

Sheet Music Transformer: End-To-End Optical Music Recognition Beyond Monophonic Transcription

A New Optical Music Recognition System Based on Combined Neural Network

Practical End-to-End Optical Music Recognition for Pianoform Music

End-to-End Optical Music Recognition with Attention Mechanism and Memory Units Optimization.

TrOMR:Transformer-Based Polyphonic Optical Music Recognition

Structure Analysis Approach of Music Notes for Optical Music Recognition

End-to-End Full-Page Optical Music Recognition for Pianoform Sheet Music

Knowledge Discovery in Optical Music Recognition: Enhancing Information Retrieval with Instance Segmentation

Real-Time Optical Music Recognition System for Dulcimer Musical Robot

The Music Note Ontology

MusicTM-Dataset for Joint Representation Learning among Sheet Music, Lyrics, and Musical Audio

State-of-the-Art Model for Music Object Recognition with Deep Learning

Kernel Density Estimation and Convolutional Neural Networks for the Recognition of Multi-Font Numbered Musical Notation

Deep Watershed Detector for Music Object Recognition