Abstract:In recent years, advancements in neural network designs and the availability of large-scale labeled datasets have led to significant improvements in the accuracy of piano transcription models. However, most previous work focused on high-performance offline transcription, neglecting deliberate consideration of model size. The goal of this work is to implement real-time inference for piano transcription while ensuring both high performance and lightweight. To this end, we propose novel architectures for convolutional recurrent neural networks, redesigning an existing autoregressive piano transcription model. First, we extend the acoustic module by adding a frequency-conditioned FiLM layer to the CNN module to adapt the convolutional filters on the frequency axis. Second, we improve note-state sequence modeling by using a pitchwise LSTM that focuses on note-state transitions within a note. In addition, we augment the autoregressive connection with an enhanced recursive context. Using these components, we propose two types of models; one for high performance and the other for high compactness. Through extensive experiments, we show that the proposed models are comparable to state-of-the-art models in terms of note accuracy on the MAESTRO dataset. We also investigate the effective model size and real-time inference latency by gradually streamlining the architecture. Finally, we conduct cross-data evaluation on unseen piano datasets and in-depth analysis to elucidate the effect of the proposed components in the view of note length and pitch range.

Reconstructing Human Expressiveness in Piano Performances with a Transformer Network

Piano automatic transcription based on transformer

End-to-end Piano Performance-MIDI to Score Conversion with Transformers

Expressive MIDI-format Piano Performance Generation

Pianist Identification Using Convolutional Neural Networks

Exploring Transformer's Potential on Automatic Piano Transcription

A Data-Driven Analysis of Robust Automatic Piano Transcription

Scoring Time Intervals using Non-Hierarchical Transformer For Automatic Piano Transcription

HPPNet: Modeling the Harmonic Structure and Pitch Invariance in Piano Transcription

Towards Efficient and Real-Time Piano Transcription Using Neural Autoregressive Models

A Transformer-Based Visual Piano Transcription Algorithm

Towards Musically Informed Evaluation of Piano Transcription Models

Coordinate Embedding Transformer Model for Optical Music Recognition on Monophonic Scores

Piano Transcription with Harmonic Attention.

Sounding Out Reconstruction Error-Based Evaluation of Generative Models of Expressive Performance

Compose & Embellish: Well-Structured Piano Performance Generation via A Two-Stage Approach

The Piano Inpainting Application

Music Performance Style Transfer for Learning Expressive Musical Performance

Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset

A Two-Stage Audio-Visual Fusion Piano Transcription Model Based on the Attention Mechanism