Abstract:In recent years, advancements in neural network designs and the availability of large-scale labeled datasets have led to significant improvements in the accuracy of piano transcription models. However, most previous work focused on high-performance offline transcription, neglecting deliberate consideration of model size. The goal of this work is to implement real-time inference for piano transcription while ensuring both high performance and lightweight. To this end, we propose novel architectures for convolutional recurrent neural networks, redesigning an existing autoregressive piano transcription model. First, we extend the acoustic module by adding a frequency-conditioned FiLM layer to the CNN module to adapt the convolutional filters on the frequency axis. Second, we improve note-state sequence modeling by using a pitchwise LSTM that focuses on note-state transitions within a note. In addition, we augment the autoregressive connection with an enhanced recursive context. Using these components, we propose two types of models; one for high performance and the other for high compactness. Through extensive experiments, we show that the proposed models are comparable to state-of-the-art models in terms of note accuracy on the MAESTRO dataset. We also investigate the effective model size and real-time inference latency by gradually streamlining the architecture. Finally, we conduct cross-data evaluation on unseen piano datasets and in-depth analysis to elucidate the effect of the proposed components in the view of note length and pitch range.

A Parallel Fusion Approach to Piano Music Transcription Based on Convolutional Neural Network

Onsets and Frames: Dual-Objective Piano Transcription

Polyphonic Piano Transcription Based on Graph Convolutional Network

HPPNet: Modeling the Harmonic Structure and Pitch Invariance in Piano Transcription

A crnn-gcn piano transcription model based on audio and skeleton features

Onsets and Velocities: Affordable Real-Time Piano Transcription Using Convolutional Neural Networks

A Two-Stage Audio-Visual Fusion Piano Transcription Model Based on the Attention Mechanism

Context-Independent Polyphonic Piano Onset Transcription with an Infinite Training Dataset

A holistic approach to polyphonic music transcription with neural networks

DAFE-MSGAT: Dual-Attention Feature Extraction and Multi-Scale Graph Attention Network for Polyphonic Piano Transcription

Automatic Transcription Method for Polyphonic Music Based on Adaptive Comb Filter and Neural Network

Towards Efficient and Real-Time Piano Transcription Using Neural Autoregressive Models

Robust Piano Music Transcription Based on Computer Vision

Semi-Supervised Convolutive NMF for Automatic Piano Transcription

An EB-enhanced CNN Model for Piano Music Transcription.

Pianist Identification Using Convolutional Neural Networks

Improving Automatic Piano Transcription by Refined Feature Fusion and Weighted Loss

Transition-Aware: A More Robust Approach for Piano Transcription

Robust Multipitch Estimation Of Piano Sounds Using Deep Spiking Neural Networks

Multitask Learning for Polyphonic Piano Transcription, a Case Study

Source Separation of Piano Concertos Using Hybrid LSTM-Transformer Model