Abstract:The automatic music transcription (AMT) task is designed to convert raw performance audio signals into digital representations of symbolic music for possible computational musicology. In polyphonic music, there are multiple notes and they may appear at the same time. The combined output of multiple notes faces the problem of dimension explosion, which makes it difficult to achieve accurate transcription. To overcome the above challenge, a deep learning model based on graph convolution network (CR-GCN) is proposed to cope with the problem of dimension explosion by exploring the interdependence between musical notes. The model is divided into two parts, i.e., feature learning and label learning. Feature learning is composed of serial convolutional neural network (CNN) and recurrent neural network (RNN), which aims to extract temporal and spatial features from the input music signals. Label learning consists of graph convolutional network (GCN), which is adopted to model the interdependence between notes. The CR-GCN model can be end-to-end trainable through joint training feature networks and label networks. Experiments on public polyphonic music data sets show that the proposed method is able to mine more co-existing notes, and it is superior to existing methods in both frame-level and note-level indexes. Moreover, visual analysis shows that the learned interdependence between notes has good explainability in music theory.

Stereo Feature Enhancement and Temporal Information Extraction Network for Automatic Music Transcription

DAFE-MSGAT: Dual-Attention Feature Extraction and Multi-Scale Graph Attention Network for Polyphonic Piano Transcription

Automatic Respiratory Sound Classification Via Multi-Branch Temporal Convolutional Network

Multi-Instrument Polyphonic Melody Transcription Based on Deep Learning

Improved Architecture for High-resolution Piano Transcription to Efficiently Capture Acoustic Characteristics of Music Signals

Polyphonic Piano Transcription Based on Graph Convolutional Network

Harmonic-Aware Frequency and Time Attention for Automatic Piano Transcription

Multitrack Music Transcription with a Time-Frequency Perceiver

Musical Tempo Estimation Using a Multi-scale Network.

CST: Automatic Modulation Recognition Method by Convolution Transformer on Temporal Continuity Features

Piano Transcription with Harmonic Attention.

Audio-Based Music Classification with DenseNet And Data Augmentation

Frequency-Temporal Attention Network for Singing Melody Extraction

TFSWA-UNet: Temporal-Frequency and Shifted Window Attention Based UNet for Music Source Separation

Triplet Convolutional Network for Music Version Identification.

A holistic approach to polyphonic music transcription with neural networks

ReconVAT: A Semi-Supervised Automatic Music Transcription Framework for Low-Resource Real-World Data

Hierarchic Temporal Convolutional Network With Cross-Domain Encoder for Music Source Separation

Unaligned Supervision For Automatic Music Transcription in The Wild

An EB-enhanced CNN Model for Piano Music Transcription.

Target Speaker Extraction Using Attention-Enhanced Temporal Convolutional Network