Abstract:Identifying musical instruments in polyphonic music recordings is a challenging but important problem in the field of music information retrieval. It enables music search by instrument, helps recognize musical genres, or can make music transcription easier and more accurate. In this paper, we present a convolutional neural network framework for predominant instrument recognition in real-world polyphonic music. We train our network from fixed-length music excerpts with a single-labeled predominant instrument and estimate an arbitrary number of predominant instruments from an audio signal with a variable length. To obtain the audio-excerpt-wise result, we aggregate multiple outputs from sliding windows over the test audio. In doing so, we investigated two different aggregation methods: one takes the average for each instrument and the other takes the instrument-wise sum followed by normalization. In addition, we conducted extensive experiments on several important factors that affect the performance, including analysis window size, identification threshold, and activation functions for neural networks to find the optimal set of parameters. Using a dataset of 10k audio excerpts from 11 instruments for evaluation, we found that convolutional neural networks are more robust than conventional methods that exploit spectral features and source separation with support vector machines. Experimental results showed that the proposed convolutional network architecture obtained an F1 measure of 0.602 for micro and 0.503 for macro, respectively, achieving 19.6% and 16.4% in performance improvement compared with other state-of-the-art algorithms.

Chinese Folk Musical Instruments Recognition in Polyphonic Music

Automatic Identification Of Chinese Musical Instruments

Chinese Folk Instruments Classification Via Statistical Features and Sparse-Based Representation

Mining the Performance Characteristics of Yao Nationality Musical Instruments under Multivariate Statistical Analysis

Comparison of Performance in Automatic Classification between Chinese and Western Musical Instruments

Research of Numbered Musical Notation Recognition Method

Acoustical feature analysis and optimization for aesthetic recognition of Chinese traditional music

Analysis of Timbre Perceptual Discrimination for Chinese Traditional Musical Instruments

SVM-Based Automatic Classification of Musical Instruments

A Multitask Learning Approach for Chinese National Instruments Recognition and Timbre Space Regression

ChMusic: A Traditional Chinese Music Dataset for Evaluation of Instrument Recognition

Musical Instrument Playing Technique Detection Based on FCN: Using Chinese Bowed-Stringed Instrument as an Example

Deep convolutional neural networks for predominant instrument recognition in polyphonic music

Exploring Isolated Musical Notes as Pre-training Data for Predominant Instrument Recognition in Polyphonic Music

Automatic Instrument Recognition in Polyphonic Music Using Convolutional Neural Networks

Musical Instrument Classification via Low-Dimensional Feature Vectors

Predominant Instrument Recognition Based on Deep Neural Network with Auxiliary Classification.

A study on attention-based fine-grained image recognition: Towards musical instrument performing hand shape assessment

Influence of Musical Elements on the Perception of ‘chinese Style’ in Music

Application and Research on Optical Music Recognition

Regional Recognition of Chinese Folk Songs based on LSD Audio Segmentation Algorithm