Abstract: One of the advantages of using natural language processing (NLP) technology for music is to fully exploit the embedding based representation learning paradigm that can easily handle classical tasks such as semantic similarity. However, recent researches have revealed the poor performance issue of common baseline methods for semantic similarity in NLP. They show that some simple embedding calibration methods can easily promote the performance of semantic similarity without extra training hence is ready-to-use. Nevertheless, it is still unclear which is the best combination of calibration methods and by how much can we further improve the performance with such methods. Most importantly, previous works are based on auto-encoder Transformer, hence the performance under auto-regressive model for music is unclear. These render the following open questions: does embedding based semantic similarity also apply for auto-regressive music model, does poor baseline issue for semantic similarity also exists, and if so, are there unexplored embedding calibration methods to better promote the performance of music semantic similarity? In this paper, we answer these questions by exploring different combination of embedding calibration under auto-regressive language model for symbolic music. Our results show that music semantic similarity works under auto-regressive model, and also suffers from poor baseline issues like in NLP. Furthermore, we provide optimal combination of embedding calibration that has not been explored in previous researches. Results show that such combination of embedding calibration can greatly improve music semantic similarity without further training tasks.

Learning and Evaluating Musical Features with Deep Autoencoders

Modeling of the Latent Embedding of Music using Deep Neural Network

Autoencoders for music sound modeling: a comparison of linear, shallow, deep, recurrent and variational models

Learning Style-Aware Symbolic Music Representations by Adversarial Autoencoders

Audio Embeddings as Teachers for Music Classification

Leveraging Pre-Trained Autoencoders for Interpretable Prototype Learning of Music Audio

Learning Music Embedding with Metadata for Context Aware Recommendation

Representations of Sound in Deep Learning of Audio Features from Music

Unsupervised Learning of Deep Features for Music Segmentation

Learning to Embed Music and Metadata for Context-Aware Music Recommendation

PiRhDy: Learning Pitch-, Rhythm-, and Dynamics-aware Embeddings for Symbolic Music.

Comparison and Analysis of Deep Audio Embeddings for Music Emotion Recognition

Use of speaker recognition approaches for learning and evaluating embedding representations of musical instrument sounds

Class-conditional Embeddings for Music Source Separation

How deep is your encoder: an analysis of features descriptors for an autoencoder-based audio-visual quality metric

Construction of AI Environmental Music Education Application Model Based on Deep Learning

Music removal by convolutional denoising autoencoder in speech recognition.

Embedding Calibration for Music Semantic Similarity using Auto-regressive Transformer

A Deep Learning-Based Piano Music Notation Recognition Method

Deep Neural Network for Musical Instrument Recognition using MFCCs

Deep Conditional Representation Learning for Drum Sample Retrieval by Vocalisation