Abstract:As a fundamental and critical component of music information retrieval (MIR) systems, automatically classifying music by genre is a challenging problem. The traditional approaches which solely depending on low-level audio features may not be able to obtain satisfactory results. In recent years, the social tags have emerged as an important way to provide information about resources on the web. So, in this paper we propose a novel multi-modal music genre classification approach which uses the acoustic features and the social tags together for classifying music by genre. For the audio contentbased classification, we design a new feature selection algorithm called IBFFS (Interaction Based Forward Feature Selection). This algorithm selects the features depending on the pre-computed rules which considering the interaction between the different features. In addition, we are interested in another aspect, that is how performing automatic music genre classification depending on the available tag data. Two classification methods based on the social tags (including music-tags and artist-tags) which crawled from website Last. fm are developed in our work: (1) we use the generative probabilistic model Latent Dirichlet Allocation (LDA) to analyze the music-tags. Then, we can obtain the probability of every tag belonging to each music genre. (2) The starting point of the second method is that music's artist is often associated with music genres more closely. Therefore, we can compute the similarity between the artist-tag vectors to infer which genre the music belongs to. At last, our experimental results demonstrate the benefit of our multi-modal music genre classification approach.

Multi-Modal Music Mood Classification Using Co-Training

Multimodal Music Mood Classification by Fusion of Audio and Lyrics.

Graph-Based Multimodal Music Mood Classification in Discriminative Latent Space.

Automatic Music Emotion Classification Using a New Classification Algorithm

Modality-invariant Temporal Representation Learning for Multimodal Sentiment Classification

Sentiment Analysis Using Deep Robust Complementary Fusion of Multi-Features and Multi-Modalities.

Automatic Music Mood Classification by Learning Cross-Media Relevance Between Audio and Lyrics

Boosting for Multi-Modal Music Emotion Classification.

Bi-Modal Deep Boltzmann Machine Based Musical Emotion Classification

A Bimodal-based Algorithm for Song Sentiment Classification

Enhancing Music Mood Recognition with LLMs and Audio Signal Processing: A Multimodal Approach

Improve the application of reinforcement learning and multi‐modal information in music sentiment analysis

Semi-Supervised Classification of Musical Genre Using Multi-View Features.

Multi-Modal Music Genre Classification Approach

Discriminating Mood Taxonomy of Chinese Traditional Music and Western Classical Music with Content Feature Sets

Multimodel Music Emotion Recognition Using Unsupervised Deep Neural Networks

Improving Music Genre Classification from Multi-Modal Properties of Music and Genre Correlations Perspective

COSMIC: Music Emotion Recognition Combining Structure Analysis and Modal Interaction

Multimodal Music Emotion Recognition with Hierarchical Cross-Modal Attention Network

Some Issues of Mood Classification for Chinese Popular Music

Audio Tonality Mode Classification Without Tonic Annotations.