Abstract:Movie genre classification is a challenging task that has increasingly attracted the attention of researchers. The number of movie consumers interested in taking advantage of automatic movie genre classification is overgrowing, thanks to media streaming service providers' popularization. In this paper, we addressed the multi-label classification of movie genres in a multimodal way. To this end, we created a dataset composed of trailer video clips, subtitles, synopses, and movie posters from 152,622 movie titles of the Movie Database (TMDb). Such a large dataset was carefully curated, organized, and made available as a contribution of this work. We labeled each movie of the dataset according to a set of eighteen genre labels. In the experimental evaluation performed in this paper, we computed different kinds of descriptors, such as Mel Frequency Cepstral Coefficients (MFCCs), Statistical Spectrum Descriptor (SSD), Local Binary Pattern (LBP) from spectrograms, Long-Short Term Memory (LSTM), and Convolutional Neural Networks (CNN). With these descriptors, we trained different monolithic classifiers using BinaryRelevance and ML-kNN techniques. Besides, we also explored the combination of classifiers/features using a late fusion strategy. The fusion of a LSTM trained on synopses and another LSTM trained on the movie subtitles provided our best results in F-Score (0.674) and AUC-PR (0.725) metrics. These results corroborate the existence of complementarity among classifiers trained on different sources of information in this field of application. As far as we know, this is the most comprehensive study developed in terms of diversity of multimedia sources of information to perform movie genre classification.

Brazilian Lyrics-Based Music Genre Classification Using a BLSTM Network

Machine learning and chord based feature engineering for genre prediction in popular Brazilian music

Exploring Genre and Success Classification through Song Lyrics using DistilBERT: A Fun NLP Venture

Complex Network-Based Approach for Feature Extraction and Classification of Musical Genres

Classification and study of music genres with multimodal Spectro-Lyrical Embeddings for Music (SLEM)

Music Genres Classification Using Text Categorization Method

Music Genre Classification using Large Language Models

Lukthung Classification Using Neural Networks on Lyrics and Audios

Automatic Identification of Traditional Colombian Music Genres based on Audio Content Analysis and Machine Learning Technique

Lyrics-Based Music Genre Classification Using a Hierarchical Attention Network

A multimodal approach for multi-label movie genre classification

A novel approach to musical genre classification using probabilistic latent semantic analysis model

Course genres classification of music e-learning platform based on deep learning big data intelligent processing algorithm

Random Projections of Mel-Spectrograms as Low-Level Features for Automatic Music Genre Classification

Embedding generation for text classification of Brazilian Portuguese user reviews: from bag-of-words to transformers

A Methodology to Handle Social Media Posts in Brazilian Portuguese for Text Mining Applications

Music Genre Classification with ResNet and Bi-GRU Using Visual Spectrograms

Automatic identification of preferred music genres: an exploratory machine learning approach to support personalized music therapy

Long Short-Term Memory Recurrent Neural Network Based Segment Features for Music Genre Classification

Music genre classification and recognition using convolutional neural network

Performance Analysis of Deep Learning and Machine Learning Methods for Music Genre Classification System