Abstract:The rapid advancement of Large AI Models (LAIMs), particularly diffusion models and large language models, has marked a new era where AI-generated multimedia is increasingly integrated into various aspects of daily life. Although beneficial in numerous fields, this content presents significant risks, including potential misuse, societal disruptions, and ethical concerns. Consequently, detecting multimedia generated by LAIMs has become crucial, with a marked rise in related research. Despite this, there remains a notable gap in systematic surveys that focus specifically on detecting LAIM-generated multimedia. Addressing this, we provide the first survey to comprehensively cover existing research on detecting multimedia (such as text, images, videos, audio, and multimodal content) created by LAIMs. Specifically, we introduce a novel taxonomy for detection methods, categorized by media modality, and aligned with two perspectives: pure detection (aiming to enhance detection performance) and beyond detection (adding attributes like generalizability, robustness, and interpretability to detectors). Additionally, we have presented a brief overview of generation mechanisms, public datasets, and online detection tools to provide a valuable resource for researchers and practitioners in this field. Furthermore, we identify current challenges in detection and propose directions for future research that address unexplored, ongoing, and emerging issues in detecting multimedia generated by LAIMs. Our aim for this survey is to fill an academic gap and contribute to global AI security efforts, helping to ensure the integrity of information in the digital realm. The project link is https://github.com/Purdue-M2/Detect-LAIM-generated-Multimedia-Survey.

Positive and Risky Message Assessment for Music Products

Human-centric Music Medical Therapy Exploration System

The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models

Real-Time Human-Music Emotional Interaction Based on Deep Learning and Multimodal Sentiment Analysis

Real-time Human-Music Emotional Interaction Based on Multimodal Analysis

Tag2Risk: Harnessing Social Music Tags for Characterizing Depression Risk

The Role of Large Language Models in Musicology: Are We Ready to Trust the Machines?

Enhancing Music Mood Recognition with LLMs and Audio Signal Processing: A Multimodal Approach

Evaluation of pretrained language models on music understanding

Assessing the Impact of Music Recommendation Diversity on Listeners: A Longitudinal Study

Non-reference audio quality assessment for online live music recordings

Automatic Detection of Moral Values in Music Lyrics

Machine Learning Framework for Audio-Based Content Evaluation using MFCC, Chroma, Spectral Contrast, and Temporal Feature Engineering

Music video affective understanding using feature importance analysis

A Comprehensive Survey for Evaluation Methodologies of AI-Generated Music

MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language Models

MusicRL: Aligning Music Generation to Human Preferences

Video Background Music Generation: Dataset, Method and Evaluation

Automatic Music Mood Classification by Learning Cross-Media Relevance Between Audio and Lyrics

Music Emotion Research Based on Reinforcement Learning and Multimodal Information

Detecting Multimedia Generated by Large AI Models: A Survey