Abstract:Generative artificial intelligence (AI) has emerged as a powerful technology with numerous applications in various domains. There is a need to identify the requirements and evaluation metrics for generative AI models designed for specific tasks. The purpose of the research aims to investigate the fundamental aspects of generative AI systems, including their requirements, models, input–output formats, and evaluation metrics. The study addresses key research questions and presents comprehensive insights to guide researchers, developers, and practitioners in the field. Firstly, the requirements necessary for implementing generative AI systems are examined and categorized into three distinct categories: hardware, software, and user experience. Furthermore, the study explores the different types of generative AI models described in the literature by presenting a taxonomy based on architectural characteristics, such as variational autoencoders (VAEs), generative adversarial networks (GANs), diffusion models, transformers, language models, normalizing flow models, and hybrid models. A comprehensive classification of input and output formats used in generative AI systems is also provided. Moreover, the research proposes a classification system based on output types and discusses commonly used evaluation metrics in generative AI. The findings contribute to advancements in the field, enabling researchers, developers, and practitioners to effectively implement and evaluate generative AI models for various applications. The significance of the research lies in understanding that generative AI system requirements are crucial for effective planning, design, and optimal performance. A taxonomy of models aids in selecting suitable options and driving advancements. Classifying input–output formats enables leveraging diverse formats for customized systems, while evaluation metrics establish standardized methods to assess model quality and performance.

A Demand-Driven Perspective on Generative Audio AI

Guest Editorial: AI for Computational Audition—sound and Music Processing

Generative AI for Music and Audio

A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AI

Foundational Discussion on Research Directions for Image-Generating Artificial Intelligence, with a Focus on Realistic Images

A Survey of Generative Artificial Intelligence Techniques

Leveraging AI to Generate Audio for User-generated Content in Video Games

Generative AI in the Wild: Prospects, Challenges, and Strategies

A Survey of AI Music Generation Tools and Models

Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music

A Survey of Deep Learning Audio Generation Methods

Prevailing Research Areas for Music AI in the Era of Foundation Models

The Power of Generative AI: A Review of Requirements, Models, Input–Output Formats, Evaluation Metrics, and Challenges

Empirical insights into AI-assisted game development: A case study on the integration of generative AI tools in creative pipelines

Designing Participatory AI: Creative Professionals' Worries and Expectations about Generative AI

Audiobox: Unified Audio Generation with Natural Language Prompts

A Systematic Survey of Approaches Used in Computer Music Generation

Survey for Landing Generative AI in Social and E-commerce Recsys -- the Industry Perspectives

Generative AI in the Construction Industry: Opportunities & Challenges

On the Challenges and Opportunities in Generative AI

Challenge on Sound Scene Synthesis: Evaluating Text-to-Audio Generation