Abstract:Recent research has focused on the medium and long-term impacts of generative AI, posing scientific and societal challenges mainly due to the detection and reliability of machine-generated information, which is projected to form the major content on the Web soon. Prior studies show that LLMs exhibit a lower performance in generation tasks (model collapse) as they undergo a fine-tuning process across multiple generations on their own generated content (self-consuming loop). In this paper, we present a comprehensive simulation framework built upon the chat version of LLama2, focusing particularly on the linguistic aspects of the generated content, which has not been fully examined in existing studies. Our results show that the model produces less lexical rich content across generations, reducing diversity. The lexical richness has been measured using the linguistic measures of entropy and TTR as well as calculating the POSTags frequency. The generated content has also been examined with an $n$-gram analysis, which takes into account the word order, and semantic networks, which consider the relation between different words. These findings suggest that the model collapse occurs not only by decreasing the content diversity but also by distorting the underlying linguistic patterns of the generated text, which both highlight the critical importance of carefully choosing and curating the initial input text, which can alleviate the model collapse problem. Furthermore, we conduct a qualitative analysis of the fine-tuned models of the pipeline to compare their performances on generic NLP tasks to the original model. We find that autophagy transforms the initial model into a more creative, doubtful and confused one, which might provide inaccurate answers and include conspiracy theories in the model responses, spreading false and biased information on the Web.

Harmonizing Fine-tuned Llama 2 for Content Generation with Stable Diffusion for Image Synthesis in Article Creation

CreativeSynth: Creative Blending and Synthesis of Visual Arts based on Multimodal Diffusion

Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation

Novel 3D-Aware Composition Images Synthesis for Object Display with Diffusion Model.

A linguistic analysis of undesirable outcomes in the era of generative AI

Diffusion Beats Autoregressive: An Evaluation of Compositional Generation in Text-to-Image Models

DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation

Fine Tuning Text-to-Image Diffusion Models for Correcting Anomalous Images

A Comparative Analysis of AI Image Generation Models: Stable Diffusion, Dall-E and Dream by WOMBO

ArtAug: Enhancing Text-to-Image Generation through Synthesis-Understanding Interaction

From Noise to Nuance: Advances in Deep Generative Image Models

Harnessing Multimodal AI for Creative Design: Performance Evaluation of Stable Diffusion and DALL-E 3 in Fashion Apparel and Typography

TextCraftor: Your Text Encoder Can be Image Quality Controller

Text-to-Image Synthesis With Generative Models: Methods, Datasets, Performance Metrics, Challenges, and Future Direction

Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesis

Enhancing Reality: Exploring the Potential of Generative Artificial Intelligence

GenCA: A Text-conditioned Generative Model for Realistic and Drivable Codec Avatars

A Development of Personalized Content Creation Technology Model using NLP and AI Integrated System

Multimodal Gen-AI for Fundamental Investment Research

HiFi Tuner: High-Fidelity Subject-Driven Fine-Tuning for Diffusion Models

ToBlend: Token-Level Blending With an Ensemble of LLMs to Attack AI-Generated Text Detection