Abstract:The introduction of Transformer architectures - with the self-attention mechanism - in automatic Natural Language Generation (NLG) is a breakthrough in solving general task-oriented problems, such as the simple production of long text excerpts that resemble ones written by humans. While the performance of GPT-X architectures is there for all to see, many efforts are underway to penetrate the secrets of these black-boxes in terms of intelligent information processing whose output statistical distributions resemble that of natural language. In this work, through the complexity science framework, a comparative study of the stochastic processes underlying the texts produced by the English version of GPT-2 with respect to texts produced by human beings, notably novels in English and programming codes, is offered. The investigation, of a methodological nature, consists first of all of an analysis phase in which the Multifractal Detrended Fluctuation Analysis and the Recurrence Quantification Analysis - together with Zipf's law and approximate entropy - are adopted to characterize long-term correlations, regularities and recurrences in human and machine-produced texts. Results show several peculiarities and trends in terms of long-range correlations and recurrences in the last case. The synthesis phase, on the other hand, uses the complexity measures to build synthetic text descriptors - hence a suitable text embedding - which serve to constitute the features for feeding a machine learning system designed to operate feature selection through an evolutionary technique. Using multivariate analysis, it is then shown the grouping tendency of the three analyzed text types, allowing to place GTP-2 texts in between natural language texts and computer codes. Similarly, the classification task demonstrates that, given the high accuracy obtained in the automatic discrimination of text classes, the proposed set of complexity measures is highly informative. These interesting results allow us to add another piece to the theoretical understanding of the surprising results obtained by NLG systems based on deep learning and let us to improve the design of new informetrics or text mining systems for text classification, fake news detection, or even plagiarism detection.

eXplainable AI with GPT4 for story analysis and generation: A novel framework for diachronic sentiment analysis

Tell Me a Story! Narrative-Driven XAI with Large Language Models

INTERACTION: A Generative XAI Framework for Natural Language Inference Explanations.

Explingo: Explaining AI Predictions using Large Language Models

Explainability and transparency in the realm of digital humanities: toward a historian XAI

Interpretable Narrative Explanation for ML Predictors with LP: A Case Study for XAI

XAI for All: Can Large Language Models Simplify Explainable AI?

Leveraging Explainable AI to Analyze Researchers' Aspect-Based Sentiment about ChatGPT

Generative AI in the Era of Transformers: Revolutionizing Natural Language Processing with LLMs

Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features

Human versus Machine Intelligence: Assessing Natural Language Generation Models through Complex Systems Theory

Sentiment Analysis in the Age of Generative AI

From Black Boxes to Conversations: Incorporating XAI in a Conversational Agent

Explainable AI Reloaded: Challenging the XAI Status Quo in the Era of Large Language Models

Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet

Sentiment Analysis Meets Explainable Artificial Intelligence: A Survey on Explainable Sentiment Analysis

SentimentGPT: Exploiting GPT for Advanced Sentiment Analysis and its Departure from Current Machine Learning

Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements

Natural Language Generation Challenges for Explainable AI

Understanding Public Opinion towards ESG and Green Finance with the Use of Explainable Artificial Intelligence

Leveraging ChatGPT As Text Annotation Tool For Sentiment Analysis