Abstract:The rapid development of Artificial Intelligence (AI) has revolutionized numerous fields, with large language models (LLMs) and computer vision (CV) systems driving advancements in natural language understanding and visual processing, respectively. The convergence of these technologies has catalyzed the rise of multimodal AI, enabling richer, cross-modal understanding that spans text, vision, audio, and video modalities. Multimodal large language models (MLLMs), in particular, have emerged as a powerful framework, demonstrating impressive capabilities in tasks like image-text generation, visual question answering, and cross-modal retrieval. Despite these advancements, the complexity and scale of MLLMs introduce significant challenges in interpretability and explainability, essential for establishing transparency, trustworthiness, and reliability in high-stakes applications. This paper provides a comprehensive survey on the interpretability and explainability of MLLMs, proposing a novel framework that categorizes existing research across three perspectives: (I) Data, (II) Model, (III) Training \& Inference. We systematically analyze interpretability from token-level to embedding-level representations, assess approaches related to both architecture analysis and design, and explore training and inference strategies that enhance transparency. By comparing various methodologies, we identify their strengths and limitations and propose future research directions to address unresolved challenges in multimodal explainability. This survey offers a foundational resource for advancing interpretability and transparency in MLLMs, guiding researchers and practitioners toward developing more accountable and robust multimodal AI systems.

Explaining latent representations of generative models with large multimodal models

LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multi-modal Foundation Models

Multimodal Latent Language Modeling with Next-Token Diffusion

Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey

A Concept-Based Explainability Framework for Large Multimodal Models

Towards Uncovering How Large Language Model Works: An Explainability Perspective

Multi-Level Explanations for Generative Language Models

Explaining Multi-modal Large Language Models by Analyzing their Vision Perception

Large Multi-modal Models Can Interpret Features in Large Multi-modal Models

Towards Interpretable Natural Language Understanding with Explanations As Latent Variables

Multimodal Explanations: Justifying Decisions and Pointing to the Evidence

A Principled Framework for Explainable Multimodal Disentanglement

Explainability for Large Language Models: A Survey

Explaining Agent Behavior with Large Language Models

XPrompt:Explaining Large Language Model's Generation via Joint Prompt Attribution

LLMExplainer: Large Language Model based Bayesian Inference for Graph Explanation Generation

Joint Gaussian Mixture Model for Versatile Deep Visual Model Explanation

Uncertainty-Aware Explainable Recommendation with Large Language Models

Multimodal Large Language Models: A Survey

Disentangling shared and private latent factors in multimodal Variational Autoencoders

Generative Large Language Models Explained [Ai-Explained]