Abstract:Visual question answering (VQA) refers to the problem where, given an image and a natural language question about the image, a correct natural language answer has to be generated. A VQA model has to demonstrate both the visual understanding of the image and the semantic understanding of the question, demonstrating reasoning capability. Since the inception of this field, a plethora of VQA datasets and models have been published. In this article, we meticulously analyze the current state of VQA datasets and models, while cleanly dividing them into distinct categories and then summarizing the methodologies and characteristics of each category. We divide VQA datasets into four categories: (1) available datasets that contain a rich collection of authentic images, (2) synthetic datasets that contain only synthetic images produced through artificial means, (3) diagnostic datasets that are specially designed to test model performance in a particular area, e.g., understanding the scene text, and (4) KB (Knowledge-Based) datasets that are designed to measure a model's ability to utilize outside knowledge. Concurrently, we explore six main paradigms of VQA models: fusion, where we discuss different methods of fusing information between visual and textual modalities; attention, the technique of using information from one modality to filter information from another; external knowledge base, where we discuss different models utilizing outside information; composition or reasoning, where we analyze techniques to answer advanced questions that require complex reasoning steps; explanation, which is the process of generating visual and textual descriptions to verify sound reasoning; and graph models, which encode and manipulate relationships through nodes in a graph. We also discuss some miscellaneous topics, such as scene text understanding, counting, and bias reduction.

A survey on VQA_Datasets and Approaches

Simple and Effective Visual Question Answering in a Single Modality

Visual question answering: A survey of methods and datasets

A Comprehensive Survey on Visual Question Answering Datasets and Algorithms

Visual question answering: Datasets, algorithms, and future challenges

Visual Question Answering using Deep Learning: A Survey and Performance Analysis

Medical visual question answering: A survey

Visual Question Answering As Reading Comprehension

Vqa: Visual question answering

Information Fusion in Visual Question Answering: A Survey

AI-VQA: Visual Question Answering based on Agent Interaction with Interpretability

AI-VQA

VQA$^2$:Visual Question Answering for Video Quality Assessment

Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey

VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges

Video Question Answering: Datasets, Algorithms and Challenges

Answer Them All! Toward Universal Visual Question Answering Models

Visual Question Answering: A Survey on Techniques and Common Trends in Recent Literature

Robust Visual Question Answering: Datasets, Methods, and Future Challenges