Abstract:Recent advances of large multi-modality models (LMM) have greatly improved the ability of image quality assessment (IQA) method to evaluate and explain the quality of visual content. However, these advancements are mostly focused on overall quality assessment, and the detailed examination of local quality, which is crucial for comprehensive visual understanding, is still largely unexplored. In this work, we introduce Q-Ground, the first framework aimed at tackling fine-scale visual quality grounding by combining large multi-modality models with detailed visual quality analysis. Central to our contribution is the introduction of the QGround-100K dataset, a novel resource containing 100k triplets of (image, quality text, distortion segmentation) to facilitate deep investigations into visual quality. The dataset comprises two parts: one with human-labeled annotations for accurate quality assessment, and another labeled automatically by LMMs such as GPT4V, which helps improve the robustness of model training while also reducing the costs of data collection. With the QGround-100K dataset, we propose a LMM-based method equipped with multi-scale feature learning to learn models capable of performing both image quality answering and distortion segmentation based on text prompts. This dual-capability approach not only refines the model's understanding of region-aware image quality but also enables it to interactively respond to complex, text-based queries about image quality and specific distortions. Q-Ground takes a step towards sophisticated visual quality analysis in a finer scale, establishing a new benchmark for future research in the area. Codes and dataset are available at <a class="link-external link-https" href="https://github.com/Q-Future/Q-Ground" rel="external noopener nofollow">this https URL</a>.

Introduction To A Large-Scale General Purpose Ground Truth Database: Methodology, Annotation Tool And Benchmarks

Benchmarking Large-Scale Multi-View 3D Reconstruction Using Realistic Synthetic Images

When Visual Grounding Meets Gigapixel-level Large-scale Scenes: Benchmark and Approach

A Database Schema for Large Scale Annotated Image Dataset

GraspNet: A Large-Scale Clustered and Densely Annotated Datase for Object Grasping

ObjectNet3D: A Large Scale Database for 3D Object Recognition

Dense Facial Landmark Localization: Database and Annotation Tool

GraspNet-1Billion: A Large-Scale Benchmark for General Object Grasping

LabelMe: Online Image Annotation and Applications

SUN database: Large-scale scene recognition from abbey to zoo

AI Challenger : A Large-scale Dataset for Going Deeper in Image Understanding

A Survey on Automatic Image Annotation.

ReCon1M:A Large-scale Benchmark Dataset for Relation Comprehension in Remote Sensing Imagery

Towards Good Practices for Efficiently Annotating Large-Scale Image Classification Datasets

Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy

EasyLabel: A Semi-Automatic Pixel-wise Object Annotation Tool for Creating Robotic RGB-D Datasets

Q-Ground: Image Quality Grounding with Large Multi-modality Models

Learning Visual Grounding from Generative Vision and Language Model

Places: An Image Database for Deep Scene Understanding

An annotated grain kernel image database for visual quality inspection