Abstract:In this paper, we introduce DINO-X, which is a unified object-centric vision model developed by IDEA Research with the best open-world object detection performance to date. DINO-X employs the same Transformer-based encoder-decoder architecture as Grounding DINO 1.5 to pursue an object-level representation for open-world object understanding. To make long-tailed object detection easy, DINO-X extends its input options to support text prompt, visual prompt, and customized prompt. With such flexible prompt options, we develop a universal object prompt to support prompt-free open-world detection, making it possible to detect anything in an image without requiring users to provide any prompt. To enhance the model's core grounding capability, we have constructed a large-scale dataset with over 100 million high-quality grounding samples, referred to as Grounding-100M, for advancing the model's open-vocabulary detection performance. Pre-training on such a large-scale grounding dataset leads to a foundational object-level representation, which enables DINO-X to integrate multiple perception heads to simultaneously support multiple object perception and understanding tasks, including detection, segmentation, pose estimation, object captioning, object-based QA, etc. Experimental results demonstrate the superior performance of DINO-X. Specifically, the DINO-X Pro model achieves 56.0 AP, 59.8 AP, and 52.4 AP on the COCO, LVIS-minival, and LVIS-val zero-shot object detection benchmarks, respectively. Notably, it scores 63.3 AP and 56.5 AP on the rare classes of LVIS-minival and LVIS-val benchmarks, both improving the previous SOTA performance by 5.8 AP. Such a result underscores its significantly improved capacity for recognizing long-tailed objects.

WEA-DINO: An Improved DINO With Word Embedding Alignment for Remote Scene Zero-Shot Object Detection

DINO-X: A Unified Vision Model for Open-World Object Detection and Understanding

OV-DINO: Unified Open-Vocabulary Detection with Language-Aware Selective Fusion

DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection

Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection

Mask DINO: Towards a Unified Transformer-Based Framework for Object Detection and Segmentation

Cascading Alignment for Unsupervised Domain-Adaptive DETR with Improved DeNoising Anchor Boxes

DINO-SD: Champion Solution for ICRA 2024 RoboDepth Challenge

DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning

Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detection

I-DINO: High-Quality Object Detection for Indoor Scenes

Visually Aligned Word Embeddings for Improving Zero-shot Learning.

Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Community

Change Dino: A Unified Transformer-Based Framework for Object-Level Change Detection and Segmentation in Remote Sensing Imagery

Automatic Aug-Aware Contrastive Proposal Encoding for Few-Shot Object Detection of Remote Sensing Images

Task-decoupled interactive embedding network for object detection

OV-DQUO: Open-Vocabulary DETR with Denoising Text Query Training and Open-World Unknown Objects Supervision

SWIN-TOD: Smooth Wasserstein Distance and Instance-level Neighboring Enhancement for Remote Sensing Tiny Object Detection

AnomalyDINO: Boosting Patch-based Few-shot Anomaly Detection with DINOv2

EdaDet: Open-Vocabulary Object Detection Using Early Dense Alignment

Efficient Decoder for End-to-End Oriented Object Detection in Remote Sensing Images