Abstract:Albeit revealing impressive predictive performance for several computer vision tasks, deep neural networks (DNNs) are prone to making overconfident predictions. This limits the adoption and wider utilization of DNNs in many safety-critical applications. There have been recent efforts toward calibrating DNNs, however, almost all of them focus on the classification task. Surprisingly, very little attention has been devoted to calibrating modern DNN-based object detectors, especially detection transformers, which have recently demonstrated promising detection performance and are influential in many decision-making systems. In this work, we address the problem by proposing a mechanism for calibrated detection transformers (Cal-DETR), particularly for Deformable-DETR, UP-DETR and DINO. We pursue the train-time calibration route and make the following contributions. First, we propose a simple yet effective approach for quantifying uncertainty in transformer-based object detectors. Second, we develop an uncertainty-guided logit modulation mechanism that leverages the uncertainty to modulate the class logits. Third, we develop a logit mixing approach that acts as a regularizer with detection-specific losses and is also complementary to the uncertainty-guided logit modulation technique to further improve the calibration performance. Lastly, we conduct extensive experiments across three in-domain and four out-domain scenarios. Results corroborate the effectiveness of Cal-DETR against the competing train-time methods in calibrating both in-domain and out-domain detections while maintaining or even improving the detection performance. Our codebase and pre-trained models can be accessed at \url{<a class="link-external link-https" href="https://github.com/akhtarvision/cal-detr" rel="external noopener nofollow">this https URL</a>}.

Low-light DEtection TRansformer (LDETR): object detection in low-light and adverse weather conditions

A Transformer-Based Object Detector with Coarse-Fine Crossing Representations

L-DETR: A Light-Weight Detector for End-to-End Object Detection With Transformers

LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection

A Step-Wise Domain Adaptation Detection Transformer for Object Detection under Poor Visibility Conditions

Investigating the Robustness and Properties of Detection Transformers (DETR) Toward Difficult Images

Deformable DETR: Deformable Transformers for End-to-End Object Detection

LEDet: A Single-Shot Real-Time Object Detector Based on Low-Light Image Enhancement

Towards Data-Efficient Detection Transformers

DETR-ORD: An Improved DETR Detector for Oriented Remote Sensing Object Detection with Feature Reconstruction and Dynamic Query

DHS-DETR: Efficient DETRs with Dynamic Head Switching

A Complementary Dual-Backbone Transformer Extracting and Fusing Weak Cues for Object Detection in Extremely Dark Videos.

DEFormer: DCT-driven Enhancement Transformer for Low-light Image and Dark Vision

Cross Resolution Encoding-Decoding For Detection Transformers

End-to-End Object Detection with Transformers

DFS-DETR: Detailed-Feature-Sensitive Detector for Small Object Detection in Aerial Images Using Transformer

DETR++: Taming Your Multi-Scale Detection Transformer

DETRs Beat YOLOs on Real-time Object Detection

A novel low light object detection method based on the YOLOv5 fusion feature enhancement

Li3DeTr: A LiDAR based 3D Detection Transformer

Cal-DETR: Calibrated Detection Transformer