Abstract:Albeit revealing impressive predictive performance for several computer vision tasks, deep neural networks (DNNs) are prone to making overconfident predictions. This limits the adoption and wider utilization of DNNs in many safety-critical applications. There have been recent efforts toward calibrating DNNs, however, almost all of them focus on the classification task. Surprisingly, very little attention has been devoted to calibrating modern DNN-based object detectors, especially detection transformers, which have recently demonstrated promising detection performance and are influential in many decision-making systems. In this work, we address the problem by proposing a mechanism for calibrated detection transformers (Cal-DETR), particularly for Deformable-DETR, UP-DETR and DINO. We pursue the train-time calibration route and make the following contributions. First, we propose a simple yet effective approach for quantifying uncertainty in transformer-based object detectors. Second, we develop an uncertainty-guided logit modulation mechanism that leverages the uncertainty to modulate the class logits. Third, we develop a logit mixing approach that acts as a regularizer with detection-specific losses and is also complementary to the uncertainty-guided logit modulation technique to further improve the calibration performance. Lastly, we conduct extensive experiments across three in-domain and four out-domain scenarios. Results corroborate the effectiveness of Cal-DETR against the competing train-time methods in calibrating both in-domain and out-domain detections while maintaining or even improving the detection performance. Our codebase and pre-trained models can be accessed at \url{<a class="link-external link-https" href="https://github.com/akhtarvision/cal-detr" rel="external noopener nofollow">this https URL</a>}.

CaloDREAM -- Detector Response Emulation via Attentive flow Matching

Normalizing Flows for High-Dimensional Detector Simulations

Generative Machine Learning for Detector Response Modeling with a Conditional Normalizing Flow

Denoising diffusion models with geometry adaptation for high fidelity calorimeter simulation

Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flows

L2LFlows: Generating High-Fidelity 3D Calorimeter Images

CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flows

Anomaly detection with flow-based fast calorimeter simulators

Unifying Simulation and Inference with Normalizing Flows

Cal-DETR: Calibrated Detection Transformer

TEDdet: Temporal Feature Exchange and Difference Network for Online Real-Time Action Detection

DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection

TransFlow: Transformer as Flow Learner

DFM: Interpolant-free Dual Flow Matching

CaloGraph: Graph-based diffusion model for fast shower generation in calorimeters with irregular geometry

Dance with Flow: Two-in-One Stream Action Detection

Dreaming Learning

Visual Anomaly Detection via Dual-Attention Transformer and Discriminative Flow

MSF3DDETR: Multi-Sensor Fusion 3D Detection Transformer for Autonomous Driving

Coordinate In and Value Out: Training Flow Transformers in Ambient Space