Abstract:This paper focuses on Human-Object Interaction (HOI) detection, addressing the challenge of identifying and understanding the interactions between humans and objects within a given image or video frame. Spearheaded by Detection Transformer (DETR), recent developments lead to significant improvements by replacing traditional region proposals by a set of learnable queries. However, despite the powerful representation capabilities provided by Transformers, existing Human-Object Interaction (HOI) detection methods still yield low confidence levels when dealing with complex interactions and are prone to overlooking interactive actions. To address these issues, we propose a novel approach \textsc{UAHOI}, Uncertainty-aware Robust Human-Object Interaction Learning that explicitly estimates prediction uncertainty during the training process to refine both detection and interaction predictions. Our model not only predicts the HOI triplets but also quantifies the uncertainty of these predictions. Specifically, we model this uncertainty through the variance of predictions and incorporate it into the optimization objective, allowing the model to adaptively adjust its confidence threshold based on prediction variance. This integration helps in mitigating the adverse effects of incorrect or ambiguous predictions that are common in traditional methods without any hand-designed components, serving as an automatic confidence threshold. Our method is flexible to existing HOI detection methods and demonstrates improved accuracy. We evaluate \textsc{UAHOI} on two standard benchmarks in the field: V-COCO and HICO-DET, which represent challenging scenarios for HOI detection. Through extensive experiments, we demonstrate that \textsc{UAHOI} achieves significant improvements over existing state-of-the-art methods, enhancing both the accuracy and robustness of HOI detection.

[Sudden death in intermittent Wolff Parkinson White syndrome].

Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics.

Human Object Interaction Detection using Two-Direction Spatial Enhancement and Exclusive Object Prior

Transferable Interactiveness Prior for Human-Object Interaction Detection.

Learning Human-Object Interaction Detection Using Interaction Points

FreeA: Human-object Interaction Detection using Free Annotation Labels

Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detection

Effective Actor-centric Human-object Interaction Detection

Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Models

Visual Compositional Learning for Human-Object Interaction Detection

PPDM++: Parallel Point Detection and Matching for Fast and Accurate HOI Detection

Detecting Human—object Interaction with Multi-Level Pairwise Feature Network

Learning to Detect Human-Object Interactions

Exploring Pose-Aware Human-Object Interaction Via Hybrid Learning

HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Models

Transferable Interactiveness Knowledge for Human-Object Interaction Detection

Disentangled Pre-training for Human-Object Interaction Detection

UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detection

UAHOI: Uncertainty-aware Robust Interaction Learning for HOI Detection

Reformulating HOI Detection as Adaptive Set Prediction

Interactiveness Field in Human-Object Interactions