Abstract:In recent years, one-stage HOI (Human-Object Interaction) detection methods tend to divide the original task into multiple sub-tasks by using a multi-branch network structure. However, there is no sufficient attention to information communication between these branches. The inference approach in the cascaded structure is singular, while fully parallel methods will disrupt the associations between different pieces of information. Besides, noise interference may occur during the fusion of different features and thus affect the detection performance. To address these issues, this paper proposes a one-stage three-branch parallel HOI detection method, which treats HOI as three separate sub-tasks (human detection, object detection, and interaction detection) and leverages three distinct reasoning relationships to generate richer relational information. Firstly , an auxiliary feature fusion (AFF) module is introduced, which integrates features originally extracted independently to form fused features enriched with supplementary information. This approach strengthens communication between branches in the network while handling the three sub-tasks concurrently, thereby facilitating the exchange of more contextual information. Secondly , to mitigate noise interference generated during the fusion process, a fusion noise suppression (FNS) module is introduced, which effectively suppresses noise and enhances the model's performance in interaction detection tasks. Finally , experiments are conducted on two major benchmark datasets, and experimental results show that our HOI detection method is superior to previous methods. Also, ablation studies confirm the effectiveness of all the components in our proposed method.

Information Fusion Based on Self-organizing Incremental Neural Network

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Interleaved Attention Convolutional Compression Network: an Effective Data Mining Method for the Fusion System of Gas Sensor and Hyperspectral

Self-Organizing Incremental Neural Network And Its Application

A study on local sensor fusion of wireless sensor networks based on the neural network

Enabling Efficient Deep Convolutional Neural Network-based Sensor Fusion for Autonomous Driving

Fourier-enhanced Implicit Neural Fusion Network for Multispectral and Hyperspectral Image Fusion

Sparse Long Short-Term Memory for Information Fusion in Wireless Sensor Networks

Deepfusion: A Deep Learning Framework For The Fusion Of Heterogeneous Sensory Data

IFNet: Data-driven multisensor estimate fusion with unknown correlation in sensor measurement noises

Hyperspectral and Multispectral Image Fusion by Deep Neural Network in a Self-Supervised Manner

Developmental Cognitive Map Learning And Behavior Acquisition By A Mobile Robot Through A Self-Organizing Incremental Neural Network

Infrared dual-band image fusion with simplified pulse coupled neural network and visual saliency map in nonsubsampled shearlet transform domain

CTFusion: CNN-transformer-based self-supervised learning for infrared and visible image fusion

DCFusion: Dual-Headed Fusion Strategy and Contextual Information Awareness for Infrared and Visible Remote Sensing Image

Auxiliary Feature Fusion and Noise Suppression for HOI Detection

Fuzzy Self-Organizing Incremental Neural Network for Fuzzy Clustering

DFTI: Dual-Branch Fusion Network Based on Transformer and Inception for Space Noncooperative Objects

A novel image fusion method based on SGNN

A Self-Organizing Incremental Neural Network Based on Local Distribution Learning

ICIF: Image fusion via information clustering and image features