Abstract:Detecting firearms and accurately localizing individuals carrying them in images or videos is of paramount importance in security, surveillance, and content customization. However, this task presents significant challenges in complex environments due to clutter and the diverse shapes of firearms. To address this problem, we propose a novel approach that leverages human-firearm interaction information, which provides valuable clues for localizing firearm carriers. Our approach incorporates an attention mechanism that effectively distinguishes humans and firearms from the background by focusing on relevant areas. Additionally, we introduce a saliency-driven locality-preserving constraint to learn essential features while preserving foreground information in the input image. By combining these components, our approach achieves exceptional results on a newly proposed dataset. To handle inputs of varying sizes, we pass paired human-firearm instances with attention masks as channels through a deep network for feature computation, utilizing an adaptive average pooling layer. We extensively evaluate our approach against existing methods in human-object interaction detection and achieve significant results (AP=77.8\%) compared to the baseline approach (AP=63.1\%). This demonstrates the effectiveness of leveraging attention mechanisms and saliency-driven locality preservation for accurate human-firearm interaction detection. Our findings contribute to advancing the fields of security and surveillance, enabling more efficient firearm localization and identification in diverse scenarios.

Human pose estimation for mitigating false negatives in weapon detection in video-surveillance

Handgun Detection Using Combined Human Pose and Weapon Appearance

Using human pose information for handgun detection

Weapon Detection Using YOLO V3 for Smart Surveillance System

Human skeletons and change detection for efficient violence detection in surveillance videos

Weapon Detection in Surveillance Videos Using YOLOV8 and PELSF-DCNN

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Object Detection Binary Classifiers methodology based on deep learning to identify small objects handled similarly: Application in video surveillance

Pose Estimation for Swimmers in Video Surveillance

Conditioned Cooperative training for semi-supervised weapon detection

Detection and Localization of Firearm Carriers in Complex Scenes for Improved Safety Measures

Distributed Intelligent Video Surveillance for Early Armed Robbery Detection based on Deep Learning

PoseHD: Boosting Human Detectors Using Human Pose Information

Human Pose Detection for Robotic-Assisted and Rehabilitation Environments

A deep-learning framework running on edge devices for handgun and knife detection from indoor video-surveillance cameras

Transfer Learning-based Real-time Handgun Detection

SD-Pose: facilitating space-decoupled human pose estimation via adaptive pose perception guidance

Fighting against terrorism: A real-time CCTV autonomous weapons detection based on improved YOLO v4

Weakly Supervised Violence Detection in Surveillance Video

SuPEr-SAM: Using the Supervision Signal from a Pose Estimator to Train a Spatial Attention Module for Personal Protective Equipment Recognition