Abstract:Physical violence detection using multimedia data is crucial for public safety and security. This is an important research area in information security and digital forensics. Research in video-based violence detection (VVD) has grown steadily in recent years with rapid increase in video surveillance systems worldwide. Verbal aggression detection technologies, on the other hand, are still limited due to the popularity of computer vision models. Thus, researchers have preferred to use computer vision models to detect violence using videos. We have presented a new automatic audio violence detection (AVD) model to fill this gap. Our AVD model is handcrafted and its details are as follows. This work collected a new audio dataset on verbal aggression from YouTube. A novel handcrafted model was proposed using multilevel feature extraction, feature selection, classification, and majority voting phases. A new local feature extraction function based on the binary tree was used to generate features from audio signals. We call this function tree pattern-23 (TreePat23), where 23 represents the number of wavelet bands/audio signals inputs. Wavelet bands were generated using tunable Q wavelet transform (TQWT) before being applied to our TreePat23 for feature extraction. The iterative neighborhood component analysis (INCA) and Chi2 were used to select the features. The selected features were classified using k nearest neighbors (kNN) and support vector machine (SVM) followed by iterative majority voting (IMV) method. The best-predicted vector was obtained by using a greedy algorithm. Finally, a new validation technique called leave one record out (LORO) cross-validation (CV) was used to validate the results. Our proposed TreePat23 model has attained classification accuracy of 89.68% and 89.75% with kNN and SVM, respectively. Our developed system has generated 14 results for each classifier and automatically selected the best result. Hence this model is a self-organized audio classification model which yielded over 89% classification accuracy for both classifiers using LORO CV strategy.

Gun identification from gunshot audios for secure public places using transformer learning

Enhancing Gun Detection With Transfer Learning and YAMNet Audio Classification

Sound of Guns: Digital Forensics of Gun Audio Samples meets Artificial Intelligence

Real Time Deep Learning Weapon Detection Techniques for Mitigating Lone Wolf Attacks

Automatic Detection Of Noise Events at Shooting Range Using Machine Learning

Video Vision Transformers for Violence Detection

A novel tree pattern-based violence detection model using audio signals

A wireless gunshot recognition system based on tri-axis accelerometer and lightweight deep learning

Gunshots Localization and Classification Model Based on Wind Noise Sensitivity Analysis Using Extreme Learning Machine

Integrating Artificial Intelligence and Deep Learning for the Purpose of Detecting Arms in Defense

Audio Transformers:Transformer Architectures For Large Scale Audio Understanding. Adieu Convolutions

Weapon Detection Using YOLO V3 for Smart Surveillance System

Research on Transformer Voiceprint Anomaly Detection Based on Data-Driven

Tiny Transformers for Environmental Sound Classification at the Edge

Transformer-Based Fire Detection in Videos

ANALYSIS OF WEAPON AND FIRE DETECTION ON DIFFERENT DATASETS IN ATMs

Large Scale Audio-Visual Video Analytics Platform for Forensic Investigations of Terroristic Attacks

Active shooter detection and robust tracking utilizing supplemental synthetic data

Novel Deep Learning Pipeline for Automatic Weapon Detection

Real-Time Weapon Detection Using YOLOv8 for Enhanced Safety

Firearm Detection and Segmentation Using an Ensemble of Semantic Neural Networks