A Computational Trust Model for Semantic Web Based on Bayesian Decision Theory

Xiaoqing Zheng,Huajun Chen,Zhaohui Wu,Yu Zhang

DOI: https://doi.org/10.1007/11610113_68

2006-01-16

Abstract:

What problem does this paper attempt to address?

A Dataset and System for Real-Time Gun Detection in Surveillance Video Using Deep Learning

Delong Qi,Weijun Tan,Zhifu Liu,Qi Yao,Jingfeng Liu

DOI: https://doi.org/10.1109/smc52423.2021.9659207

2021-10-17

Abstract:Gun violence is a severe problem in the world, particularly in the United States. Deep learning methods have been studied to detect guns in surveillance video cameras or smart IP cameras and to send a real-time alert to security personals. One problem for the development of gun detection algorithms is the lack of large public datasets. In this work, we first publish a dataset with 51K annotated gun images for gun detection and other 51K cropped gun chip images for gun classification we collect from a few different sources. To our knowledge, this is the largest dataset for the study of gun detection. This dataset can be downloaded at www.linksprite.com/gundetection-datasets. We present a gun detection system using a smart IP camera as an embedded edge device and a cloud server as a manager for device, data, alert, and to further reduce the false positive rate. We study to find solutions for gun detection in an embedded device and for gun classification on the edge device and the cloud server. This edge/cloud framework makes the deployment of gun detection in the real world possible.
CCTV-Gun: Benchmarking Handgun Detection in CCTV Images

Srikar Yellapragada,Zhenghong Li,Kevin Bhadresh Doshi,Purva Makarand Mhasakar,Heng Fan,Jie Wei,Erik Blasch,Bin Zhang,Haibin Ling

2023-07-11

Abstract:Gun violence is a critical security problem, and it is imperative for the computer vision community to develop effective gun detection algorithms for real-world scenarios, particularly in Closed Circuit Television (CCTV) surveillance data. Despite significant progress in visual object detection, detecting guns in real-world CCTV images remains a challenging and under-explored task. Firearms, especially handguns, are typically very small in size, non-salient in appearance, and often severely occluded or indistinguishable from other small objects. Additionally, the lack of principled benchmarks and difficulty collecting relevant datasets further hinder algorithmic development. In this paper, we present a meticulously crafted and annotated benchmark, called \textbf{CCTV-Gun}, which addresses the challenges of detecting handguns in real-world CCTV images. Our contribution is three-fold. Firstly, we carefully select and analyze real-world CCTV images from three datasets, manually annotate handguns and their holders, and assign each image with relevant challenge factors such as blur and occlusion. Secondly, we propose a new cross-dataset evaluation protocol in addition to the standard intra-dataset protocol, which is vital for gun detection in practical settings. Finally, we comprehensively evaluate both classical and state-of-the-art object detection algorithms, providing an in-depth analysis of their generalizing abilities. The benchmark will facilitate further research and development on this topic and ultimately enhance security. Code, annotations, and trained models are available at <a class="link-external link-https" href="https://github.com/srikarym/CCTV-Gun" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
YouTube-GDD: A challenging gun detection dataset with rich contextual information

Yongxiang Gu,Xingbin Liao,Xiaolin Qin

DOI: https://doi.org/10.48550/arXiv.2203.04129

2022-03-08

Computer Vision and Pattern Recognition

Abstract:An automatic gun detection system can detect potential gun-related violence at an early stage that is of paramount importance for citizens security. In the whole system, object detection algorithm is the key to perceive the environment so that the system can detect dangerous objects such as pistols and rifles. However, mainstream deep learning-based object detection algorithms depend heavily on large-scale high-quality annotated samples, and the existing gun datasets are characterized by low resolution, little contextual information and little data volume. To promote the development of security, this work presents a new challenging dataset called YouTube Gun Detection Dataset (YouTube-GDD). Our dataset is collected from 343 high-definition YouTube videos and contains 5000 well-chosen images, in which 16064 instances of gun and 9046 instances of person are annotated. Compared to other datasets, YouTube-GDD is "dynamic", containing rich contextual information and recording shape changes of the gun during shooting. To build a baseline for gun detection, we evaluate YOLOv5 on YouTube-GDD and analyze the influence of additional related annotated information on gun detection. YouTube-GDD and subsequent updates will be released at https://github.com/UCAS-GYX/YouTube-GDD.
Weapon Detection Using YOLO V3 for Smart Surveillance System

Sanam Narejo,Bishwajeet Pandey,Doris Esenarro vargas,Ciro Rodriguez,M. Rizwan Anjum

DOI: https://doi.org/10.1155/2021/9975700

IF: 1.43

2021-05-11

Mathematical Problems in Engineering

Abstract:Every year, a large amount of population reconciles gun-related violence all over the world. In this work, we develop a computer-based fully automated system to identify basic armaments, particularly handguns and rifles. Recent work in the field of deep learning and transfer learning has demonstrated significant progress in the areas of object detection and recognition. We have implemented YOLO V3 “You Only Look Once” object detection model by training it on our customized dataset. The training results confirm that YOLO V3 outperforms YOLO V2 and traditional convolutional neural network (CNN). Additionally, intensive GPUs or high computation resources were not required in our approach as we used transfer learning for training our model. Applying this model in our surveillance system, we can attempt to save human life and accomplish reduction in the rate of manslaughter or mass killing. Additionally, our proposed system can also be implemented in high-end surveillance and security robots to detect a weapon or unsafe assets to avoid any kind of assault or risk to human life.

engineering, multidisciplinary,mathematics, interdisciplinary applications
Weapon Violence Dataset 2.0: A synthetic dataset for violence detection

Muhammad Shahroz Nadeem,Fatih Kurugollu,Hany F Atlam,Virginia N L Franqueira

DOI: https://doi.org/10.1016/j.dib.2024.110448

2024-04-20

Abstract:In the current era, satisfying the appetite of data hungry models is becoming an increasingly challenging task. This challenge is particularly magnified in research areas characterised by sensitivity, where the quest for genuine data proves to be elusive. The study of violence serves as a poignant example, entailing ethical considerations and compounded by the scarcity of authentic, real-world data that is predominantly accessible only to law enforcement agencies. Existing datasets in this field often resort to using content from movies or open-source video platforms like YouTube, further emphasising the scarcity of authentic data. To address this, our dataset aims to pioneer a new approach by creating the first synthetic virtual dataset for violence detection, named the Weapon Violence Dataset (WVD). The dataset is generated by creating virtual violence scenarios inside the photo-realistic video game namely: Grand Theft Auto-V (GTA-V). This dataset includes carefully selected video clips of person-to-person fights captured from a frontal view, featuring various weapons-both hot and cold across different times of the day. Specifically, WVD contains three categories: Hot violence and Cold violence (representing the violence category) as well as No violence (constituting the control class). The dataset is designed and created in a way that will enable the research community to train deep models on such synthetic data with the ability to increase the data corpus if the needs arise. The dataset is publicly available on Kaggle and comprises normal RGB and optic flow videos.
Handgun Detection Using Combined Human Pose and Weapon Appearance

Jesus Ruiz-Santaquiteria,Alberto Velasco-Mata,Noelia Vallez,Gloria Bueno,Juan A. Álvarez-García,Oscar Deniz,Juan A. Alvarez-Garcia

DOI: https://doi.org/10.1109/access.2021.3110335

IF: 3.9

2021-01-01

IEEE Access

Abstract:Closed-circuit television (CCTV) systems are essential nowadays to prevent security threats or dangerous situations, in which early detection is crucial. Novel deep learning-based methods have allowed to develop automatic weapon detectors with promising results. However, these approaches are mainly based on visual weapon appearance only. For handguns, body pose may be a useful cue, especially in cases where the gun is barely visible. In this work, a novel method is proposed to combine, in a single architecture, both weapon appearance and human pose information. First, pose keypoints are estimated to extract hand regions and generate binary pose images, which are the model inputs. Then, each input is processed in different subnetworks and combined to produce the handgun bounding box. Results obtained show that the combined model improves the handgun detection state of the art, achieving from 4.23 to 18.9 AP points more than the best previous approach.

computer science, information systems,telecommunications,engineering, electrical & electronic
Detection and Localization of Firearm Carriers in Complex Scenes for Improved Safety Measures

Arif Mahmood,Abdul Basit,M. Akhtar Munir,Mohsen Ali

DOI: https://doi.org/10.48550/arXiv.2309.09236

2023-09-17

Abstract:Detecting firearms and accurately localizing individuals carrying them in images or videos is of paramount importance in security, surveillance, and content customization. However, this task presents significant challenges in complex environments due to clutter and the diverse shapes of firearms. To address this problem, we propose a novel approach that leverages human-firearm interaction information, which provides valuable clues for localizing firearm carriers. Our approach incorporates an attention mechanism that effectively distinguishes humans and firearms from the background by focusing on relevant areas. Additionally, we introduce a saliency-driven locality-preserving constraint to learn essential features while preserving foreground information in the input image. By combining these components, our approach achieves exceptional results on a newly proposed dataset. To handle inputs of varying sizes, we pass paired human-firearm instances with attention masks as channels through a deep network for feature computation, utilizing an adaptive average pooling layer. We extensively evaluate our approach against existing methods in human-object interaction detection and achieve significant results (AP=77.8\%) compared to the baseline approach (AP=63.1\%). This demonstrates the effectiveness of leveraging attention mechanisms and saliency-driven locality preservation for accurate human-firearm interaction detection. Our findings contribute to advancing the fields of security and surveillance, enabling more efficient firearm localization and identification in diverse scenarios.

Computer Vision and Pattern Recognition,Artificial Intelligence,Computers and Society,Machine Learning
Conditioned Cooperative training for semi-supervised weapon detection

Jose L Salazar González,Juan A Álvarez-García,Fernando J Rendón-Segador,Fabio Carrara

DOI: https://doi.org/10.1016/j.neunet.2023.08.043

Abstract:Violent assaults and homicides occur daily, and the number of victims of mass shootings increases every year. However, this number can be reduced with the help of Closed Circuit Television (CCTV) and weapon detection models, as generic object detectors have become increasingly accurate with more data for training. We present a new semi-supervised learning methodology based on conditioned cooperative student-teacher training with optimal pseudo-label generation using a novel confidence threshold search method and improving both models by conditional knowledge transfer. Furthermore, a novel firearms image dataset of 458,599 images was collected using Instagram hashtags to evaluate our approach and compare the improvements obtained using a specific unsupervised dataset instead of a general one such as ImageNet. We compared our methodology with supervised, semi-supervised and self-supervised learning techniques, outperforming approaches such as YOLOv5 m (up to ＋19.86), YOLOv5l (up to ＋6.52) Unbiased Teacher (up to ＋10.5 AP), DETReg (up to ＋2.8 AP) and UP-DETR (up to ＋1.22 AP).
Orientation aware weapons detection in visual data: a benchmark dataset

N. U. Haq,M. M. Fraz,T. S. Hashmi,M. Shahzad

DOI: https://doi.org/10.1007/s00607-022-01095-0

2022-06-28

Computing (Vienna/New York)

Abstract:Automatic detection of weapons is significant for improving security and well being of individuals, nonetheless, it is a difficult task due to large variety of size, shape and appearance of weapons. View point variations and occlusion also are reasons which makes this task more difficult. Further, the current object detection algorithms process rectangular areas, however a slender and long rifle may really cover just a little portion of area and the rest may contain unessential details. To overcome these problem, we propose a CNN architecture for Orientation Aware Weapons Detection, which provides oriented bounding box with improved weapons detection performance. The proposed model provides orientation not only using angle as classification problem by dividing angle into eight classes but also angle as regression problem. For training our model for weapon detection a new dataset comprising of total 7801 weapons images is gathered from the web and then manually annotated with position oriented bounding boxes. Our dataset provides not only oriented bounding box as ground truth but also horizontal bounding box. We also provide our dataset in multiple formats of modern object detectors for further research in this area. The proposed model is evaluated on this dataset, and the comparative analysis with off-the shelf object detectors yields superior performance of proposed model, measured with standard evaluation strategies. The dataset and the model implementation are made publicly available at this link: https://bit.ly/2TyZICF.
Distributed Intelligent Video Surveillance for Early Armed Robbery Detection based on Deep Learning

Sergio Fernandez-Testa,Edwin Salcedo

2024-10-13

Abstract:Low employment rates in Latin America have contributed to a substantial rise in crime, prompting the emergence of new criminal tactics. For instance, "express robbery" has become a common crime committed by armed thieves, in which they drive motorcycles and assault people in public in a matter of seconds. Recent research has approached the problem by embedding weapon detectors in surveillance cameras; however, these systems are prone to false positives if no counterpart confirms the event. In light of this, we present a distributed IoT system that integrates a computer vision pipeline and object detection capabilities into multiple end-devices, constantly monitoring for the presence of firearms and sharp weapons. Once a weapon is detected, the end-device sends a series of frames to a cloud server that implements a 3DCNN to classify the scene as either a robbery or a normal situation, thus minimizing false positives. The deep learning process to train and deploy weapon detection models uses a custom dataset with 16,799 images of firearms and sharp weapons. The best-performing model, YOLOv5s, optimized using TensorRT, achieved a final mAP of 0.87 running at 4.43 FPS. Additionally, the 3DCNN demonstrated 0.88 accuracy in detecting abnormal situations. Extensive experiments validate that the proposed system significantly reduces false positives while autonomously monitoring multiple locations in real-time.

Computer Vision and Pattern Recognition
Integrating Artificial Intelligence and Deep Learning for the Purpose of Detecting Arms in Defense

Seelam SKML Sandhya

DOI: https://doi.org/10.22214/ijraset.2023.57542

2023-12-31

International Journal for Research in Applied Science and Engineering Technology

Abstract:Abstract: There has been an increase in the relevance of security as a primary issue across all sectors as a result of the prominence of criminal activities that take place at public events or in settings that seem to be distant. It is important to note that computer vision plays a vital role in the fields of anomaly detection and monitoring. It provides a broad range of applications that may be used to handle a variety of issues. The technology of computer vision is used in several applications. An essential component of the intelligence monitoring process is the use of video surveillance systems that are equipped with the capacity to identify and assess the surrounding environment, in addition to identifying and analysing unexpected events. The explanation for this occurrence is that there is a rising need to protect personal assets, and there is also an increased focus on ensuring that there is an increased degree of safety and security. This study makes use of a Yolo algorithm in order to effectively accomplish the goal of automating the identification of guns and other types of weapons. The method that is being presented involves the use of two distinct types of datasets. The first dataset is made up of images that have already been classified, whereas the second dataset is made up of photographs that have been manually labelled. The use of these datasets is available to the public. Despite the fact that the laborious tabulation of data is carried out with accuracy, the actual use of these findings in real-world circumstances may be contingent on the delicate balance that is established between speed and precision.
Leveraging Orientation for Weakly Supervised Object Detection with Application to Firearm Localization

Javed Iqbal,Muhammad Akhtar Munir,Arif Mahmood,Afsheen Rafaqat Ali,Mohsen Ali

DOI: https://doi.org/10.48550/arXiv.1904.10032

2021-01-30

Abstract:Automatic detection of firearms is important for enhancing the security and safety of people, however, it is a challenging task owing to the wide variations in shape, size, and appearance of firearms. Also, most of the generic object detectors process axis-aligned rectangular areas though, a thin and long rifle may actually cover only a small percentage of that area and the rest may contain irrelevant details suppressing the required object signatures. To handle these challenges, we propose a weakly supervised Orientation Aware Object Detection (OAOD) algorithm which learns to detect oriented object bounding boxes (OBB) while using AxisAligned Bounding Boxes (AABB) for training. The proposed OAOD is different from the existing oriented object detectors which strictly require OBB during training which may not always be present. The goal of training on AABB and detection of OBB is achieved by employing a multistage scheme, with Stage-1 predicting the AABB and Stage-2 predicting OBB. In-between the two stages, the oriented proposal generation module along with the object aligned RoI pooling is designed to extract features based on the predicted orientation and to make these features orientation invariant. A diverse and challenging dataset consisting of eleven thousand images is also proposed for firearm detection which is manually annotated for firearm classification and localization. The proposed ITU Firearm dataset (ITUF) contains a wide range of guns and rifles. The OAOD algorithm is evaluated on the ITUF dataset and compared with current state-of-the-art object detectors, including fully supervised oriented object detectors. OAOD has outperformed both types of object detectors with a significant margin. The experimental results (mAP: 88.3 on AABB & mAP: 77.5 on OBB) demonstrate the effectiveness of the proposed algorithm for firearm detection.

Computer Vision and Pattern Recognition
ANALYSIS OF WEAPON AND FIRE DETECTION ON DIFFERENT DATASETS IN ATMs

Aditya Vajpayee,Dhinakaran M,Aditya Toamar,Arpit Singh,Afzal Khan,

DOI: https://doi.org/10.33564/ijeast.2023.v08i02.012

2023-06-01

International Journal of Engineering Applied Sciences and Technology

Abstract:The special area of real-time objects moving according to monitoring methods is one of the soughtafter reasons for CNNs. This review work is pushed into the field of shooting firearms and pistols in areas covered by cameras. Domestic fire incidents, current impacts and fast-spreading fires are major problems with negative environmental impacts. Gun cruelty and mass shootings are also on the rise in obvious places on the planet. Such events are time-consuming and can be a monstrous test of life and property. The proposed work has now generated a meaningful learning model that enables the YOLOv3 computation to process video images by tuning to rationallyperceive those peculiarities and alert the experts. related. The latest model has an approval deficit of 0.2864, with a rendering rate of 45 edges per second, and has been compared with datasets such as IMFDB, UGR, and Fire Net with an accuracy of 90.3%, 83.6% and 85.5% independently.
Active Terahertz Imaging Dataset for Concealed Object Detection

Dong Liang,Fei Xue,Ling Li

DOI: https://doi.org/10.48550/arXiv.2105.03677

2021-05-08

Abstract:Concealed object detection in Terahertz imaging is an urgent need for public security and counter-terrorism. In this paper, we provide a public dataset for evaluating multi-object detection algorithms in active Terahertz imaging resolution 5 mm by 5 mm. To the best of our knowledge, this is the first public Terahertz imaging dataset prepared to evaluate object detection algorithms. Object detection on this dataset is much more difficult than on those standard public object detection datasets due to its inferior imaging quality. Facing the problem of imbalanced samples in object detection and hard training samples, we evaluate four popular detectors: YOLOv3, YOLOv4, FRCN-OHEM, and RetinaNet on this dataset. Experimental results indicate that the RetinaNet achieves the highest mAP. In addition, we demonstrate that hiding objects in different parts of the human body affect detection accuracy. The dataset is available at <a class="link-external link-https" href="https://github.com/LingLIx/THz_Dataset" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Drone-Action: An Outdoor Recorded Drone Video Dataset for Action Recognition

Asanka G. Perera,Yee Wei Law,Javaan Chahl

DOI: https://doi.org/10.3390/drones3040082

IF: 5.532

2019-11-28

Drones

Abstract:Aerial human action recognition is an emerging topic in drone applications. Commercial drone platforms capable of detecting basic human actions such as hand gestures have been developed. However, a limited number of aerial video datasets are available to support increased research into aerial human action analysis. Most of the datasets are confined to indoor scenes or object tracking and many outdoor datasets do not have sufficient human body details to apply state-of-the-art machine learning techniques. To fill this gap and enable research in wider application areas, we present an action recognition dataset recorded in an outdoor setting. A free flying drone was used to record 13 dynamic human actions. The dataset contains 240 high-definition video clips consisting of 66,919 frames. All of the videos were recorded from low-altitude and at low speed to capture the maximum human pose details with relatively high resolution. This dataset should be useful to many research areas, including action recognition, surveillance, situational awareness, and gait analysis. To test the dataset, we evaluated the dataset with a pose-based convolutional neural network (P-CNN) and high-level pose feature (HLPF) descriptors. The overall baseline action recognition accuracy calculated using P-CNN was 75.92%.
TYolov5: A Temporal Yolov5 Detector Based on Quasi-Recurrent Neural Networks for Real-Time Handgun Detection in Video

Mario Alberto Duran-Vega,Miguel Gonzalez-Mendoza,Leonardo Chang,Cuauhtemoc Daniel Suarez-Ramirez

DOI: https://doi.org/10.48550/arXiv.2111.08867

2021-11-19

Abstract:Timely handgun detection is a crucial problem to improve public safety; nevertheless, the effectiveness of many surveillance systems still depends of finite human attention. Much of the previous research on handgun detection is based on static image detectors, leaving aside valuable temporal information that could be used to improve object detection in videos. To improve the performance of surveillance systems, a real-time temporal handgun detection system should be built. Using Temporal Yolov5, an architecture based on Quasi-Recurrent Neural Networks, temporal information is extracted from video to improve the results of handgun detection. Moreover, two publicly available datasets are proposed, labeled with hands, guns, and phones. One containing 2199 static images to train static detectors, and another with 5960 frames of videos to train temporal modules. Additionally, we explore two temporal data augmentation techniques based on Mosaic and Mixup. The resulting systems are three temporal architectures: one focused in reducing inference with a mAP$_{50:95}$ of 55.9, another in having a good balance between inference and accuracy with a mAP$_{50:95}$ of 59, and a last one specialized in accuracy with a mAP$_{50:95}$ of 60.2. Temporal Yolov5 achieves real-time detection in the small and medium architectures. Moreover, it takes advantage of temporal features contained in videos to perform better than Yolov5 in our temporal dataset, making TYolov5 suitable for real-world applications. The source code is publicly available at <a class="link-external link-https" href="https://github.com/MarioDuran/TYolov5" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
A Multi-viewpoint Outdoor Dataset for Human Action Recognition

Asanka G. Perera,Yee Wei Law,Titilayo T. Ogunwa,Javaan Chahl

DOI: https://doi.org/10.48550/arXiv.2110.04119

2021-10-07

Computer Vision and Pattern Recognition

Abstract:Advancements in deep neural networks have contributed to near perfect results for many computer vision problems such as object recognition, face recognition and pose estimation. However, human action recognition is still far from human-level performance. Owing to the articulated nature of the human body, it is challenging to detect an action from multiple viewpoints, particularly from an aerial viewpoint. This is further compounded by a scarcity of datasets that cover multiple viewpoints of actions. To fill this gap and enable research in wider application areas, we present a multi-viewpoint outdoor action recognition dataset collected from YouTube and our own drone. The dataset consists of 20 dynamic human action classes, 2324 video clips and 503086 frames. All videos are cropped and resized to 720x720 without distorting the original aspect ratio of the human subjects in videos. This dataset should be useful to many research areas including action recognition, surveillance and situational awareness. We evaluated the dataset with a two-stream CNN architecture coupled with a recently proposed temporal pooling scheme called kernelized rank pooling that produces nonlinear feature subspace representations. The overall baseline action recognition accuracy is 74.0%.
Object Detection Binary Classifiers methodology based on deep learning to identify small objects handled similarly: Application in video surveillance

Francisco Pérez-Hernández,Siham Tabik,Alberto Lamas,Roberto Olmos,Hamido Fujita,Francisco Herrera

DOI: https://doi.org/10.1016/j.knosys.2020.105590

2020-04-01

Abstract:The capability of distinguishing between small objects when manipulated with hand is essential in many fields, especially in video surveillance. To date, the recognition of such objects in images using Convolutional Neural Networks (CNNs) remains a challenge. In this paper, we propose improving robustness, accuracy and reliability of the detection of small objects handled similarly using binarization techniques. We propose improving their detection in videos using a two level methodology based on deep learning, called Object Detection with Binary Classifiers. The first level selects the candidate regions from the input frame and the second level applies a binarization technique based on a CNN-classifier with One-Versus-All or One-Versus-One. In particular, we focus on the video surveillance problem of detecting weapons and objects that can be confused with a handgun or a knife when manipulated with hand. We create a database considering six objects: pistol, knife, smartphone, bill, purse and card. The experimental study shows that the proposed methodology reduces the number of false positives with respect to the baseline multi-class detection model.

computer science, artificial intelligence
Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challenges

Tongtong Yuan,Xuange Zhang,Kun Liu,Bo Liu,Chen Chen,Jian Jin,Zhenzhen Jiao

2023-12-04

Abstract:Surveillance videos are an essential component of daily life with various critical applications, particularly in public security. However, current surveillance video tasks mainly focus on classifying and localizing anomalous events. Existing methods are limited to detecting and classifying the predefined events with unsatisfactory semantic understanding, although they have obtained considerable performance. To address this issue, we propose a new research direction of surveillance video-and-language understanding, and construct the first multimodal surveillance video dataset. We manually annotate the real-world surveillance dataset UCF-Crime with fine-grained event content and timing. Our newly annotated dataset, UCA (UCF-Crime Annotation), contains 23,542 sentences, with an average length of 20 words, and its annotated videos are as long as 110.7 hours. Furthermore, we benchmark SOTA models for four multimodal tasks on this newly created dataset, which serve as new baselines for surveillance video-and-language understanding. Through our experiments, we find that mainstream models used in previously publicly available datasets perform poorly on surveillance video, which demonstrates the new challenges in surveillance video-and-language understanding. To validate the effectiveness of our UCA, we conducted experiments on multimodal anomaly detection. The results demonstrate that our multimodal surveillance learning can improve the performance of conventional anomaly detection tasks. All the experiments highlight the necessity of constructing this dataset to advance surveillance AI. The link to our dataset is provided at: <a class="link-external link-https" href="https://xuange923.github.io/Surveillance-Video-Understanding" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence

A Computational Trust Model for Semantic Web Based on Bayesian Decision Theory

A Dataset and System for Real-Time Gun Detection in Surveillance Video Using Deep Learning

CCTV-Gun: Benchmarking Handgun Detection in CCTV Images

YouTube-GDD: A challenging gun detection dataset with rich contextual information

Weapon Detection Using YOLO V3 for Smart Surveillance System

Weapon Violence Dataset 2.0: A synthetic dataset for violence detection

Handgun Detection Using Combined Human Pose and Weapon Appearance

Detection and Localization of Firearm Carriers in Complex Scenes for Improved Safety Measures

Conditioned Cooperative training for semi-supervised weapon detection

Orientation aware weapons detection in visual data: a benchmark dataset

Distributed Intelligent Video Surveillance for Early Armed Robbery Detection based on Deep Learning

Integrating Artificial Intelligence and Deep Learning for the Purpose of Detecting Arms in Defense

Leveraging Orientation for Weakly Supervised Object Detection with Application to Firearm Localization

ANALYSIS OF WEAPON AND FIRE DETECTION ON DIFFERENT DATASETS IN ATMs

Active Terahertz Imaging Dataset for Concealed Object Detection

Drone-Action: An Outdoor Recorded Drone Video Dataset for Action Recognition

TYolov5: A Temporal Yolov5 Detector Based on Quasi-Recurrent Neural Networks for Real-Time Handgun Detection in Video

A Multi-viewpoint Outdoor Dataset for Human Action Recognition

Object Detection Binary Classifiers methodology based on deep learning to identify small objects handled similarly: Application in video surveillance

Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challenges