Abstract:In the field of security, baggage-screening with X-rays is used as nondestructive testing for threat object detection. This is a common protocol when inspecting passenger baggage particularly at airports. Unfortunately, the accuracy of such human inspection is around 80–90%, under optimal operator conditions. For this reason, it is quite necessary to assist human inspectors with the aid of computer vision algorithms. This work proposes a deep learning-based methodology designed to detect threat objects in (single spectrum) X-ray baggage scan images. For this purpose, our proposed framework simulates a large number of X-ray images, using a combination of PGGAN (Karras et al. in International conference on learning representations, 2018. https://openreview.net/forum?id=Hk99zCeAb) and superimposition (Mery and Katsaggelos in 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), 2017.https://doi.org/10.1109/CVPRW.2017.37) strategies, that are used to train state-of-the-art detection models such as YOLO (Redmon et al. in You only look once: unified, real-time object detection. CoRR abs/1506.02640, 2015. http://arxiv.org/ abs/1506.02640), SSD (Liu et al. in SSD: single shot multibox detector. CoRR abs/1512.02325, 2015. http://arxiv. org/abs/1512.02325) and RetinaNet (Lin et al. in Focal loss for dense object detection. CoRR abs/1708.02002, 2017. http://arxiv.org/abs/1708.02002). Our method has been tested on real X-ray images in the detection of four categories of threat objects: guns, knives, razor blades and shuriken (ninja stars). In our experiments, YOLOv3 (Redmon and Farhadi in Yolov3: An incremental improvement. CoRR abs/1804.02767, 2018. http://arxiv.org/abs/1804.02767) obtained the best mean average precision (mAP) with 96.3% for guns, 76.2% for knives, 86.9% for razor blades and 93.7% for shuriken, while the average mAP for all threat objects was 80.0%. We believe the effectiveness of our method in the detection of threat objects makes its use in checkpoints possible. Moreover, our methodology is scalable and can be easily extended to detect other categories automatically.

Invaders Detection for Surveillance Video of Airport Luggage Delivery

Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

Detecting Insecure Person in Crowd with Human Sensor

Human Detection Based on Head and Shoulder Feature in Intelligent Surveillance System

Video Based Head Detection and Tracking Surveillance System

Target Detection and Recognition for Wide Area Border Defense Intelligent Surveillance.

Abandoned Luggage Detection Method Based on Multi-Layer Codebook Model

Real-Time Deep Learning Method for Abandoned Luggage Detection in Video

Detection of threat objects in baggage inspection with X-ray images using deep learning

Detection Algorithm of Unattended Package in Surveillance Sequence Based on Spatial-Temporal Accumulative Frame Difference Pictures

Comparative Study of Supervised Machine Learning Color-Based Segmentation for Object Detection in X-Ray Baggage Images for Intelligent Transportation Systems

Security Event Recognition for Visual Surveillance

Synergistic Monitoring System Via LiDAR and Visual Sensors for Detecting Wildlife Intrusion

A railway intrusion detection method based on decomposition and semi-supervised learning for accident protection

Railway Intrusion Detection Based on Refined Spatial and Temporal Features for UAV Surveillance Scene

Detecting Electric Devices in 3D Images of Bags

Robust Baggage Detection and Classification Based on Local Tri-directional Pattern

A New Network-Based Intelligent Surveillance System

Trainable Structure Tensors for Autonomous Baggage Threat Detection Under Extreme Occlusion

Intelligent Video Analysis Technology of Public Security Standard Sets of Data and Measurements

Foreign object recognition technology for port transportation channel based on automatic image recognition