Abstract:In the field of security, baggage-screening with X-rays is used as nondestructive testing for threat object detection. This is a common protocol when inspecting passenger baggage particularly at airports. Unfortunately, the accuracy of such human inspection is around 80–90%, under optimal operator conditions. For this reason, it is quite necessary to assist human inspectors with the aid of computer vision algorithms. This work proposes a deep learning-based methodology designed to detect threat objects in (single spectrum) X-ray baggage scan images. For this purpose, our proposed framework simulates a large number of X-ray images, using a combination of PGGAN (Karras et al. in International conference on learning representations, 2018. https://openreview.net/forum?id=Hk99zCeAb) and superimposition (Mery and Katsaggelos in 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), 2017.https://doi.org/10.1109/CVPRW.2017.37) strategies, that are used to train state-of-the-art detection models such as YOLO (Redmon et al. in You only look once: unified, real-time object detection. CoRR abs/1506.02640, 2015. http://arxiv.org/ abs/1506.02640), SSD (Liu et al. in SSD: single shot multibox detector. CoRR abs/1512.02325, 2015. http://arxiv. org/abs/1512.02325) and RetinaNet (Lin et al. in Focal loss for dense object detection. CoRR abs/1708.02002, 2017. http://arxiv.org/abs/1708.02002). Our method has been tested on real X-ray images in the detection of four categories of threat objects: guns, knives, razor blades and shuriken (ninja stars). In our experiments, YOLOv3 (Redmon and Farhadi in Yolov3: An incremental improvement. CoRR abs/1804.02767, 2018. http://arxiv.org/abs/1804.02767) obtained the best mean average precision (mAP) with 96.3% for guns, 76.2% for knives, 86.9% for razor blades and 93.7% for shuriken, while the average mAP for all threat objects was 80.0%. We believe the effectiveness of our method in the detection of threat objects makes its use in checkpoints possible. Moreover, our methodology is scalable and can be easily extended to detect other categories automatically.

Automated Baggage Size Check: Real-Time Object Measurement Using Aruco Markers in OpenCV

Detection of threat objects in baggage inspection with X-ray images using deep learning

Target Detection and Recognition for Wide Area Border Defense Intelligent Surveillance.

Enhancing Border Security and Countering Terrorism Through Computer Vision: a Field of Artificial Intelligence

Optimization of Image Recognition System for Civil Aviation Baggage Security Inspection Based on Artificial Intelligence

Detecting Electric Devices in 3D Images of Bags

Towards In-baggage Suspicious Object Detection Using Commodity WiFi

A Searching Space Constrained Partial to Full Registration Approach With Applications in Airport Trolley Deployment Robot

Toward Human-in-the-Loop Prohibited Item Detection in X-ray Baggage Images

Real-Time Deep Learning Method for Abandoned Luggage Detection in Video

Trainable Structure Tensors for Autonomous Baggage Threat Detection Under Extreme Occlusion

Automated detection of inorganic powders in X-ray images of airport luggage

AI-Assisted Drone Localization of Arbitrary Objects using Aruco Markers

Multi-Scale Hierarchical Contour Framework for Detecting Cluttered Threats in Baggage Security

Real-time Cargo Loading Identification Based on Self-powered Camera

A computer vision framework using Convolutional Neural Networks for airport-airside surveillance

Vision-based Conflict Detection within Crowds based on High-Resolution Human Pose Estimation for Smart and Safe Airport

Security Fence Inspection at Airports Using Object Detection

Comparative Study of Supervised Machine Learning Color-Based Segmentation for Object Detection in X-Ray Baggage Images for Intelligent Transportation Systems

Monocular Visual Measurement Based on Marking Points Regression and Semantic Information

Robust Baggage Detection and Classification Based on Local Tri-directional Pattern