Abstract:The problem of detecting dangerous or prohibited objects in luggage is a very important step during the implementation of Security setup at Airports, Banks, Government buildings, etc. At present, the most common techniques for detecting such dangerous objects are by using intelligent data analysis algorithms such as deep learning techniques on X-ray imaging or employing a human workforce for inferring the presence of these threat objects in the obtained X-ray images. One of the major challenges while using deep-learning methods to detect such objects is the lack of high-quality threat image data containing the "dangerous" objects (objects of interest) versus the non-threat image data in practical scenarios. So, to tackle this data scarcity problem, anomaly detection techniques using normal data samples have shown great promise. Also, among the available Deep Learning Strategies for anomaly detection for computer vision applications, generative adversarial networks have achieved state-of-the-art results. Considering these insights, we adopted a newly proposed architecture known as Skip-GANomaly and devised a modified version of it by using a UNet++ style generator which performed better than Skip-GANomaly, getting an AUC of 94.94% on Compass-XP, a public X-ray dataset. Finally, for targeting better latent space exploration, we combine these two architectures into an Ensemble, which gives another boost to the performance, getting an AUC of 96.8% on the same Compass-XP, a public X-ray dataset. To further validate the effectiveness of ensemble-based architecture, its performance was tested on patch-based training data on a subset of randomly chosen images of another huge public X-ray dataset named as SIXray, and obtained an AUC of 75.3% on this reduced dataset. To demonstrate the prowess of the discriminator and to bring some explainability to the working of our ensemble, we have used Uniform Manifold Approximation and Projection to plot the latent-space vectors for the dangerous and non-dangerous objects of the test-set; this analysis indicates that the Ensemble learns better features for separating the anomalous class from non-anomalous with respect to the individual architectures. Thus, our proposed architecture provides state-of-the-art results for threat object detection. Most importantly, our models are able to detect threat objects without ever being trained on images containing threat objects.

Generative adversarial networks and faster-region convolutional neural networks based object detection in X-ray baggage security imagery

Automatic and Robust Object Detection in X-Ray Baggage Inspection Using Deep Convolutional Neural Networks

Evaluating GAN-Based Image Augmentation for Threat Detection in Large-Scale Xray Security Images

A GAN based method for multiple prohibited items synthesis of X-ray security image

Background Adaptive Faster R-CNN for Semi-Supervised Convolutional Object Detection of Threats in X-Ray Images

X-YOLO: An Efficient Detection Network of Dangerous Objects in X-Ray Baggage Images

Threat Object-based anomaly detection in X-ray images using GAN-based ensembles

The Good, the Bad and the Ugly: Evaluating Convolutional Neural Networks for Prohibited Item Detection Using Real and Synthetically Composited X-ray Imagery

Detection of threat objects in baggage inspection with X-ray images using deep learning

On the impact of using X-ray energy response imagery for object detection via Convolutional Neural Networks

Multi-Class 3D Object Detection Within Volumetric 3D Computed Tomography Baggage Security Screening Imagery

ABTD-Net: Autonomous Baggage Threat Detection Networks for X-ray Images.

X-ray Security Image Recognition System Based on Deep Learning

Detecting Anomalies using Generative Adversarial Networks on Images

On Using XMC R-CNN Model for Contraband Detection within X-Ray Baggage Security Images

Illicit item detection in X-ray images for security applications

Multi-Object Detection in Security Screening Scene Based on Convolutional Neural Network

An automated detection model of threat objects for X-Ray baggage inspection based on modified encoder-decoder model

On the Evaluation of Prohibited Item Classification and Detection in Volumetric 3D Computed Tomography Baggage Security Screening Imagery

A Physics-Driven X-Ray Image Data Augmentation Method for Automated Threat Detection in Nuclear Facility Entrancement

Object Detection and X-Ray Security Imaging: A Survey