Abstract:Security inspection is X-ray scanning for personal belongings in suitcases, which is significantly important for the public security but highly time-consuming for human inspectors. Fortunately, deep learning has greatly promoted the development of computer vision, offering a possible way of automatic security inspection. However, items within a luggage are randomly overlapped resulting in noisy X-ray images with heavy occlusions. Thus, traditional CNN-based models trained through common image recognition datasets fail to achieve satisfactory performance in this scenario. To address these problems, we contribute the first high-quality prohibited X-ray object detection dataset named OPIXray, which contains 8885 X-ray images from 5 categories of the widely-occurred prohibited item ``cutters''. The images are gathered from an airport and these prohibited items are annotated manually by professional inspectors, which can be used as a benchmark for model training and further facilitate future research. To better improve occluded X-ray object detection, we further propose an over-sampling de-occlusion attention network (DOAM-O), which consists of a novel de-occlusion attention module and a new over-sampling training strategy. Specifically, our de-occlusion module, namely DOAM, simultaneously leverages the different appearance information of the prohibited items; the over-sampling training strategy forces the model to put more emphasis on these hard samples consisting these items of high occlusion levels, which is more suitable for this scenario. We comprehensively evaluated DOAM-O on the OPIXray dataset, which proves that our model can stably improve the performance of the famous detection models such as SSD, YOLOv3, and FCOS, and outperform many extensively-used attention mechanisms.

AO-DETR: Anti-Overlapping DETR for X-Ray Prohibited Items Detection

Over-sampling De-occlusion Attention Network for Prohibited Items Detection in Noisy X-ray Images

Combination of Deep Learning with Representation Learning in X-ray Prohibited Item Detection

Towards to Human Intention: A few-shot open-set object detection for X-ray hazard inspection

FDTNet: Enhancing frequency-aware representation for prohibited object detection from X-ray images via dual-stream transformers

Multi-Target Prohibited Item Recognition Algorithm for X-Ray Security Scene

MMCL: Boosting Deformable DETR-Based Detectors with Multi-Class Min-Margin Contrastive Learning for Superior Prohibited Item Detection

Open-Vocabulary X-ray Prohibited Item Detection via Fine-tuning CLIP

DETR-ORD: An Improved DETR Detector for Oriented Remote Sensing Object Detection with Feature Reconstruction and Dynamic Query

Towards Real-world X-ray Security Inspection: A High-Quality Benchmark and Lateral Inhibition Module for Prohibited Items Detection

D2Q-DETR: Decoupling and Dynamic Queries for Oriented Object Detection with Transformers

DQ-DETR: DETR with Dynamic Query for Tiny Object Detection

Prohibited item detection within X-ray security inspection images based on an improved cascade network

DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection

Rank-DETR for High Quality Object Detection

Towards Real-World Prohibited Item Detection: A Large-Scale X-ray Benchmark

Lightweight Detection Method for X-ray Security Inspection with Occlusion

Detecting Overlapped Objects in X-Ray Security Imagery by a Label-Aware Mechanism

DPDETR: Decoupled Position Detection Transformer for Infrared-Visible Object Detection

Detecting prohibited objects with physical size constraint from cluttered X-ray baggage images