Abstract:With the recent advance of deep learning, a large number of methods have been developed for prohibited item detection in X-ray security images. Generally, these methods train models on a single X-ray image dataset that may contain only limited categories of prohibited items. To detect more prohibited items, it is desirable to train a model on the multi-dataset that is constructed by combining multiple datasets. However, directly applying existing methods to the multi-dataset cannot guarantee good performance because of the large domain discrepancy between datasets and the occlusion in images. To address the above problems, we propose a novel Dual-Mode Learning Network (DML-Net) to effectively detect all the prohibited items in the multi-dataset. In particular, we develop an enhanced RetinaNet as the architecture of DML-Net, where we introduce a lattice appearance enhanced sub-net to enhance appearance representations. Such a way benefits the detection of occluded prohibited items. Based on the enhanced RetinaNet, the learning process of DML-Net involves both common mode learning (detecting the common prohibited items across datasets) and unique mode learning (detecting the unique prohibited items in each dataset). For common mode learning, we introduce an adversarial prototype alignment module to align the feature prototypes from different datasets in the domain-invariant feature space. For unique mode learning, we take advantage of feature distillation to enforce the student model to mimic the features extracted by multiple pre-trained teacher models. By tightly combining and jointly training the dual modes, our DML-Net method successfully eliminates the domain discrepancy and exhibits superior model capacity on the multi-dataset. Extensive experimental results on several combined X-ray image datasets demonstrate the effectiveness of our method against several state-of-the-art methods. Our code is available at https://github.com/vampirename/dmlnet.

Multi-Target Prohibited Item Recognition Algorithm for X-Ray Security Scene

Prohibited item detection within X-ray security inspection images based on an improved cascade network

Attention‐based prohibited item detection in X‐ray images during security checking

Multi-objects Real Time Recognition Based on Color Information

Prohibited Items Detection in X-ray Images Based on Task Decoupling YOLOv5

Multi-Object Detection in Security Screening Scene Based on Convolutional Neural Network

Combination of Deep Learning with Representation Learning in X-ray Prohibited Item Detection

An Enhanced Prohibited Items Recognition Model

Towards Real-world X-ray Security Inspection: A High-Quality Benchmark and Lateral Inhibition Module for Prohibited Items Detection

A GAN based method for multiple prohibited items synthesis of X-ray security image

FDTNet: Enhancing frequency-aware representation for prohibited object detection from X-ray images via dual-stream transformers

Towards Real-World Prohibited Item Detection: A Large-Scale X-ray Benchmark

Dual-Mode Learning for Multi-Dataset X-Ray Security Image Detection

Contraband detection algorithm for X‐ray security inspection images based on global semantic enhancement

X-YOLO: An Efficient Detection Network of Dangerous Objects in X-Ray Baggage Images

Multi-Class 3D Object Detection Within Volumetric 3D Computed Tomography Baggage Security Screening Imagery

The Good, the Bad and the Ugly: Evaluating Convolutional Neural Networks for Prohibited Item Detection Using Real and Synthetically Composited X-ray Imagery

SIXray : A Large-scale Security Inspection X-ray Benchmark for Prohibited Item Discovery in Overlapping Images

A Few-Shot Segmentation Method for Prohibited Item Inspection

CTA-FPN: Channel-Target Attention Feature Pyramid Network for Prohibited Object Detection in X-ray Images

AO-DETR: Anti-Overlapping DETR for X-Ray Prohibited Items Detection