Abstract:Prohibited item detection is crucial for ensuring public safety, yet current X-ray image-based detection methods often lack comprehensive data-driven exploration. This paper introduces a novel data augmentation approach tailored for prohibited item detection, leveraging unique characteristics inherent to X-ray imagery. Our method is motivated by observations of physical properties including: 1) X-ray Transmission Imagery: Unlike reflected light images, transmitted X-ray pixels represent composite information from multiple materials along the imaging path. 2) Material-based Pseudo-coloring: Pseudo-color rendering in X-ray images correlates directly with material properties, aiding in material distinction. Building on a novel perspective from physical properties, we propose a simple yet effective X-ray image augmentation technique, Background Mixup (BGM), for prohibited item detection in security screening contexts. The essence is the rich background simulation of X-ray images to induce the model to increase its attention to the foreground. The approach introduces 1) contour information of baggage and 2) variation of material information into the original image by Mixup at patch level. Background Mixup is plug-and-play, parameter-free, highly generalizable and provides an effective solution to the limitations of classical visual augmentations in non-reflected light imagery. When implemented with different high-performance detectors, our augmentation method consistently boosts performance across diverse X-ray datasets from various devices and environments. Extensive experimental results demonstrate that our approach surpasses strong baselines while maintaining similar training resources.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that when detecting contraband items in X - ray security inspection images, the existing methods lack a comprehensive data - driven exploration. Specifically, the existing detection methods based on X - ray images fail to fully utilize the unique physical characteristics of X - ray images when dealing with data augmentation, resulting in limited improvement in model performance. ### Main problems: 1. **Small dataset scale**: Due to privacy policies and the limitations of X - ray imaging systems, the publicly available X - ray image datasets are far smaller than natural image datasets. 2. **Difficult to label**: Labeling contraband items in X - ray images requires professionals because the pixels in these images represent the composite information of multiple materials along the imaging path, rather than a single object. 3. **Traditional data augmentation methods are not applicable**: Traditional data augmentation methods (such as Mixup, Random Erasing, etc.) do not work well on X - ray images because these methods do not take into account the unique characteristics of X - ray images, such as transmission imaging and pseudo - color rendering. ### Solutions proposed in the paper: To address the above challenges, the paper proposes a new data augmentation method - **Background Mixup (BGM)**, which is specifically designed for the characteristics of X - ray security inspection images. BGM improves the model's attention to foreground targets by simulating rich background information, thereby enhancing the detection performance. ### Specific methods: 1. **Self Patch Mixup (SPM)**: Operates at the contour level, randomly selects background patches and places them globally, and introduces transparency in local Mixup operations to enrich the background information. 2. **Color Patch Mixup (CPM)**: Operates at the material level, randomly selects patches with random colors, and introduces transparency in local Mixup operations to simulate material changes. ### Experimental results: Experiments show that the BGM method significantly improves the performance of different detection models on multiple X - ray datasets, especially in complex occlusions and cluttered backgrounds. For example, on the PIDray dataset, the DINO detector using ResNet - 50 as the backbone network, the mAP is increased from 68.4% to 70.1%, with an overall performance improvement of 1.7%. ### Summary: By introducing the BGM method, the paper solves the problem of insufficient data augmentation in the existing X - ray image detection methods and provides a simple and effective solution that can significantly improve the performance of the detection model.

BGM: Background Mixup for X-ray Prohibited Items Detection

A Physics-Driven X-Ray Image Data Augmentation Method for Automated Threat Detection in Nuclear Facility Entrancement

The Good, the Bad and the Ugly: Evaluating Convolutional Neural Networks for Prohibited Item Detection Using Real and Synthetically Composited X-ray Imagery

On the impact of using X-ray energy response imagery for object detection via Convolutional Neural Networks

Towards Real-world X-ray Security Inspection: A High-Quality Benchmark and Lateral Inhibition Module for Prohibited Items Detection

<i>X</i>-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detection

Prohibited item detection within X-ray security inspection images based on an improved cascade network

Background-Mixed Augmentation for Weakly Supervised Change Detection

SIXray : A Large-scale Security Inspection X-ray Benchmark for Prohibited Item Discovery in Overlapping Images

Multi-Class 3D Object Detection Within Volumetric 3D Computed Tomography Baggage Security Screening Imagery

Detecting prohibited objects with physical size constraint from cluttered X-ray baggage images

Illicit item detection in X-ray images for security applications

Dual-Level Boost Network for Long-Tail Prohibited Items Detection in X-ray Security Inspection

EBL: Efficient Background Learning for X-Ray Security Inspection

EM-YOLO: An X-ray Prohibited-Item-Detection Method Based on Edge and Material Information Fusion

Research on Data Augmentation for Object Detection Based on X- ray Security Inspection Picture

Detection of threat objects in baggage inspection with X-ray images using deep learning

Contraband detection algorithm for X‐ray security inspection images based on global semantic enhancement

Generative adversarial networks and faster-region convolutional neural networks based object detection in X-ray baggage security imagery

Towards to Human Intention: A few-shot open-set object detection for X-ray hazard inspection

Lightweight Detection Method for X-ray Security Inspection with Occlusion