Abstract:The authors use dilated convolutions of multi‐scale dilation rates to build a pyramid feature extraction structure and encapsulate the structure into self‐attention. The new attention module is called Multi‐Scale Feature Attention (MSFA). MSFA can fuse object size information into feature maps, alleviating the problems caused by the object size disparity in X‐ray pictures. A module for foreground sequence extraction is proposed. The module combines multi‐branch channel attention and self‐attention to extract important feature sequences in feature maps. These feature sequences as prior knowledge of object queries to avoid semantic gaps. To comprehensively evaluate the performance of Multi‐Scale Feature Attention‐DEtection TRansformer, experiments are conducted on two multi‐category X‐ray datasets. The experimental results show that the performance of the model achieves state‐of‐the‐art on both CLCXray and PIDray datasets. X‐ray security checks aim to detect contraband in luggage; however, the detection accuracy is hindered by the overlapping and significant size differences of objects in X‐ray images. To address these challenges, the authors introduce a novel network model named Multi‐Scale Feature Attention (MSFA)‐DEtection TRansformer (DETR). Firstly, the pyramid feature extraction structure is embedded into the self‐attention module, referred to as the MSFA. Leveraging the MSFA module, MSFA‐DETR extracts multi‐scale feature information and amalgamates them into high‐level semantic features. Subsequently, these features are synergised through attention mechanisms to capture correlations between global information and multi‐scale features. MSFA significantly bolsters the model's robustness across different sizes, thereby enhancing detection accuracy. Simultaneously, A new initialisation method for object queries is proposed. The authors' foreground sequence extraction (FSE) module extracts key feature sequences from feature maps, serving as prior knowledge for object queries. FSE expedites the convergence of the DETR model and elevates detection accuracy. Extensive experimentation validates that this proposed model surpasses state‐of‐the‐art methods on the CLCXray and PIDray datasets.

X-ray security check image recognition based on attention mechanism

Object Detection and X-Ray Security Imaging: A Survey

A Lightweight Dangerous Liquid Detection Method Based on Depthwise Separable Convolution for X-Ray Security Inspection

X-YOLO: An Efficient Detection Network of Dangerous Objects in X-Ray Baggage Images

Detection of threat objects in baggage inspection with X-ray images using deep learning

Illicit item detection in X-ray images for security applications

Attention‐based prohibited item detection in X‐ray images during security checking

Contraband detection algorithm for X‐ray security inspection images based on global semantic enhancement

A Physics-Driven X-Ray Image Data Augmentation Method for Automated Threat Detection in Nuclear Facility Entrancement

Multi-Target Prohibited Item Recognition Algorithm for X-Ray Security Scene

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

Visual inspection for illicit items in X-ray images using Deep Learning

Multi‐Scale Feature Attention‐DEtection TRansformer: Multi‐Scale Feature Attention for security check object detection

Towards Automatic Threat Detection: A Survey of Advances of Deep Learning within X-ray Security Imaging

Advancements in machine learning techniques for threat item detection in X-ray images: a comprehensive survey

Detecting prohibited objects with physical size constraint from cluttered X-ray baggage images

Improved YOLOv8 Detection Algorithm in Security Inspection Image

Towards Real-world X-ray Security Inspection: A High-Quality Benchmark and Lateral Inhibition Module for Prohibited Items Detection

Lightweight Detection Method for X-ray Security Inspection with Occlusion

EM-YOLO: An X-ray Prohibited-Item-Detection Method Based on Edge and Material Information Fusion

An automated detection model of threat objects for X-Ray baggage inspection based on modified encoder-decoder model