Domain adaptive detection system for concealed objects using millimeter wave images

Bo Zhang,Bin Wang,Xiaofeng Wu,Liming Zhang,Minghui Yang,Xiaowei Sun
DOI: https://doi.org/10.1007/s00521-021-05847-5
2021-01-01
Abstract:Millimeter wave (MMW) images can be used to identify metallic or non-metallic embargoed items hidden under clothing in both active and passive modes. Detection of concealed objects aims to locate these forbidden items from given MMW images. However, how to effectively realize the detection of concealed objects from MMW images is still a very challenging task, since the prohibited items are relatively smaller in size than human bodies, and the quality of MMW images is also relatively lower than natural images such as in signal-to-noise ratio and spatial resolution, and further, domain shifts of MMW images are common in the real applications. In this paper, a domain adaptive detection system, mainly composed of two parts: a detection module and a domain adaptation module, is proposed. Our system takes reconstructed single-channel MMW images as the input. For the detection module, a top-down region-free network with attention units is proposed to effectively fuse low-level and high-level features. For the domain adaptation module, an unsupervised hierarchical alignment is proposed and incorporated into the training process to constrain the inter-domain difference of the extracted features by embedding the extracted features into kernel Hilbert spaces and optimally matching different domain distributions. Ablative experiments are conducted to evaluate the function of each module and the performance of the proposed system. Experimental results on both active and passive MMW datasets demonstrate that the proposed method is evidently superior over existing methods in accuracy and speed of detection and should be very useful in practice for concealed object detection.
What problem does this paper attempt to address?