Abstract:The explosive growth of digital images in video surveillance and social media has led to the significant need for efficient search of persons of interest in law enforcement and forensic applications. Despite tremendous progress in primary biometric traits (e.g., face and fingerprint) based person identification, a single biometric trait alone can not meet the desired recognition accuracy in forensic scenarios. Tattoos, as one of the important soft biometric traits, have been found to be valuable for assisting in person identification. However, tattoo search in a large collection of unconstrained images remains a difficult problem, and existing tattoo search methods mainly focus on matching cropped tattoos, which is different from real application scenarios. To close the gap, we propose an efficient tattoo search approach that is able to learn tattoo detection and compact representation jointly in a single convolutional neural network (CNN) via multi-task learning. While the features in the backbone network are shared by both tattoo detection and compact representation learning, individual latent layers of each sub-network optimize the shared features toward the detection and feature learning tasks, respectively. We resolve the small batch size issue inside the joint tattoo detection and compact representation learning network via random image stitch and preceding feature buffering. We evaluate the proposed tattoo search system using multiple public-domain tattoo benchmarks, and a gallery set with about 300K distracter tattoo images compiled from these datasets and images from the Internet. In addition, we also introduce a tattoo sketch dataset containing 300 tattoos for sketch-based tattoo search. Experimental results show that the proposed approach has superior performance in tattoo detection and tattoo search at scale compared to several state-of-the-art tattoo retrieval algorithms.

DCINN: Deformable Convolution and Inception Based Neural Network for Tattoo Text Detection Through Skin Region

A comprehensive scheme for tattoo text detection

Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning

TTS: Hilbert Transform-based Generative Adversarial Network for Tattoo and Scene Text Spotting

Inkthetics: A Comprehensive Computational Model for Aesthetic Evaluation of Chinese Ink Paintings.

CTH-Net: CNN-Transformer Hybrid Network for Garment Image Generation from Sketches and Color Points

Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition

Tattoo Recognition Based on Triplet GAN

TATTOOED: A Robust Deep Neural Network Watermarking Scheme based on Spread-Spectrum Channel Coding

A new method for detection and prediction of occluded text in natural scene images

An Episodic Learning Network for Text Detection on Human Bodies in Sports Images

Deformable scene text detection using harmonic features and modified pixel aggregation network

Seam Carving Detection and Localization using Two-Stage Deep Neural Networks

Text detection and script identification in natural scene images using deep learning

Local Gradient Difference Features for Classification of 2D-3D Natural Scene Text Images.

Deep Convolutional Neural Network for Identifying Seam-Carving Forgery

DSANet: dilated spatial attention network for the detection of text, non-text and touching components in unconstrained handwritten documents

Text Detection In Born-Digital Images By Mass Estimation

Impact of facial tattoos and paintings on face recognition systems

An Encoder-Decoder CNN for Hair Removal in Dermoscopic Images

Text Region Identification in Indian Street Scene Images Using Stroke Width Transform and Support Vector Machine