Abstract:RGBT person detection benefits numerous vital applications like surveillance, search, and rescue. Meanwhile, drones can capture images holding broad perspectives and large searching regions per frame, which can notably improve the efficacy of large-scale search and rescue missions. In this work, we leverage the advantages of drone-based vision for RGBT person detection. The drone-based RGBT person detection task brings interesting challenges to existing cross-modality object detectors, e.g., tiny sizes of objects, modality-space imbalance, and position shifts. Observing that there is a lack of data and customized detectors for drone-based RGBT person detection, we contribute two new datasets and design a novel detector. The data contribution is two-fold. For one, we construct the first large-scale drone-based RGBT person detection benchmark RGBTDronePerson, which contains 6,125 pairs of RGBT images and 70,880 instances. Images are captured in various scenes and under various illumination and weather conditions. For another, we annotate the VTUAV tracking dataset and obtain its object detection version, named VTUAV-det. To tackle the challenges raised by this task, we propose a Quality-aware RGBT Fusion Detector (QFDet). Firstly, we design a Quality-aware Learning Strategy (QLS) to provide sufficient supervision for tiny objects while focusing on high-quality samples, in which a Quality-Aware Factor (QAF) is designed to measure the quality. Moreover, a Quality-aware Cross-modality Enhancement module (QCE) is proposed to predict a QAF map for each modality, which not only indicates the reliability of each modality but also highlights regions where objects are more likely to appear. Our QFDet remarkably boosts the detection performance over tiny and small objects, surpassing the strong baseline on mAP 50 tiny by 6.57 points on RGBTDronePerson and mAP s by 3.80 points on VTUAV-det. The datasets, codes, and pre-trained models are available at https://nnnnerd.github.io/RGBTDronePerson/.

RPTK1: A New Thangka Data Set for Object Detection of Thangka Images

Computer Assisted Rendering of Black and White Thangka

Few shot object detection for headdresses and seats in Thangka Yidam based on ResNet and deformable convolution

Portrait Thangka Image Retrieval via Figure Re-identification

Ancient thangka Buddha face recognition based on the Dlib machine learning library and comparison with secular aesthetics

Human Detection Method Based on Multi-Part Detector and Multi-Instance Learning

Thangka Sketch Colorization Based on Multi-Level Adaptive-Instance-Normalized Color Fusion and Skip Connection Attention

A Preliminary Study On Extracting Objects In Sketches

Few-Shot Object Detection With Attention-RPN and Multi-Relation Detector

Automatic colorization for Thangka sketch-based paintings

Active Terahertz Imaging Dataset for Concealed Object Detection

DART: An Automated End-to-End Object Detection Pipeline with Data Diversification, Open-Vocabulary Bounding Box Annotation, Pseudo-Label Review, and Model Training

Learning Multi-Granularity Features for Re-Identifying Figures in Portrait Thangka Images

Application of YOLOv5 Based on Attention Mechanism and Receptive Field in Identifying Defects of Thangka Images

Drone-based RGBT tiny person detection

Recurrent Multi-scale Transformer for High-Resolution Salient Object Detection

Subtask Attention Based Object Detection in Remote Sensing Images

Few-Shot Object Detection: Application to Medieval Musicological Studies

A Multi-object Detection Sampling Algorithm for Large Scenes

CvT-ASSD: Convolutional vision-Transformer Based Attentive Single Shot MultiBox Detector

Multi-scale Dense Object Detection in Remote Sensing Imagery Based on Keypoints