Abstract:Nowadays, with the rapid development of consumer Unmanned Aerial Vehicles (UAVs), utilizing UAV platforms for visual surveillance has become very attractive, and a key part of this is remote vision-based pedestrian attribute recognition. Pedestrian Attribute Recognition (PAR) is dedicated to predicting multiple attribute labels of a single pedestrian image extracted from surveillance videos and aerial imagery, which presents significant challenges in the computer vision community due to factors such as poor imaging quality and substantial pose variations. Despite recent studies demonstrating impressive advancements in utilizing complicated architectures and exploring relations, most of them may fail to fully and systematically consider the inter-region, inter-attribute, and region-attribute mapping relations simultaneously and be stuck in the dilemma of information redundancy, leading to the degradation of recognition accuracy. To address the issues, we construct a novel Mask-Relation-Guided Transformer (MRG-T) framework that consists of three relation modeling modules to fully exploit spatial and semantic relations in the model learning process. Specifically, we first propose a Masked Region Relation Module (MRRM) to focus on precise spatial attention regions to extract more robust features with masked random patch training. To explore the semantic association of attributes, we further present a Masked Attribute Relation Module (MARM) to extract intrinsic and semantic inter-attribute relations with an attribute label masking strategy. Based on the cross-attention mechanism, we finally design a Region and Attribute Mapping Module (RAMM) to learn the cross-modal alignment between spatial regions and semantic attributes. We conduct comprehensive experiments on three public benchmarks such as PETA, PA-100K, and RAPv1, and conduct inference on a large-scale airborne person dataset named PRAI-1581. The extensive experimental results demonstrate the superior performance of our method compared to state-of-the-art approaches and validate the effectiveness of mask-relation-guided modeling in the remote vision-based PAR task.

Multidirection and Multiscale Pyramid in Transformer for Video-Based Pedestrian Retrieval

Multi-direction and Multi-scale Pyramid in Transformer for Video-based Pedestrian Retrieval

Multi-attribute Adaptive Aggregation Transformer for Vehicle Re-Identification.

Multi-window Transformer Parallel Fusion Feature Pyramid Network for Pedestrian Orientation Detection

DIMGNet: A Transformer-based Network for Pedestrian Reidentification with Multi-granularity Information Mutual Gain

Transformer fusion and histogram layer multispectral pedestrian detection network

Pedestrian Attribute Recognition Via Spatio-temporal Relationship Learning for Visual Surveillance

MRG-T: Mask-Relation-Guided Transformer for Remote Vision-Based Pedestrian Attribute Recognition in Aerial Imagery

Multi-Stage Spatio-Temporal Aggregation Transformer for Video Person Re-identification

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

P2T: Pyramid Pooling Transformer for Scene Understanding

HRPVT: High-Resolution Pyramid Vision Transformer for medium and small-scale human pose estimation

MuTrans: Multiple Transformers for Fusing Feature Pyramid on 2D and 3D Object Detection

InvPT: Inverted Pyramid Multi-task Transformer for Dense Scene Understanding

GTransPDM: A Graph-embedded Transformer with Positional Decoupling for Pedestrian Crossing Intention Prediction

Pyramid Transformer for Traffic Sign Detection

Non-Hierarchical Transformers for Pedestrian Segmentation

A Video Is Worth Three Views: Trigeminal Transformers for Video-Based Person Re-Identification

Spatio-Temporal Side Tuning Pre-trained Foundation Models for Video-based Pedestrian Attribute Recognition

Pedestrian 3D Shape Understanding for Person Re-Identification via Multi-View Learning

PT-Net: Pyramid Transformer Network for Feature Matching Learning