Abstract:Nowadays, with the rapid development of consumer Unmanned Aerial Vehicles (UAVs), utilizing UAV platforms for visual surveillance has become very attractive, and a key part of this is remote vision-based pedestrian attribute recognition. Pedestrian Attribute Recognition (PAR) is dedicated to predicting multiple attribute labels of a single pedestrian image extracted from surveillance videos and aerial imagery, which presents significant challenges in the computer vision community due to factors such as poor imaging quality and substantial pose variations. Despite recent studies demonstrating impressive advancements in utilizing complicated architectures and exploring relations, most of them may fail to fully and systematically consider the inter-region, inter-attribute, and region-attribute mapping relations simultaneously and be stuck in the dilemma of information redundancy, leading to the degradation of recognition accuracy. To address the issues, we construct a novel Mask-Relation-Guided Transformer (MRG-T) framework that consists of three relation modeling modules to fully exploit spatial and semantic relations in the model learning process. Specifically, we first propose a Masked Region Relation Module (MRRM) to focus on precise spatial attention regions to extract more robust features with masked random patch training. To explore the semantic association of attributes, we further present a Masked Attribute Relation Module (MARM) to extract intrinsic and semantic inter-attribute relations with an attribute label masking strategy. Based on the cross-attention mechanism, we finally design a Region and Attribute Mapping Module (RAMM) to learn the cross-modal alignment between spatial regions and semantic attributes. We conduct comprehensive experiments on three public benchmarks such as PETA, PA-100K, and RAPv1, and conduct inference on a large-scale airborne person dataset named PRAI-1581. The extensive experimental results demonstrate the superior performance of our method compared to state-of-the-art approaches and validate the effectiveness of mask-relation-guided modeling in the remote vision-based PAR task.

SRPT: State Refinement ProbSparse Transformer for Tactical Intention Recognition of Cluster Targets

Hierarchical Aggregation Perceptual Pipeline for Tactical Intention Recognition

Spatial-Temporal Tensor Representation Learning with Priors for Infrared Small Target Detection

STIRNet: A Spatio-Temporal Network for Air Formation Targets Intention Recognition

A GRU-Based Method for Predicting Intention of Aerial Targets

SCTransNet: Spatial-channel Cross Transformer Network for Infrared Small Target Detection

5-D Spatial-Temporal Information-Based Infrared Small Target Detection in Complex Environments

PBT: Progressive Background-aware Transformer for Infrared Small Target Detection

LEC-MTNN: a Novel Multi-Frame Infrared Small Target Detection Method Based on Spatial-Temporal Patch-Tensor

Exploring reliable infrared object tracking with spatio-temporal fusion transformer

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Separable Spatial–Temporal Patch-Tensor Pair Completion for Infrared Small Target Detection

ST-Trans: Spatial-Temporal Transformer for Infrared Small Target Detection in Sequential Images

Infrared Small Target Detection via Two-Stage Feature Complementary Improved Tensor Low-Rank Sparse Decomposition

Pose Discrepancy Spatial Transformer Based Feature Disentangling for Partial Aspect Angles SAR Target Recognition

Transductive Prototypical Attention Reasoning Network for Few-Shot SAR Target Recognition

PSCLI-TF: Position-Sensitive Cross-Layer Interactive Transformer Model for Remote Sensing Image Scene Classification

RSPT: Reconstruct Surroundings and Predict Trajectories for Generalizable Active Object Tracking

RSPT: Reconstruct Surroundings and Predict Trajectory for Generalizable Active Object Tracking

SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Prediction

MRG-T: Mask-Relation-Guided Transformer for Remote Vision-Based Pedestrian Attribute Recognition in Aerial Imagery