Abstract:In complex traffic scenes, the orientation and location of pedestrians are important criteria for judging their intentions. We note that pedestrians are characterized by variability in appearance and small differences among orientations (especially adjacent orientations), thus causing general object detection algorithms to perform poorly in extracting features. So, extracting more discriminative features is an effective way to solve this problem. To this end, we propose a novel framework to enhance feature extraction involving pedestrian orientation detection (orientation classification and location regression). The framework consists of two modules, multi-window Transformer parallel fusion feature pyramid (MTPF) and gated graph (GG). The MTPF module is used for multi-layer feature fusion, which improves the feature representation of the prediction map by extracting high-level semantic information from deep layers and recovering missing contextual information from shallow layers. Specifically, it is achieved by setting a sliding window on multiple prediction maps and fused by the Transformer. The region proposal is abstracted into a graph with six nodes in the GG module, where each node represents a body part. We utilize GG to learn the spatial dependencies among body parts and learn features by aggregating information from neighbors. Finally, pedestrian orientation classification and location regression are performed on a graph containing rich relationships among nodes. According to the survey, there are currently no methods and datasets that can be directly used for pedestrian orientation detection, so we manually annotate pedestrian orientations on three public datasets containing a large number of pedestrian samples, and compare the proposed method with the current state-of-the-art object detection methods by comparison, the results demonstrate the effectiveness of the proposed method.

Exploiting key points supervision and grouped feature fusion for multiview pedestrian detection

Pedestrian Detection with Multi-View Convolution Fusion Algorithm

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

See Extensively While Focusing on the Core Area for Pedestrian Detection.

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Multi-view and Multi-Plane Data Fusion for Effective Pedestrian Detection in Intelligent Visual Surveillance

Unsupervised Multi-view Pedestrian Detection

A Pedestrian-Detection Method Based on Heterogeneous Features and Ensemble of Multi-View–Pose Parts

Exploiting fusion architectures for multispectral pedestrian detection and segmentation

Exploiting the Potential of Overlapping Cropping for Real-World Pedestrian and Vehicle Detection with Gigapixel-Level Images

An End-to-end Tracking Framework Via Multi-View and Temporal Feature Aggregation

Cascaded information enhancement and cross-modal attention feature fusion for multispectral pedestrian detection

A Deep Top-Down Framework Towards Generalisable Multi-View Pedestrian Detection

Transformer fusion and histogram layer multispectral pedestrian detection network

Multi-window Transformer Parallel Fusion Feature Pyramid Network for Pedestrian Orientation Detection

Key points and visible part fusion attention network for occluded pedestrian detection in traffic environments

Pedestrian detection based on channel feature fusion and enhanced semantic segmentation

Context feature fusion and enhanced non-maximum suppression for pedestrian detection in crowded scenes

Multi-View Pedestrian Recognition Using Shared Dictionary Learning with Group Sparsity

Vision Based Multi-pedestrian Tracking Using Adaptive Detection and Clustering.

A Methodology Review on Multi-view Pedestrian Detection