Abstract:In complex traffic scenes, the orientation and location of pedestrians are important criteria for judging their intentions. We note that pedestrians are characterized by variability in appearance and small differences among orientations (especially adjacent orientations), thus causing general object detection algorithms to perform poorly in extracting features. So, extracting more discriminative features is an effective way to solve this problem. To this end, we propose a novel framework to enhance feature extraction involving pedestrian orientation detection (orientation classification and location regression). The framework consists of two modules, multi-window Transformer parallel fusion feature pyramid (MTPF) and gated graph (GG). The MTPF module is used for multi-layer feature fusion, which improves the feature representation of the prediction map by extracting high-level semantic information from deep layers and recovering missing contextual information from shallow layers. Specifically, it is achieved by setting a sliding window on multiple prediction maps and fused by the Transformer. The region proposal is abstracted into a graph with six nodes in the GG module, where each node represents a body part. We utilize GG to learn the spatial dependencies among body parts and learn features by aggregating information from neighbors. Finally, pedestrian orientation classification and location regression are performed on a graph containing rich relationships among nodes. According to the survey, there are currently no methods and datasets that can be directly used for pedestrian orientation detection, so we manually annotate pedestrian orientations on three public datasets containing a large number of pedestrian samples, and compare the proposed method with the current state-of-the-art object detection methods by comparison, the results demonstrate the effectiveness of the proposed method.

Consistent GT-Proposal Assignment for Challenging Pedestrian Detection

Learning Consistent Gt-Proposal Assignment for Pedestrian Detection

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Pedestrian Proposal and Refining Based on the Shared Pixel Differential Feature

Putting the Anchors Efficiently: Geometric Constrained Pedestrian Detection.

Sequential Attention-Based Distinct Part Modeling for Balanced Pedestrian Detection

Attention-Guided Sample-Based Feature Enhancement Network for Crowded Pedestrian Detection Using Vision Sensors

Cross-Modality Proposal-guided Feature Mining for Unregistered RGB-Thermal Pedestrian Detection

Fast Pedestrian Detection Based on Object Proposals and HOG.

Pedestrian As Points: an Improved Anchor-Free Method for Center-Based Pedestrian Detection.

MSAGNet: Multi-Stream Attribute-Guided Network for Occluded Pedestrian Detection

Reparameterized dilated architecture: A wider field of view for pedestrian detection

SurfaceNet: A Surface Focused Network for Pedestrian Detection and Segmentation in 3D Point Clouds

Learning Hierarchical Graph for Occluded Pedestrian Detection

Multi-window Transformer Parallel Fusion Feature Pyramid Network for Pedestrian Orientation Detection

Attention-Guided Region Proposal Network for Pedestrian Detection

A Boosted Multi-Task Model for Pedestrian Detection with Occlusion Handling.

Unsupervised Multi-view Pedestrian Detection

Towards More Reliable Evaluation in Pedestrian Detection by Rethinking "ignore Regions".