Abstract:In complex traffic scenes, the orientation and location of pedestrians are important criteria for judging their intentions. We note that pedestrians are characterized by variability in appearance and small differences among orientations (especially adjacent orientations), thus causing general object detection algorithms to perform poorly in extracting features. So, extracting more discriminative features is an effective way to solve this problem. To this end, we propose a novel framework to enhance feature extraction involving pedestrian orientation detection (orientation classification and location regression). The framework consists of two modules, multi-window Transformer parallel fusion feature pyramid (MTPF) and gated graph (GG). The MTPF module is used for multi-layer feature fusion, which improves the feature representation of the prediction map by extracting high-level semantic information from deep layers and recovering missing contextual information from shallow layers. Specifically, it is achieved by setting a sliding window on multiple prediction maps and fused by the Transformer. The region proposal is abstracted into a graph with six nodes in the GG module, where each node represents a body part. We utilize GG to learn the spatial dependencies among body parts and learn features by aggregating information from neighbors. Finally, pedestrian orientation classification and location regression are performed on a graph containing rich relationships among nodes. According to the survey, there are currently no methods and datasets that can be directly used for pedestrian orientation detection, so we manually annotate pedestrian orientations on three public datasets containing a large number of pedestrian samples, and compare the proposed method with the current state-of-the-art object detection methods by comparison, the results demonstrate the effectiveness of the proposed method.

Gated Multi-Layer Convolutional Feature Extraction Network for Robust Pedestrian Detection.

Coupled Network for Robust Pedestrian Detection With Gated Multi-Layer Feature Extraction and Deformable Occlusion Handling

Pedestrian Detection by Using CNN Features with Skip Connection.

Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

Multi-Scale Structure Perception and Global Context-Aware Method for Small-Scale Pedestrian Detection

Transformer fusion and histogram layer multispectral pedestrian detection network

Multi-Grained Deep Feature Learning for Pedestrian Detection

Multi-scale cross-layer fusion and center position network for pedestrian detection

Feature Fusing of Feature Pyramid Network for Multi-Scale Pedestrian Detection

PFEL-Net: A lightweight network to enhance feature for multi-scale pedestrian detection

Hybrid Channel Based Pedestrian Detection

Pedestrian Detection with a Directly-Cascaded Deconvolution-Convolution Structure.

R-SSD: Refined Single Shot Multibox Detector for Pedestrian Detection

Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

Multi-window Transformer Parallel Fusion Feature Pyramid Network for Pedestrian Orientation Detection

Attention-Guided Sample-Based Feature Enhancement Network for Crowded Pedestrian Detection Using Vision Sensors

An improved scheme of deep dilated feature extraction on pedestrian detection

Selective Kernel and Spatial Grouping Attention Network for Occluded Pedestrian Detection

Feature Calibration Network for Occluded Pedestrian Detection

Small-Scale and Occluded Pedestrian Detection Using Multi Mapping Feature Extraction Function and Modified Soft-NMS

Learning Multilayer Channel Features for Pedestrian Detection