Abstract:With the advancements in deep learning, detecting occluded pedestrians has become a focal point of research. Extracting pedestrian parts has proven to be an effective solution for handling occlusion. However, existing methods mainly rely on Region Proposal Networks (RPNs) for the part feature extraction. These RPNs-based methods suffer from limitations such as complex structures and limited receptive fields, which hinder their ability to capture global dependency information. To overcome these challenges, we propose a simple but effective Occlusion-Aware Dual-Branch Network (OADB-Net) based on an anchor-free framework for pedestrian detection in crowded scenes. Specifically, we design a dual-branch occlusion-aware detection head, consisting of a full-body detection branch and a head-shoulder detection branch, to address the occlusion issue in crowded scenes. The head-shoulder detection branch to handle heavily occluded instances and the full-body branch to focus on non-heavily occluded instances. Furthermore, we propose a Cross-Layer Non-Local Module (CLNL-Module), which captures long-range dependencies across feature layers, to effectively differentiate the relationship between pedestrian body and body parts while integrating essential features for more accurate and discriminative pedestrian representation. This strengthens the connections between the dual detection branches and enhances the responses of their respective center heatmaps. Our OADB-Net leverages part and full-body features to handle pedestrians with varying degrees of occlusion, while avoiding the limitations of RPNs-based methods. In heavy occlusion settings, OADB-Net achieves the average miss rates of 39.9%, 26.8%, and 43.1% on the Citypersons, Caltech, and CrowdHuman datasets, respectively, and demonstrates superior performance in traffic scenes.

An Integrated Deep Learning Framework for Occluded Pedestrian Tracking.

Pedestrian Tracking Framework Based on Deep Convolution Network and SIFT

An Integrated Learning Framework For Pedestrian Tracking

Research on Pedestrian Tracking Algorithm Based on Deep Learning Framework

Robust Pedestrian Tracking in Video Sequences Using an Improved STF Module

Full Occlusion Handling for Pedestrian Tracking Via Hybrid System

Deep Alignment Network Based Multi-person Tracking with Occlusion and Motion Reasoning

Detector-Tracker Integration Framework for Autonomous Vehicles Pedestrian Tracking.

Solving Occlusion Problem in Pedestrian Detection by Constructing Discriminative Part Layers

Multiple object tracking with appearance feature prediction and similarity fusion

OccluTrack: Rethinking Awareness of Occlusion for Enhancing Multiple Pedestrian Tracking

A Light Tracker for Online Multiple Pedestrian Tracking

3-Layer Specific Pedestrian Continuous Tracking Framework

Online multi-object tracking with pedestrian re-identification and occlusion processing

Pedestrian Tracking by Learning Deep Features

OADB-Net: an Occlusion-Aware Dual-Branch Network for Pedestrian Detection

Learning Deep Appearance Feature for Multi-target Tracking

Adaptive Pedestrian Tracking Via Patch-Based Features and Spatial–temporal Similarity Measurement

A Pedestrian Detection and Tracking Framework for Autonomous Cars: Efficient Fusion of Camera and LiDAR Data

An End-to-end Tracking Framework Via Multi-View and Temporal Feature Aggregation

A Modified Multi-Pedestrian Tracking System