Abstract:In the growth of intelligent surveillance and computer vision, pedestrian intrusion detection (PID) has been widely applied in security, automatic driving and many other fields. Vision-based PID aims at detecting whether pedestrians invade an area-of-interest (AoI). For dynamic PID task, we need to identify the invading individuals from a large amount of pedestrian objects in a varying AoI scene, which is very challenging. We take the first attempt to solve this issue and propose a network named PIDNet to address it. In the PIDNet, we design an efficient dual-branch network, which combines region segmentation and pedestrian object detection. The final intrusion judgement is made by analyzing the position relation between a segmented AoI and a detected pedestrian. With the lightweight network design, PIDNet can detect pedestrian objects and segment AoI simultaneously, and make intrusion judgment efficiently. In order to achieve better intrusion detection performance, we further propose a netowrk with a cross-association strategy (cross-PIDNet) to improve the feature extraction capability of dual-branch network. In this strategy, we build the connection between detection branch and segmentation branch, avoiding the redundancy of non-critical intrusion features and enhancing the expression of critical intrusion features. Meanwhile, we design a multi-scale intrusion judgment module, which makes the judgment of intrusion state more robust. Since neither public datasets nor a benchmark is available in this direction, we set up a benchmark dataset and corresponding evaluation metrics. Experimental results indicate that our cross-PIDNet can reach 74.7% $PID\_{A}cc$ and 50.8% $PID\_{A}P$ .

Pedestrian Detection via Body Part Semantic and Contextual Information With DNN

PCN: Part and Context Information for Pedestrian Detection with CNNs

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

See Extensively While Focusing on the Core Area for Pedestrian Detection.

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Learning Pixel-Level and Instance-Level Context-Aware Features for Pedestrian Detection in Crowds.

An Efficient Multi-Task Network for Pedestrian Intrusion Detection

PSC-Net: learning part spatial co-occurrence for occluded pedestrian detection

Dual-branch Self-Attention Network for Pedestrian Attribute Recognition

PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes

Pedestrian Partial Occlusion Detection Method Based on Improved YOLO Network Structure

Pedestrian Detection Based on Center, Temperature, Scale and Ratio Prediction in Thermal Imagery

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Guided Attention in CNNs for Occluded Pedestrian Detection and Re-identification

Mask-Guided Attention Network for Occluded Pedestrian Detection

Occluded Pedestrian Attention Network : an Occluded Pedestrian Detector

Attention-Guided Sample-Based Feature Enhancement Network for Crowded Pedestrian Detection Using Vision Sensors

Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

Count- and Similarity-Aware R-CNN for Pedestrian Detection

Deep Pedestrian Detection Using Contextual Information and Multi-level Features

Pedestrian detection based on channel feature fusion and enhanced semantic segmentation