Abstract:Human detection is one of the long-standing computer vision tasks, and it has been a cornerstone for many real-world applications, such as photo album organization, video surveillance, and autonomous driving. Benefiting from deep learning technologies, such as convolutional neural networks and modern object detectors, have been achieving much improved accuracy in generic object detection tasks. In this paper, we aim to improve deep learning-based human detection. Our main idea is to exploit semantic context information for human detection by using deep-learnt semantic features provided by semantic segmentation masks. Segmentation masks play as an attention mechanism and enforce the detectors to focus on the image regions where potential object candidates are likely to appear. Meanwhile, the extra segmentation mask channel can also guide the convolutional kernels to automatically learn more discriminative features which make it easier to distinguish the background and foreground. We implement our methods with two popular detection frameworks, i.e., faster R-CNN and SSD and experimentally analyze the effectiveness of the proposed methods. Evaluation results on the widely used MS-COCO dataset and the very recent CrowdHuman dataset are provided. Our proposed methods outperform the baseline detectors and achieve better performance on highly occluded human detection.

Human detection using depth information

A Two-Stage Human Body Detector on Depth Data

Human face detection under weak light based on depth information

Single image dehazing based on dark channel prior

Pixel Structure Based on Hausdorff Distance for Human Detection in Outdoor Environments.

Robust Real-Time Human Perception with Depth Camera.

Robust 3-D Human Detection in Complex Environments With a Depth Camera.

An ultra-fast human detection method for color-depth camera

Fast Human Detection in RGB-D Images Based on Color-Depth Joint Feature Learning.

A modified Mahalanobis distance for human detection in out-door environments

Reliably Detecting Humans in Crowded and Dynamic Environments Using RGB-D Camera

Upper Body Human Detection and Segmentation in Low Contrast Video

Human Detection Aided by Deeply Learned Semantic Masks

Human Detection Method Based on Multi-Part Detector and Multi-Instance Learning

Depth incorporating with color improves salient object detection

Robust Human Detection with Super-Pixel Segmentation and Random Ferns Classification Using RGB-D Camera

Human detection and tracking using apparent features under multi-cameras with non-overlapping

Physical Blob Detector and Multi-Channel Color Shape Descriptor for Human Detection.

Haze Density Estimation via Modeling of Scattering Coefficients of Iso-depth Regions

Real-time human detection and tracking in complex environments using single RGBD camera

Single Image Haze Removal Via Depth-Based Contrast Stretching Transform