Abstract:The rise of intelligent vision-based people detection and counting methods will have a significant impact on the future security and space management of intelligent buildings. The current deep learning-based people detection algorithm achieves state-of-the-art performance in images collected by standard cameras. Nevertheless, standard vision approaches do not perform well on fisheye cameras because they are not suitable for fisheye images with radial geometry and barrel distortion. Overhead fisheye cameras can provide a larger field of view compared to standard cameras in people detection and counting tasks. In this paper, we propose an orientation-aware people detection and counting method based on an overhead fisheye camera. Specifically, an orientation-aware deep convolutional neural network with simultaneous attention refinement module (SARM) is introduced for people detection in arbitrary directions. Based on the attention mechanism, SARM can suppress the noise feature and highlight the object feature to improve the context focusing ability of the network on the people with different poses and orientations. Following the collection of detection results, an Internet of Things (IoT) system based on Real Time Streaming Protocol (RTSP) is constructed to output results to different devices. Experiments on three common fisheye image datasets show that under low light conditions, our method has high generalization ability and outperforms the state-of-the-art methods.

PHD: A Deep Learning Based Human Detection Framework for Panoramic Videos

Video Based Head Detection and Tracking Surveillance System

Real-Time Drone Detection Using Deep Learning Approach.

Object Detection on Panoramic Images Based on Deep Learning

Panoramic Multi-Target Tracking Model Incorporating Human Features and Motion Model

Large Area 3D Human Pose Detection Via Stereo Reconstruction in Panoramic Cameras

Orientation-aware People Detection and Counting Method Based on Overhead Fisheye Camera

Detecting and tracking people in real time with RGB-D camera

Human Detection Using Multi-Camera And 3d Scene Knowledge

A Panoramic Video Face Detection System Design and Implement

People Tracking in Panoramic Video for Guiding Robots

Robust 3-D Human Detection in Complex Environments With a Depth Camera.

Instance Implant-Aided Non-uniformly Cropping for Person Detection in Aerial Images

Two- and Three-Dimensional Deep Human Detection by Generating Orthographic Top View Image from Dense Point Cloud

Human Detection in Video over Large Viewpoint Changes

Object Detection Algorithm Based on Panoramic Stereo Video

Implementation Of Person Tracking System In Panorama Based On Personalized Distribution

3D Object Detection Algorithm for Panoramic Images with Multi-Scale Convolutional Neural Network.

Fast Human Detection in RGB-D Images Based on Color-Depth Joint Feature Learning.

Depth sensor based human detection for indoor surveillance.

A Multi-view Deep Learning Approach for Detecting Threats on 3D Human Body.