Abstract:A number of studies have been conducted to enhance the pedestrian detection accuracy of intelligent surveillance systems. However, detecting pedestrians under outdoor conditions is a challenging problem due to the varying lighting, shadows, and occlusions. In recent times, a growing number of studies have been performed on visible light camera-based pedestrian detection systems using a convolutional neural network (CNN) in order to make the pedestrian detection process more resilient to such conditions. However, visible light cameras still cannot detect pedestrians during nighttime, and are easily affected by shadows and lighting. There are many studies on CNN-based pedestrian detection through the use of far-infrared (FIR) light cameras (i.e., thermal cameras) to address such difficulties. However, when the solar radiation increases and the background temperature reaches the same level as the body temperature, it remains difficult for the FIR light camera to detect pedestrians due to the insignificant difference between the pedestrian and non-pedestrian features within the images. Researchers have been trying to solve this issue by inputting both the visible light and the FIR camera images into the CNN as the input. This, however, takes a longer time to process, and makes the system structure more complex as the CNN needs to process both camera images. This research adaptively selects a more appropriate candidate between two pedestrian images from visible light and FIR cameras based on a fuzzy inference system (FIS), and the selected candidate is verified with a CNN. Three types of databases were tested, taking into account various environmental factors using visible light and FIR cameras. The results showed that the proposed method performs better than the previously reported methods.

Far-Infrared Based Pedestrian Detection for Driver-Assistance Systems Based on Candidate Filters, Gradient-Based Feature and Multi-Frame Approval Matching.

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Real-time Pedestrian Crossing Lights Detection Algorithm for the Visually Impaired

Real-time pedestrian detection and tracking at nighttime for driver-assistance systems

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

Locality guided cross-modal feature aggregation and pixel-level fusion for multispectral pedestrian detection

Box-level Segmentation Supervised Deep Neural Networks for Accurate and Real-time Multispectral Pedestrian Detection

Contour Information-Guided Multi-Scale Feature Detection Method for Visible-Infrared Pedestrian Detection

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

Adaboost based Real-time Pedestrian Detection System

Multi-Grained Deep Feature Learning for Pedestrian Detection

Pedestrian- and Vehicle-Detection Algorithm Based on Improved Aggregated Channel Features

Nighttime Pedestrian Detection With Near Infrared Using Cascaded Classifiers

REAL-TIME SIDE PEDESTRIAN DETECTION FOR DRIVER ASSISTANCE SYSTEMS

Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

A Fast RetinaNet Fusion Framework for Multi-Spectral Pedestrian Detection

Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism

Shape-based Pedestrian Detection in Infrared Images

Pedestrian Detection Based on Adaptive Selection of Visible Light or Far-Infrared Light Camera Image by Fuzzy Inference System and Convolutional Neural Network-Based Verification

Multi-scale Pedestrian Detection in Infrared Images with Salient Background-awareness