Alpha 2 adrenergic receptor subtypes in depression: a candidate gene study.

Z. Wang,R. Crowe,V. Tanna,G. Winokur

DOI: https://doi.org/10.1016/0165-0327(92)90005-Q

IF: 6.533

1992-07-01

Journal of Affective Disorders

Abstract:

What problem does this paper attempt to address?

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Haoyang He,Zhishan Li,Guanzhong Tian,Hongxu Chen,Lei Xie,Shan Lu,Hongye Su

DOI: https://doi.org/10.1016/j.patrec.2023.08.019

IF: 4.757

2023-01-01

Pattern Recognition Letters

Abstract:With the development of self-driving technology, pedestrian detection models are becoming more useful and important. Although object detection models based on Convolutional Neural Networks have achieved favorable detection results, due to the occlusion in crowded scenarios, dense pedestrian detection is still a challenging task compared with generic object detection. For a CNN-based object detector, an appropriate label assignment method is significant. In this paper, we propose an effective training sample allocation method called Occlusion-Prediction aware Label Assignment (OPLA) to improve the performance of the detector in crowded scenarios. For those Ground Truths (GTs) without severe occlusion, we directly assign prediction boxes with the best matching quality as the corresponding positive samples. In terms of GTs in heavily crowded areas, we fine-tune the matching quality based on visible ratio to enhance the training sample selection priority of severe occluded GTs. In addition, we reveal the deficiency of currently popular post-processing algorithms, Non-Maximum Suppression (NMS) and Soft-NMS for dense pedestrian detection, and propose Hierarchical-NMS (H-NMS) whose strategy diverges with different Intersection over Union (IoU) levels. Experimental results on Crowdhuman, the largest dense pedestrian detection dataset at present, show our approach optimizes the Average Precision (AP) and Miss Rate (MR) of Fully Convolutional One Stage Object Detection (FCOS) by 4.05% and 5.35% and outperforms many state-of-the-art detectors, respectively. Besides, our method does not bring any increase in calculation during inference.
Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond

Irtiza Hasan,Shengcai Liao,Jinpeng Li,Saad Ullah Akram,Ling Shao

DOI: https://doi.org/10.48550/arXiv.2201.03176

2022-03-02

Abstract:Pedestrian detection is the cornerstone of many vision based applications, starting from object tracking to video surveillance and more recently, autonomous driving. With the rapid development of deep learning in object detection, pedestrian detection has achieved very good performance in traditional single-dataset training and evaluation setting. However, in this study on generalizable pedestrian detectors, we show that, current pedestrian detectors poorly handle even small domain shifts in cross-dataset evaluation. We attribute the limited generalization to two main factors, the method and the current sources of data. Regarding the method, we illustrate that biasness present in the design choices (e.g anchor settings) of current pedestrian detectors are the main contributing factor to the limited generalization. Most modern pedestrian detectors are tailored towards target dataset, where they do achieve high performance in traditional single training and testing pipeline, but suffer a degrade in performance when evaluated through cross-dataset evaluation. Consequently, a general object detector performs better in cross-dataset evaluation compared with state of the art pedestrian detectors, due to its generic design. As for the data, we show that the autonomous driving benchmarks are monotonous in nature, that is, they are not diverse in scenarios and dense in pedestrians. Therefore, benchmarks curated by crawling the web (which contain diverse and dense scenarios), are an efficient source of pre-training for providing a more robust representation. Accordingly, we propose a progressive fine-tuning strategy which improves generalization. Code and models can accessed at <a class="link-external link-https" href="https://github.com/hasanirtiza/Pedestron" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Deep convolutional neural networks for pedestrian detection

Denis Tomè,Federico Monti,Luca Baroffio,Luca Bondi,Marco Tagliasacchi,Stefano Tubaro

DOI: https://doi.org/10.1016/j.image.2016.05.007

2016-03-07

Abstract:Pedestrian detection is a popular research topic due to its paramount importance for a number of applications, especially in the fields of automotive, surveillance and robotics. Despite the significant improvements, pedestrian detection is still an open challenge that calls for more and more accurate algorithms. In the last few years, deep learning and in particular convolutional neural networks emerged as the state of the art in terms of accuracy for a number of computer vision tasks such as image classification, object detection and segmentation, often outperforming the previous gold standards by a large margin. In this paper, we propose a pedestrian detection system based on deep learning, adapting a general-purpose convolutional network to the task at hand. By thoroughly analyzing and optimizing each step of the detection pipeline we propose an architecture that outperforms traditional methods, achieving a task accuracy close to that of state-of-the-art approaches, while requiring a low computational time. Finally, we tested the system on an NVIDIA Jetson TK1, a 192-core platform that is envisioned to be a forerunner computational brain of future self-driving cars.

Computer Vision and Pattern Recognition
Accurate Pedestrian Detection by Human Pose Regression

Yun Zhao,Zejian Yuan,Badong Chen

DOI: https://doi.org/10.1109/tip.2019.2942686

IF: 10.6

2020-01-01

IEEE Transactions on Image Processing

Abstract:Pedestrian detection with high detection and localization accuracy is increasingly important for many practical applications. Due to the flexible structure of the human body, it is hard to train a template-based pedestrian detector that achieves a high detection rate and a good localization accuracy simultaneously. In this paper, we utilize human pose estimation to improve the detection and localization accuracy of pedestrian detection. We design two kinds of pose-indexed features that can considerably improve the discriminability of the detector. In addition to employing a two-stage pipeline to carry out these two tasks, we unify pose estimation and pedestrian detection into a cascaded decision forest in which they can cooperate sufficiently. To prevent irregular positive examples, such as truncated ones, from distracting the pedestrian detection and the pose regression, we clean the positive training data by realigning the bounding boxes and rejecting the wrong positive samples. Experimental results on the Caltech test dataset demonstrate the effectiveness of our proposed method. Our detector achieves 11.1% MR<sub>−2</sub>, outperforming all existing detectors without using the convolutional neural network (CNN). Moreover, our method can be assembled with other detectors based on CNNs to improve detection and localization performance. By collaborating with the recent CNN-based method, our detector achieves 5.5% MR<sub>−2</sub> on the Caltech test dataset, outperforming the state-of-the-art methods.

computer science, artificial intelligence,engineering, electrical & electronic
Too Far to See? Not Really! --- Pedestrian Detection with Scale-aware Localization Policy

Xiaowei Zhang,Li Cheng,Bo Li,Hai-Miao Hu

DOI: https://doi.org/10.1109/TIP.2018.2818018

2017-09-01

Abstract:A major bottleneck of pedestrian detection lies on the sharp performance deterioration in the presence of small-size pedestrians that are relatively far from the camera. Motivated by the observation that pedestrians of disparate spatial scales exhibit distinct visual appearances, we propose in this paper an active pedestrian detector that explicitly operates over multiple-layer neuronal representations of the input still image. More specifically, convolutional neural nets such as ResNet and faster R-CNNs are exploited to provide a rich and discriminative hierarchy of feature representations as well as initial pedestrian proposals. Here each pedestrian observation of distinct size could be best characterized in terms of the ResNet feature representation at a certain layer of the hierarchy; Meanwhile, initial pedestrian proposals are attained by faster R-CNNs techniques, i.e. region proposal network and follow-up region of interesting pooling layer employed right after the specific ResNet convolutional layer of interest, to produce joint predictions on the bounding-box proposals' locations and categories (i.e. pedestrian or not). This is engaged as input to our active detector where for each initial pedestrian proposal, a sequence of coordinate transformation actions is carried out to determine its proper x-y 2D location and layer of feature representation, or eventually terminated as being background. Empirically our approach is demonstrated to produce overall lower detection errors on widely-used benchmarks, and it works particularly well with far-scale pedestrians. For example, compared with 60.51% log-average miss rate of the state-of-the-art MS-CNN for far-scale pedestrians (those below 80 pixels in bounding-box height) of the Caltech benchmark, the miss rate of our approach is 41.85%, with a notable reduction of 18.68%.

Computer Vision and Pattern Recognition
Pedestrian detection by multiple decision-based neural networks

Chen Huang,Guangrong Tang,Yupin Luo

DOI: https://doi.org/10.1007/11427469_74

2005-01-01

Abstract:This paper describes an approach of pedestrian detection for onboard application in night driving. Based on single-frame analysis, two-stage method is designed for detecting pedestrians in the cluttered scenes, which are obtained via a normal camera installed on moving vehicle. In the first stage, bright foreground objects are extracted from dim background as candidates. In the second one, we cascade different-feature-based classifiers, emphasizing shape-based classification. Novel contributions of this paper are, 1) developing the shape representation of candidates; 2) combining multiple Decision-Based Neural Networks for elaborate classification, and further reducing the false alarms. Experiments show that our approach is promising, while the system can achieve real-time detection.
Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

Peijia Yu,Yong Zhao,Jing Zhang,Xiaoyao Xie

DOI: https://doi.org/10.1016/j.jvcir.2019.102579

IF: 2.887

2019-01-01

Journal of Visual Communication and Image Representation

Abstract:Object detection has been widely applied in modern intelligent systems, especially using convolutional neural networks (CNNs). Pedestrian detection is a key technique in video surveillance, which could automatically locate special pedestrian. However, conventional CNN based methods such as Fast/Faster R-CNN cannot handle pedestrian detection effectively due to the extremely similar of positives and hard negatives. In this paper, in order to solve hard negative problem in pedestrian detection, we incorporate classifier enhancement and representational ability of CNNs. More specifically, we first fuse multi-channel visual features (color, texture, semantic) for quality assessment. Then, we propose “Reduction-adjustment” (RA) block which can enhance feature extraction and can be flexibly embedded into CNNs. In our implementation, we embed RA blocks into a base model such as VGG 16. Afterwards, we apply Faster R-CNN as a detection system to classify and locate pedestrians. Extensive experiments on Caltech, ETH and CityPersons datasets demonstrate that our deep model is feasible and effective for pedestrian detection.
Pedestrian Detection Based on Hand-crafted Features and Multi-layer Feature Fused-ResNet Model

Sweta Panigrahi,U. S. N. Raju

DOI: https://doi.org/10.1142/s0218213021500287

IF: 1.1

2021-08-01

International Journal on Artificial Intelligence Tools

Abstract:One of the most sought-after research areas in object detection is pedestrian detection owing to its applications especially in automated surveillance and robotics. Traditional methods use hand-crafted features to characterize pedestrians. In this work, we have pro-posed a new hand-crafted feature extraction method that concatenates shape, color and texture features; which is then classified by using Support Vector Machine (SVM). As in recent years, deep learning models such as Convolutional Neural Networks (CNNs) have become an eminent state of the art in detection challenges, which unlike the manually designed feature extraction mechanism, results in more accuracy. Therefore, we have also proposed a CNN network, a modification of the pre-trained ResNet-18 named as Multi-layer Feature Fused-ResNet (MF2-ResNet). We have used the proposed modification for (1) feature extraction; which is then classified by using Support Vector Machine (SVM); (2) End-to-End feature extraction and classification by the CNN network and (3) MF2-ResNet based Faster-RCNN to include region proposals in the detection pipeline. To evaluate the proposed method, it is compared with existing pre-trained CNNs. The MF2-ResNet based Faster R-CNN is compared with state-of-the-art detection methods. Three benchmark pedestrian datasets are used in this work: INRIA, NICTA and Daimler.

computer science, artificial intelligence, interdisciplinary applications
Count- and Similarity-Aware R-CNN for Pedestrian Detection

Jin Xie,Hisham Cholakkal,Rao Muhammad Anwer,Fahad Shahbaz Khan,Yanwei Pang,Ling Shao,Mubarak Shah

DOI: https://doi.org/10.1007/978-3-030-58520-4_6

2020-01-01

Abstract:Recent pedestrian detection methods generally rely on additional supervision, such as visible bounding-box annotations, to handle heavy occlusions. We propose an approach that leverages pedestrian count and proposal similarity information within a two-stage pedestrian detection framework. Both pedestrian count and proposal similarity are derived from standard full-body annotations commonly used to train pedestrian detectors. We introduce a count-weighted detection loss function that assigns higher weights to the detection errors occurring at highly overlapping pedestrians. The proposed loss function is utilized at both stages of the two-stage detector. We further introduce a count-and-similarity branch within the two-stage detection framework, which predicts pedestrian count as well as proposal similarity. Lastly, we introduce a count and similarity-aware NMS strategy to identify distinct proposals. Our approach requires neither part information nor visible bounding-box annotations. Experiments are performed on the CityPersons and CrowdHuman datasets. Our method sets a new state-of-the-art on both datasets. Further, it achieves an absolute gain of 2.4% over the current state-of-the-art, in terms of log-average miss rate, on the heavily occluded (HO) set of CityPersons test set. Finally, we demonstrate the applicability of our approach for the problem of human instance segmentation. Code and models are available at: https://github.com/Leotju/CaSe.
Multi-Grained Deep Feature Learning for Pedestrian Detection

Chunze Lin,Jiwen Lu,Jie Zhou

DOI: https://doi.org/10.1109/icme.2018.8486498

2018-01-01

Abstract:In this paper, we address the challenging problem of detecting pedestrians who are heavily occluded or far from camera. Unlike most existing pedestrian detection methods which only use coarse-resolution feature maps with fixed receptive field, our approach exploits multi-grained deep features to make the detector more robust to visible parts of occluded pedestrians and small-size targets. Specifically, we jointly train a scale-aware network and a human parsing network in a semi-supervised manner with only bounding box annotation. We carefully design the scale-aware network to predict pedestrians of particular scales using most appropriate feature maps, by matching their receptive field with the target sizes. The human parsing network generates a fine-grained attentional map which helps guide the detector to focus on the visible parts of occluded pedestrians and small-size instances. Both networks are computed in parallel and form an unified single stage pedestrian detector, which assures a great trade-off between accuracy and speed. Experiments on two challenging benchmarks, Caltech and KITTI, demonstrate the effectiveness of our proposed approach, which in addition, executes 2× faster than competitive methods.
Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

Rui Zhao,Jutao Hao,Huan Huo

DOI: https://doi.org/10.3390/fi16060194

2024-05-31

Future Internet

Abstract:In the realm of intelligent transportation, pedestrian detection has witnessed significant advancements. However, it continues to grapple with challenging issues, notably the detection of pedestrians in complex lighting scenarios. Conventional visible light mode imaging is profoundly affected by varying lighting conditions. Under optimal daytime lighting, visibility is enhanced, leading to superior pedestrian detection outcomes. Conversely, under low-light conditions, visible light mode imaging falters due to the inadequate provision of pedestrian target information, resulting in a marked decline in detection efficacy. In this context, infrared light mode imaging emerges as a valuable supplement, bolstering pedestrian information provision. This paper delves into pedestrian detection and tracking algorithms within a multi-modal image framework grounded in deep learning methodologies. Leveraging the YOLOv4 algorithm as a foundation, augmented by a channel stack fusion module, a novel multi-modal pedestrian detection algorithm tailored for intelligent transportation is proposed. This algorithm capitalizes on the fusion of visible and infrared light mode image features to enhance pedestrian detection performance amidst complex road environments. Experimental findings demonstrate that compared to the Visible-YOLOv4 algorithm, renowned for its high performance, the proposed Double-YOLOv4-CSE algorithm exhibits a notable improvement, boasting a 5.0% accuracy rate enhancement and a 6.9% reduction in logarithmic average missing rate. This research's goal is to ensure that the algorithm can run smoothly even on a low configuration 1080 Ti GPU and to improve the algorithm's coverage at the application layer, making it affordable and practical for both urban and rural areas. This addresses the broader research problem within the scope of smart cities and remote ends with limited computational power.
MM_Fast_RCNN_ResNet: Construction of Multimodal Faster RCNN Inception and ResNet V2 for Pedestrian Tracking and detection

Johnson Kolluri,Sandeep Kumar Dash,Ranjita Das

DOI: https://doi.org/10.5750/ijme.v1i1.1381

2024-07-27

Abstract:Pedestrian identification and tracking is a crucial duty in smart building monitoring. The development of sensors has led to architects' focus on smart building design. The image distortions caused by numerous external environmental factors present a significant problem for pedestrian recognition in smart buildings. It is difficult for machine learning algorithms and other conventional filter-based image classification methods, such as histograms of oriented gradient filters, to function efficiently when dealing with many input photos of pedestrians. Deep learning algorithms are now performing substantially better when processing an enormous amount of image data. This article evaluates a novel multimodal classifier-based pedestrian identification method. The proposed method is Multimodal Faster RCNN Inception and ResNet V2 (MM Fast RCNN ResNet). The collected attributes address a tracking problem and establish the foundation for several object recognition tasks (novelty). Our method's neural network is regularized, and the feature representation is automatically adjusted to the detection assignment, resulting in high accuracy (superior to the proposed method). The proposed method is assessed using the PenFudan dataset and contemporary techniques regarding several factors. It is discovered that the recommended MM Fast RCNN ResNet obtains precision, recall, FPPI, FPPW, and average precision of 0.9057, 0.8629, 0.0898, and 0.0943.

engineering, marine
Fast Pedestrian Detection with Attention-Enhanced Multi-Scale RPN and Soft-Cascaded Decision Trees

Han Wang,Yali Li,Shengjin Wang

DOI: https://doi.org/10.1109/tits.2019.2948398

IF: 8.5

2019-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Pedestrian detection has attracted more attention in the fields of computer vision and artificial intelligence. A variety of real-world applications involving pedestrian detection have been promoted, such as Advanced Driving Assistant System (ADAS). Although both two-stage and single-stage deeply learned object detectors have shown outstanding performance for general object detection, they are still facing the problem of poor accuracy in single-class detection senario because they are designed to distinguish objects from different categories rather than pay attention to various appearances of pedestrians. Previous leading pedestrian detectors F-DNN and F-DNN v2 fuse several neural networks like SSD, VGG16 and GoogLeNet to generate ROIs and supress false alarms with cascaded structure, resulting in low miss rate but high complexity. In this paper we propose a novel framework called Attention-Enhanced Multi-Scale Region Proposal Network (AEMS-RPN) for ROI generation, which also acts as first-stage classification. Inspired by the success of traditional pedestrian detectors, we use soft-cascaded decision trees instead of cascaded deep neural networks to achieve high accuracy and fast detection speed simultaneously. The decision tree classifier is used and enables us to combine features from different layers with various resolutions for classification and incorporate effective bootstrapping for mining hard negatives. We test our method on several pedestrian detection datasets and the experimental results certify the effectiveness of the proposed AEMS-RPN. Compared with the state-of-the-art, we obtain the competitive accuracy with near real-time efficiency.
Robust multi-modal pedestrian detection using deep convolutional neural network with ensemble learning model

Deepak Kumar Jain,Xudong Zhao,Salvador Garcia,Subramani Neelakandan

DOI: https://doi.org/10.1016/j.eswa.2024.123527

IF: 8.5

2024-09-01

Expert Systems with Applications

Abstract:In the realm of video surveillance systems, pedestrian detection (PD) is a crucial task that enables the identification and tracking of individuals, crowd monitoring, and people counting. However, accurate PD is a challenging task due to variations in the appearance and pose of pedestrians. With the advent of deep learning (DL) techniques, particularly convolutional neural networks (CNNs), computer vision (CV) methods for object classification and detection have been revolutionized. Effective PD depends on supervised learning, which requires large labeled datasets. This paper, we present pedestrian detection (PD) using a Robust Multi-modal Pedestrian Detection using a Deep Convolutional Neural Network with an Ensemble Learning (RMPD-DCNN-EL) model. This model effects computer vision and ensemble learning to accomplish precise pedestrian detection. The SimAM EfficientNet model with a stochastic gradient descent (SGD) optimizer is used for feature extraction, while ensemble classification is performed using three DL models are Nested Long Short-Term Memory (NLSTM), deep belief networks (DBNs), and extreme learning machine (ELM). To evaluate the effectiveness of tettapproach, we use the INRIA dataset, and the experimental results prove the greater performance of RMPD-DCNN-EL over other DL methods. The proposed method enables robust pedestrian detection despite modifications in arrival and pose, making it an operative solution for video surveillance systems in smart transport environments. Experimental results show that the detection accuracy is 99.30% of the proposed algorithm is considerably higher than that of the traditional convolutional neural network algorithm.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Pushing the Limits of Deep CNNs for Pedestrian Detection

Qichang Hu,Peng Wang,Chunhua Shen,Anton van den Hengel,Fatih Porikli

DOI: https://doi.org/10.48550/arXiv.1603.04525

2016-06-06

Abstract:Compared to other applications in computer vision, convolutional neural networks have under-performed on pedestrian detection. A breakthrough was made very recently by using sophisticated deep CNN models, with a number of hand-crafted features, or explicit occlusion handling mechanism. In this work, we show that by re-using the convolutional feature maps (CFMs) of a deep convolutional neural network (DCNN) model as image features to train an ensemble of boosted decision models, we are able to achieve the best reported accuracy without using specially designed learning algorithms. We empirically identify and disclose important implementation details. We also show that pixel labelling may be simply combined with a detector to boost the detection performance. By adding complementary hand-crafted features such as optical flow, the DCNN based detector can be further improved. We set a new record on the Caltech pedestrian dataset, lowering the log-average miss rate from $11.7\%$ to $8.9\%$, a relative improvement of $24\%$. We also achieve a comparable result to the state-of-the-art approaches on the KITTI dataset.

Computer Vision and Pattern Recognition
Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism

Zhao Bin,Wang Chunping,Fu Qiang,Chen Yichao

DOI: https://doi.org/10.3788/aos202040.0504001

2020-01-01

Acta Optica Sinica

Abstract:In this paper, for multi-scale target detection, a multi-scale infrared pedestrian detection method based on deep attention mechanism is proposed. The lightweight Darknet53 is adopted as the backbone network for deep convolutional features extracting, and a four-scale feature pyramid network is constructed to classify and localize objects. The detection performance with respect to small-scale objects such as pedestrians is improved by introducing low-level and high-resolution feature maps. Furthermore, an attention module is designed to replace the traditional upsampling block in the feature pyramid network, which generate local saliency map based on convolution feature, thus suppress the feature responses of unrelated areas and highlight the local feature of the image. Finally, the Caltech pedestrian and U-FOV infrared pedestrian datasets arc used to execute two-step transfer learning to ensure the generalization of the proposed model and improve the pedestrian features. The results show that the average precision of the proposed method is 93.45% on the U-FOV dataset, which is 26.74 percentage higher than that obtained using YOLOv3, and the minimum pixel size of the pedestrian that can be detected is 6 x 13. In addition, the qualitative experiment results obtained using the LTIR dataset validate the good generalization of the proposed model, which makes it suitable for multi-scale infrared pedestrian detection.
DETR for Pedestrian Detection.

Matthieu Lin,Chuming Li,Xingyuan Bu,Ming Sun,Chen Lin,Junjie Yan,Wanli Ouyang,Zhidong Deng

2020-01-01

Abstract:Pedestrian detection in crowd scenes poses a challenging problem due to the heuristic defined mapping from anchors to pedestrians and the conflict between NMS and highly overlapped pedestrians. The recently proposed end-to-end detectors(ED), DETR and deformable DETR, replace hand designed components such as NMS and anchors using the transformer architecture, which gets rid of duplicate predictions by computing all pairwise interactions between queries. Inspired by these works, we explore their performance on crowd pedestrian detection. Surprisingly, compared to Faster-RCNN with FPN, the results are opposite to those obtained on COCO. Furthermore, the bipartite match of ED harms the training efficiency due to the large ground truth number in crowd scenes. In this work, we identify the underlying motives driving ED's poor performance and propose a new decoder to address them. Moreover, we design a mechanism to leverage the less occluded visible parts of pedestrian specifically for ED, and achieve further improvements. A faster bipartite match algorithm is also introduced to make ED training on crowd dataset more practical. The proposed detector PED(Pedestrian End-to-end Detector) outperforms both previous EDs and the baseline Faster-RCNN on CityPersons and CrowdHuman. It also achieves comparable performance with state-of-the-art pedestrian detection methods. Code will be released soon.
Pedestrian Detection Aided by Scale-Discriminative Network.

Zongqing Lu,Wenjian Zhang,Qingmin Liao

DOI: https://doi.org/10.1109/ssci.2016.7850112

2016-01-01

Abstract:Deep learning is greatly successful when used for pedestrian detection. However, we find that this method is barely satisfactory for multi-scale detection. Meanwhile, various solutions such as multi-scale classifiers have been developed (based on traditional methods) to handle this situation. Considering this, we propose a scale-discriminative classifier layer (SDC) that contains numerous classifiers to cope with different scales. To expand the capacity for small-scale pedestrian detection, we construct a full-scale layer that converges both high-level semantic features and low-level features. From the analysis above, a scale-discriminative network (SDN) for pedestrian detection was born. We apply this network to the Caltech pedestrian dataset, and the experimental results show that the SDN achieves state-of-the-art performance.
Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

Xiaotao Shao,Qing Wang,Wei Yang,Yun Chen,Yi Xie,Yan Shen,Zhongli Wang

DOI: https://doi.org/10.3390/s21051820

IF: 3.9

2021-03-05

Sensors

Abstract:The existing pedestrian detection algorithms cannot effectively extract features of heavily occluded targets which results in lower detection accuracy. To solve the heavy occlusion in crowds, we propose a multi-scale feature pyramid network based on ResNet (MFPN) to enhance the features of occluded targets and improve the detection accuracy. MFPN includes two modules, namely double feature pyramid network (FPN) integrated with ResNet (DFR) and repulsion loss of minimum (RLM). We propose the double FPN which improves the architecture to further enhance the semantic information and contours of occluded pedestrians, and provide a new way for feature extraction of occluded targets. The features extracted by our network can be more separated and clearer, especially those heavily occluded pedestrians. Repulsion loss is introduced to improve the loss function which can keep predicted boxes away from the ground truths of the unrelated targets. Experiments carried out on the public CrowdHuman dataset, we obtain 90.96% AP which yields the best performance, 5.16% AP gains compared to the FPN-ResNet50 baseline. Compared with the state-of-the-art works, the performance of the pedestrian detection system has been boosted with our method.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Multispectral Deep Neural Networks for Pedestrian Detection

Jingjing Liu,Shaoting Zhang,Shu Wang,Dimitris N. Metaxas

DOI: https://doi.org/10.48550/arXiv.1611.02644

2016-11-09

Abstract:Multispectral pedestrian detection is essential for around-the-clock applications, e.g., surveillance and autonomous driving. We deeply analyze Faster R-CNN for multispectral pedestrian detection task and then model it into a convolutional network (ConvNet) fusion problem. Further, we discover that ConvNet-based pedestrian detectors trained by color or thermal images separately provide complementary information in discriminating human instances. Thus there is a large potential to improve pedestrian detection by using color and thermal images in DNNs simultaneously. We carefully design four ConvNet fusion architectures that integrate two-branch ConvNets on different DNNs stages, all of which yield better performance compared with the baseline detector. Our experimental results on KAIST pedestrian benchmark show that the Halfway Fusion model that performs fusion on the middle-level convolutional features outperforms the baseline method by 11% and yields a missing rate 3.5% lower than the other proposed architectures.

Computer Vision and Pattern Recognition

Alpha 2 adrenergic receptor subtypes in depression: a candidate gene study.

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond

Deep convolutional neural networks for pedestrian detection

Accurate Pedestrian Detection by Human Pose Regression

Too Far to See? Not Really! --- Pedestrian Detection with Scale-aware Localization Policy

Pedestrian detection by multiple decision-based neural networks

Pedestrian Detection Using Multi-Channel Visual Feature Fusion by Learning Deep Quality Model.

Pedestrian Detection Based on Hand-crafted Features and Multi-layer Feature Fused-ResNet Model

Count- and Similarity-Aware R-CNN for Pedestrian Detection

Multi-Grained Deep Feature Learning for Pedestrian Detection

Research on Multi-Modal Pedestrian Detection and Tracking Algorithm Based on Deep Learning

MM_Fast_RCNN_ResNet: Construction of Multimodal Faster RCNN Inception and ResNet V2 for Pedestrian Tracking and detection

Fast Pedestrian Detection with Attention-Enhanced Multi-Scale RPN and Soft-Cascaded Decision Trees

Robust multi-modal pedestrian detection using deep convolutional neural network with ensemble learning model

Pushing the Limits of Deep CNNs for Pedestrian Detection

Multi-Scale Infrared Pedestrian Detection Based on Deep Attention Mechanism

DETR for Pedestrian Detection.

Pedestrian Detection Aided by Scale-Discriminative Network.

Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

Multispectral Deep Neural Networks for Pedestrian Detection