Abstract:Pedestrian detection currently suffers from two issues in crowded scenes: occlusion and dense boundary prediction, making it still challenging in complex real-world scenarios. In recent years, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have shown their superiorities in addressing these issues, where ViTs capture global feature dependency to infer occlusion parts and CNNs make accurate dense predictions by local detailed features. Nevertheless, limited by the narrow receptive field, CNNs fail to infer occlusion parts, while ViTs tend to ignore local features that are vital to distinguish different pedestrians in the crowd. Therefore, it is essential to combine the advantages of CNN and ViT for pedestrian detection. However, manually designing a specific CNN and ViT hybrid network requires enormous time and resources for trial and error. To address this issue, we propose the first Neural Architecture Search (NAS) framework specifically designed for pedestrian detection named NAS-PED, which automatically designs an appropriate CNNs and ViTs hybrid backbone for the crowded pedestrian detection task. Specifically, we formulate transformers and convolutions with various kernel sizes in the same format, which provides an unconstrained space for diverse hybrid network search. Furthermore, to search for a suitable backbone, we propose an information bottleneck based NAS objective function, which treats the process of NAS as an information extraction process, preserving relevant information and suppressing redundant information from the dense pedestrians in crowd scenes Extensive experiments on CrowdHuman, CityPersons and EuroCity Persons datasets demonstrate the effectiveness of the proposed method. Our NAS-PED obtains absolute gains of 4.0% MR $^{-2}$ and 1.9% AP over the state-of-the-art (SOTA) pedestrian detection framework on CrowdHuman datasets. For the CityPersons and EuroCity Persons datasets, the searched backbone achieves stable improvement across all three subsets, outperforming some large language-image pre-trained models. Code will be released after acceptance.

MOD-NAS: Migration-Based Object Detection Neural Architecture Search

NAS-EOD: an End-to-end Neural Architecture Search Method for Efficient Object Detection.

SP-NAS: Serial-to-Parallel Backbone Search for Object Detection

SM-NAS: Structural-to-Modular Neural Architecture Search for Object Detection

NAS-FCOS: Efficient Search for Object Detection Architectures

NAS-FCOS: Fast Neural Architecture Search for Object Detection

Efficient Neural Architecture Transformation Searchin Channel-Level for Object Detection

Auto-FPN: Automatic Network Architecture Adaptation for Object Detection Beyond Classification

Multi-Objective Evolutionary for Object Detection Mobile Architectures Search

Surrogate-assisted Multi-objective Neural Architecture Search for Real-time Semantic Segmentation

NAS-PED: Neural Architecture Search for Pedestrian Detection

Multi-Objective Neural Architecture Search for Light-Weight Model

Point-NAS: A Novel Neural Architecture Search Framework for Point Cloud Analysis.

AutoSpace: Neural Architecture Search with Less Human Interference

Obstacle Detection System for Navigation Assistance of Visually Impaired People Based on Deep Learning Techniques

Nas-Hris: Automatic Design And Architecture Search Of Neural Network For Semantic Segmentation In Remote Sensing Images

PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search

FBNetV5: Neural Architecture Search for Multiple Tasks in One Run

NAS-ASDet: An Adaptive Design Method for Surface Defect Detection Network using Neural Architecture Search

Efficient Visual Fault Detection for Freight Train via Neural Architecture Search with Data Volume Robustness