Abstract:Accurate and efficient pedestrian detection is crucial for the intelligent transportation system regarding pedestrian safety and mobility, e.g., Advanced Driver Assistance Systems, and smart pedestrian crosswalk systems. Among all pedestrian detection methods, vision-based detection method is demonstrated to be the most effective in previous studies. However, the existing vision-based pedestrian detection algorithms still have two limitations that restrict their implementations, those being real-time performance as well as the resistance to the impacts of environmental factors, e.g., low illumination conditions. To address these issues, this study proposes a lightweight Illumination and Temperature-aware Multispectral Network (IT-MN) for accurate and efficient pedestrian detection. The proposed IT-MN is an efficient one-stage detector. For accommodating the impacts of environmental factors and enhancing the sensing accuracy, thermal image data is fused by the proposed IT-MN with visual images to enrich useful information when visual image quality is limited. In addition, an innovative and effective late fusion strategy is also developed to optimize the image fusion performance. To make the proposed model implementable for edge computing, the model quantization is applied to reduce the model size by 75% while shortening the inference time significantly. The proposed algorithm is evaluated by comparing with the selected state-of-the-art algorithms using a public dataset collected by in-vehicle cameras. The results show that the proposed algorithm achieves a low miss rate and inference time at 14.19% and 0.03 seconds per image pair on GPU. Besides, the quantized IT-MN achieves an inference time of 0.21 seconds per image pair on the edge device, which also demonstrates the potentiality of deploying the proposed model on edge devices as a highly efficient pedestrian detection algorithm.

Privacy-Preserving Pedestrian Detection for Smart City with Edge Computing

$\Mathrm{p}^{3}$: A Privacy-Preserving Perception Framework for Building Vehicle-Edge Perception Networks Protecting Data Privacy

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection

Differential Privacy in Edge Computing-Based Smart City Applications:Security Issues, Solutions and Future Directions

A Privacy-Preserving Deep Learning Scheme for Edge-enhanced Smart Homes

Privacy preserving video surveillance using pedestrian tracking mechanism.

Real-Time Pedestrian Detection on IoT Edge Devices: A Lightweight Deep Learning Approach

Accurate Image-Based Pedestrian Detection With Privacy Preservation

Learning from Differentially Private Neural Activations with Edge Computing

Privacy-Preserving Object Detection with Secure Convolutional Neural Networks for Vehicular Edge Computing

Data Loss and Reconstruction of Location Differential Privacy Protection Based on Edge Computing

Intrusion Detection Based on Data Privacy in Cloud-Edge Collaborative Computing Using Federated Learning

Multi-Layered Edge Computing Architecture of Smart Information System for Cross-View People Tracking

A privacy-preserving deep learning approach for face recognition with edge computing

Research on Pedestrian Detection Technology Based on Deep Learning Network Complexity

Federated Learning Model Training Mechanism with Edge Cloud Collaboration for Services in Smart Cities

Privacy-preserving Pedestrian Tracking using Distributed 3D LiDARs

PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes

A Smart, Efficient, and Reliable Parking Surveillance System With Edge Artificial Intelligence on IoT Devices

Privacy-preserving pedestrian tracking with path image inpainting and 3D point cloud features