Abstract:With the advancement of assisted and autonomous driving technologies, vehicles are being outfitted with an ever-increasing number of sensors. Among these, visible light sensors, or dash-cameras, produce visual data rich in information. Analyzing this visual data through crowdsensing allows for low-cost and timely perception of urban road conditions, such as identifying dangerous driving behaviors and locating parking spaces. However, uploading such massive visual data to the cloud for centralized processing can lead to significant bandwidth challenges and also raise privacy concerns among vehicle owners. Federated learning (FL), in which vehicles serve as both data generators and computing nodes, presents a promising solution to address these challenges. Nevertheless, urban roads are complex and vehicles in different locations encounter completely different scenes, resulting in non-i.i.d. (non-independently and identically distributed) characteristics. Additionally, the diversity in dash-camera and onboard computation resources may lead to differences in the performance of locally trained models. Indiscriminate aggregating of local models from all vehicles can potentially degrade the global models performance. To overcome these challenges, we introduce FedVisual, a model aggregation approach for FL in vehicular visual crowdsensing. FedVisual leverages deep Q-Network (DQN) to select appropriate local models, considering the heterogeneities in visual data contents and vehicles specifications. By leveraging the historical training experience, an effective model selection strategy can be obtained without complex mathematical modeling. Through the extensive simulations of our self-collected driving videos, FedVisual reduces model aggregation latency by up to 3.8% while improving the models performance by up to 3.2% compared to reference works.

Toward Efficient and Secure Object Detection with Sparse Federated Training over Internet of Vehicles

Sparse Federated Training of Object Detection in the Internet of Vehicles

Sparse Federated Training of Object Detection in the Internet of Vehicles

FedPylot: Navigating Federated Learning for Real-Time Object Detection in Internet of Vehicles

Communication and Computation Efficient Federated Learning for Internet of Vehicles with a Constrained Latency

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

Improved YOLOV3 Surveillance Device Object Detection Method Based on Federated Learning

A Comprehensive Intrusion Detection Method for the Internet of Vehicles Based on Federated Learning Architecture

FedLVR: a federated learning-based fine-grained vehicle recognition scheme in intelligent traffic system

FedVisual: Heterogeneity-Aware Model Aggregation for Federated Learning in Visual-Based Vehicular Crowdsensing

Enhancing Federated Learning in Heterogeneous Internet of Vehicles: A Collaborative Training Approach

Accurate and Efficient Federated-Learning-Based Edge Intelligence for Effective Video Analysis.

Two-Layer Federated Learning With Heterogeneous Model Aggregation for 6G Supported Internet of Vehicles.

Towards Efficient Learning Using Double-Layered Federation Based on Traffic Density for Internet of Vehicles

Adaptive Hierarchical Aggregation for Federated Object Detection

Federated Learning with Dynamic Staleness Correction for Privacy Protection in Vehicular Networks

Fast and Practical Intrusion Detection System Based on Federated Learning for VANET

Federated Learning with Heterogeneous Data Handling for Robust Vehicular Object Detection

Lightweight Object Detection Based on Autonomous Driving

Federated learning-powered visual object detection for safety monitoring

Secure Federated Learning with Efficient Communication in Vehicle Network