Abstract:With the advancement of assisted and autonomous driving technologies, vehicles are being outfitted with an ever-increasing number of sensors. Among these, visible light sensors, or dash-cameras, produce visual data rich in information. Analyzing this visual data through crowdsensing allows for low-cost and timely perception of urban road conditions, such as identifying dangerous driving behaviors and locating parking spaces. However, uploading such massive visual data to the cloud for centralized processing can lead to significant bandwidth challenges and also raise privacy concerns among vehicle owners. Federated learning (FL), in which vehicles serve as both data generators and computing nodes, presents a promising solution to address these challenges. Nevertheless, urban roads are complex and vehicles in different locations encounter completely different scenes, resulting in non-i.i.d. (non-independently and identically distributed) characteristics. Additionally, the diversity in dash-camera and onboard computation resources may lead to differences in the performance of locally trained models. Indiscriminate aggregating of local models from all vehicles can potentially degrade the global models performance. To overcome these challenges, we introduce FedVisual, a model aggregation approach for FL in vehicular visual crowdsensing. FedVisual leverages deep Q-Network (DQN) to select appropriate local models, considering the heterogeneities in visual data contents and vehicles specifications. By leveraging the historical training experience, an effective model selection strategy can be obtained without complex mathematical modeling. Through the extensive simulations of our self-collected driving videos, FedVisual reduces model aggregation latency by up to 3.8% while improving the models performance by up to 3.2% compared to reference works.

Federated Learning with Heterogeneous Data Handling for Robust Vehicular Object Detection

A Distributed Aggregation Approach for Vehicular Federated Learning

FedVisual: Heterogeneity-Aware Model Aggregation for Federated Learning in Visual-Based Vehicular Crowdsensing

FedPylot: Navigating Federated Learning for Real-Time Object Detection in Internet of Vehicles

Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification

On Addressing Heterogeneity in Federated Learning for Autonomous Vehicles Connected to a Drone Orchestrator

LFGurad: A defense against label flipping attack in federated learning for vehicular network

FedRAV: Hierarchically Federated Region-Learning for Traffic Object Classification of Autonomous Vehicles

Clustered Vehicular Federated Learning: Process and Optimization

Mobility, Communication and Computation Aware Federated Learning for Internet of Vehicles

Mobility-Aware Federated Self-supervised Learning in Vehicular Network

Navigating Data Heterogeneity in Federated Learning A Semi-Supervised Federated Object Detection

Secure Hierarchical Federated Learning in Vehicular Networks Using Dynamic Client Selection and Anomaly Detection

Federated learning system on autonomous vehicles for lane segmentation

Fast-Convergent and Communication-Alleviated Heterogeneous Hierarchical Federated Learning in Autonomous Driving

A Secure Personalized Federated Learning Algorithm for Autonomous Driving

Distributed Dynamic Map Fusion via Federated Learning for Intelligent Networked Vehicles

Hierarchical Federated Learning: Architecture, Challenges, and Its Implementation in Vehicular Networks

Federated Learning for Misbehaviour Detection with Variational Autoencoders and Gaussian Mixture Models

Adaptive and Parallel Split Federated Learning in Vehicular Edge Computing

Enhancing Federated Learning in Heterogeneous Internet of Vehicles: A Collaborative Training Approach