Abstract:With the advancement of assisted and autonomous driving technologies, vehicles are being outfitted with an ever-increasing number of sensors. Among these, visible light sensors, or dash-cameras, produce visual data rich in information. Analyzing this visual data through crowdsensing allows for low-cost and timely perception of urban road conditions, such as identifying dangerous driving behaviors and locating parking spaces. However, uploading such massive visual data to the cloud for centralized processing can lead to significant bandwidth challenges and also raise privacy concerns among vehicle owners. Federated learning (FL), in which vehicles serve as both data generators and computing nodes, presents a promising solution to address these challenges. Nevertheless, urban roads are complex and vehicles in different locations encounter completely different scenes, resulting in non-i.i.d. (non-independently and identically distributed) characteristics. Additionally, the diversity in dash-camera and onboard computation resources may lead to differences in the performance of locally trained models. Indiscriminate aggregating of local models from all vehicles can potentially degrade the global models performance. To overcome these challenges, we introduce FedVisual, a model aggregation approach for FL in vehicular visual crowdsensing. FedVisual leverages deep Q-Network (DQN) to select appropriate local models, considering the heterogeneities in visual data contents and vehicles specifications. By leveraging the historical training experience, an effective model selection strategy can be obtained without complex mathematical modeling. Through the extensive simulations of our self-collected driving videos, FedVisual reduces model aggregation latency by up to 3.8% while improving the models performance by up to 3.2% compared to reference works.

Enhancing Federated Learning in Heterogeneous Internet of Vehicles: A Collaborative Training Approach

Communication and Computation Efficient Federated Learning for Internet of Vehicles with a Constrained Latency

Matching Game for Multi-task Federated Learning in Internet of Vehicles

Resource Management and Optimization in Internet of Vehicles for Hierarchical Federated Learning

Mitigating straggler effect in federated learning based on reconfigurable intelligent surface over Internet of Vehicles

Federated Learning Framework Coping with Hierarchical Heterogeneity in Cooperative ITS

Mobility, Communication and Computation Aware Federated Learning for Internet of Vehicles

Hierarchical Decentralized Federated Learning Framework with Adaptive Clustering: Bloom-Filter-Based Companions Choice for Learning Non-IID Data in IoV

Efficient Asynchronous Federated Learning Research in the Internet of Vehicles

Adaptive and Parallel Split Federated Learning in Vehicular Edge Computing

Adaptive Scheduling for Internet of Vehicles Using Deconfounded Graph Transfer Learning

On the Federated Learning Framework for Cooperative Perception

Mobility-Aware Asynchronous Federated Learning for Edge-Assisted Vehicular Networks.

FedVisual: Heterogeneity-Aware Model Aggregation for Federated Learning in Visual-Based Vehicular Crowdsensing

Hierarchical Federated Learning: Architecture, Challenges, and Its Implementation in Vehicular Networks

Distributed client selection with multi-objective in federated learning assisted Internet of Vehicles

On Addressing Heterogeneity in Federated Learning for Autonomous Vehicles Connected to a Drone Orchestrator

Joint Optimization of Model Partition and Resource Allocation for Split Federated Learning Over Vehicular Edge Networks

Mobility Accelerates Learning: Convergence Analysis on Hierarchical Federated Learning in Vehicular Networks

Clustered Vehicular Federated Learning: Process and Optimization

Multi-Objective Distributed Client Selection in Federated Learning-Assisted Internet of Vehicles