Abstract:Autonomous vehicles are a promising solution to traffic congestion, air pollution, accidents, and wasted time and resources. However, remote driver intervention may be necessary for extreme situations to ensure safe roadside parking or complete remote takeover. In such cases, high-quality real-time video streaming is crucial for practical remote driving. In a preliminary study, we already presented a region of interest (ROI) HEVC data compression where the image was segmented into two categories of ROI and background, allocating more bandwidth to the ROI, yielding an improvement in the visibility of the classes that essential for driving while transmitting the background with lesser quality. However, migrating bandwidth to the large ROI portion of the image doesn't substantially improve the quality of traffic signs and lights. This work categorized the ROIs into either background, weak ROI, or strong ROI. The simulation-based approach uses a photo-realistic driving scenario database created with the Cognata self-driving car simulation platform. We use semantic segmentation to categorize the compression quality of a Coding Tree Unit (CTU) according to each pixel class. A background CTU can contain only sky, trees, vegetation, or building classes. Essentials for remote driving include significant classes such as roads, road marks, cars, and pedestrians. And most importantly, traffic signs and traffic lights. We apply thresholds to decide if the number of pixels in a CTU of a particular category is enough to declare it as belonging to the strong or weak ROI. Then, we allocate the bandwidth according to the CTU categories. Our results show that the perceptual quality of traffic signs, especially textual signs and traffic lights, improves significantly by up to 5.5 dB compared to the only background and foreground partition, while the weak ROI classes at least retain their original quality.

Influence of AVC and HEVC Compression on Detection of Vehicles Through Faster R-CNN

Slim-FCP: Lightweight-Feature-Based Cooperative Perception for Connected Automated Vehicles

An Efficient Compressive Convolutional Network for Unified Object Detection and Image Compression

3D Vehicle Detection Using Cheap LiDAR and Camera Sensors.

Traffic Sign Detection With Event Cameras and DCNN

Multi-Cue Vehicle Detection for Semantic Video Compression In Georegistered Aerial Videos

Beamforming and Scalable Image Processing in Vehicle-to-Vehicle Networks

An Optimized DNN Model for Real-Time Inferencing on an Embedded Device

DMVC: Multi-Camera Video Compression Network aimed at Improving Deep Learning Accuracy

A Compressive Sensing Approach for Connected Vehicle Data Capture and Recovery and its Impact on Travel Time Estimation

Rate-Accuracy Trade-Off In Video Classification With Deep Convolutional Neural Networks

Optimizing traffic signs and lights visibility for the teleoperation of autonomous vehicles through ROI compression

An algorithm for highway vehicle detection based on convolutional neural network

Impact of LiDAR point cloud compression on 3D object detection evaluated on the KITTI dataset

Efficient Data Collection and Accurate Travel Time Estimation in a Connected Vehicle Environment Via Real-Time Compressive Sensing

Optimization of User Service Rate with Image Compression in Edge Computing-Based Vehicular Networks

Learned Multimodal Compression for Autonomous Driving

Controllable Model Compression for Roadside Camera Depth Estimation

Exploiting Richness of Learned Compressed Representation of Images for Semantic Segmentation

A Study on the Impact of Multi-view Distributed Feature Coding on a Multi-camera Vehicle Tracking System at Roundabouts

Collaborative processing and data optimization of environmental perception technologies for autonomous vehicles