Abstract:Autonomous vehicles are a promising solution to traffic congestion, air pollution, accidents, and wasted time and resources. However, remote driver intervention may be necessary for extreme situations to ensure safe roadside parking or complete remote takeover. In such cases, high-quality real-time video streaming is crucial for practical remote driving. In a preliminary study, we already presented a region of interest (ROI) HEVC data compression where the image was segmented into two categories of ROI and background, allocating more bandwidth to the ROI, yielding an improvement in the visibility of the classes that essential for driving while transmitting the background with lesser quality. However, migrating bandwidth to the large ROI portion of the image doesn't substantially improve the quality of traffic signs and lights. This work categorized the ROIs into either background, weak ROI, or strong ROI. The simulation-based approach uses a photo-realistic driving scenario database created with the Cognata self-driving car simulation platform. We use semantic segmentation to categorize the compression quality of a Coding Tree Unit (CTU) according to each pixel class. A background CTU can contain only sky, trees, vegetation, or building classes. Essentials for remote driving include significant classes such as roads, road marks, cars, and pedestrians. And most importantly, traffic signs and traffic lights. We apply thresholds to decide if the number of pixels in a CTU of a particular category is enough to declare it as belonging to the strong or weak ROI. Then, we allocate the bandwidth according to the CTU categories. Our results show that the perceptual quality of traffic signs, especially textual signs and traffic lights, improves significantly by up to 5.5 dB compared to the only background and foreground partition, while the weak ROI classes at least retain their original quality.

Studying the Effect of ROI on Image Quality Using ERPS

Study of Image Quality Using Event-Related Potentials Measurement.

Variable Rate ROI Image Compression Optimized for Visual Quality

ERP Component Analysis for Rapid Image Searching in Finer Categories

Influence of intensity feature on ROI extraction

Medical Image ROI Compression Based on JPEG/JPEG2000

A Study on the Relationship Between Event-Related Potentials and Image Quality Variation

Stereo image quality assessment based on visual attention

End-to-end Optimized ROI Image Compression.

A No-Reference Video Quality Assessment Metric Based on ROI

An Effective Method of Image Quality Protection Based on ROI Extraction

Unsupervised Regions of Interest Extraction for Color Image Compression

A multilevel region-of-interest based rate control scheme for video communication

ROI Extraction Based on Visual Salience and Visual Evaluation

An automatic ROI coding algorithm based on multi-resolution target detection

Region of interest image coding based on SPIHT

An Innovative Saliency Guided ROI Selection Model for Panoramic Images Compression

ROI Image Compression Algorithm for Reconnaissance Satellite Systems

ROI-CSNet: Compressive Sensing Network for ROI-aware Image Recovery

Optimizing traffic signs and lights visibility for the teleoperation of autonomous vehicles through ROI compression

Region of Interest-Based Coding Technique of Medical Images Using Varying Grading of Compression