Abstract:Due to recent advancements in virtual reality (VR) and augmented reality (AR), the demand for high quality immersive contents is a primary concern for production companies and consumers. Similarly, the topical record-breaking performance of deep learning in various domains of artificial intelligence has extended the attention of researchers to contribute to different fields of computer vision. To ensure the quality of immersive media contents using these advanced deep learning technologies, several learning based Stitched Image Quality Assessment methods have been proposed with reasonable performances. However, these methods are unable to localize, segment, and extract the stitching errors in panoramic images. Further, these methods used computationally complex procedures for quality assessment of panoramic images. With these motivations, in this paper, we propose a novel three-fold Deep Learning based No-Reference Stitched Image Quality Assessment (DLNR-SIQA) approach to evaluate the quality of immersive contents. In the first fold, we fined-tuned the state-of-the-art Mask R-CNN (Regional Convolutional Neural Network) on manually annotated various stitching error-based cropped images from the two publicly available datasets. In the second fold, we segment and localize various stitching errors present in the immersive contents. Finally, based on the distorted regions present in the immersive contents, we measured the overall quality of the stitched images. Unlike existing methods that only measure the quality of the images using deep features, our proposed method can efficiently segment and localize stitching errors and estimate the image quality by investigating segmented regions. We also carried out extensive qualitative and quantitative comparison with full reference image quality assessment (FR-IQA) and no reference image quality assessment (NR-IQA) on two publicly available datasets, where the proposed system outperformed the existing state-of-the-art techniques.

A no-reference 3D virtual reality image quality assessment algorithm based on saliency statistics

SCVS: Blind Image Quality Assessment Based on Spatial Correlation and Visual Saliency

No-Reference Image Quality Assessment in the Spatial Domain

No-reference stereoscopic image quality assessment using 3D visual saliency maps fused with three-channel convolutional neural network

No-reference stereoscopic image quality assessment based on binocular collaboration

Reduced-Reference 3D Image Quality Measurement via Spatial to Gradient Domain Feature Aggregation

Saliency and Depth-aware Full Reference 360-degree Image Quality Assessment

No-Reference Quality Assessment for 360-degree Images by Analysis of Multi-frequency Information and Local-global Naturalness

3D No-Reference Image Quality Assessment Via Transfer Learning and Saliency-Guided Feature Consolidation.

Study of 3D Virtual Reality Picture Quality

FOVQA: Blind Foveated Video Quality Assessment

Perceptual Quality Assessment of Omnidirectional Images

Full Reference Image Quality Assessment Based on Visual Salience with Color Appearance and Gradient Similarity

Saliency Inspired Quality Assessment of Stereoscopic 3D Video

Blind stereoscopic image quality assessment using 3D saliency selected binocular perception and 3D convolutional neural network

Eye Scanpath Prediction-Based No-Reference Quality Assessment of Omnidirectional Images

Quality Assessment for Virtual Reality Technology Based on Real Scene.

No-Reference Quality Assessment for 3D Colored Point Cloud and Mesh Models

No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction

DLNR-SIQA: Deep Learning-Based No-Reference Stitched Image Quality Assessment

No-Reference Image Quality Assessment Using Independent Component Analysis and Convolutional Neural Network