Abstract:360-degree/omnidirectional images (OIs) have achieved remarkable attentions due to the increasing applications of virtual reality (VR). Compared to conventional 2D images, OIs can provide more immersive experience to consumers, benefitting from the higher resolution and plentiful field of views (FoVs). Moreover, observing OIs is usually in the head mounted display (HMD) without references. Therefore, an efficient blind quality assessment method, which is specifically designed for 360-degree images, is urgently desired. In this paper, motivated by the characteristics of the human visual system (HVS) and the viewing process of VR visual contents, we propose a novel and effective no-reference omnidirectional image quality assessment (NR OIQA) algorithm by Multi-Frequency Information and Local-Global Naturalness (MFILGN). Specifically, inspired by the frequency-dependent property of visual cortex, we first decompose the projected equirectangular projection (ERP) maps into wavelet subbands. Then, the entropy intensities of low and high frequency subbands are exploited to measure the multi-frequency information of OIs. Besides, except for considering the global naturalness of ERP maps, owing to the browsed FoVs, we extract the natural scene statistics features from each viewport image as the measure of local naturalness. With the proposed multi-frequency information measurement and local-global naturalness measurement, we utilize support vector regression as the final image quality regressor to train the quality evaluation model from visual quality-related features to human ratings. To our knowledge, the proposed model is the first no-reference quality assessment method for 360-degreee images that combines multi-frequency information and image naturalness. Experimental results on two publicly available OIQA databases demonstrate that our proposed MFILGN outperforms state-of-the-art approaches.

No-reference Omnidirectional Image Quality Assessment via Equirectangular Convolution and Hierarchically Fusion.

OmiQnet: Multiscale feature aggregation convolutional neural network for omnidirectional image assessment

No-Reference Quality Assessment for 360-degree Images by Analysis of Multi-frequency Information and Local-global Naturalness

U-Shaped Transformer-Based 360-Degree No Reference Image Quality Assessment

Omnidirectional Image Quality Assessment with Knowledge Distillation

Blind Omnidirectional Image Quality Assessment with Viewport Oriented Graph Convolutional Networks

Eye Scanpath Prediction-Based No-Reference Quality Assessment of Omnidirectional Images

Omnidirectional Video Quality Assessment With Causal Intervention

Perception-Oriented U-Shaped Transformer Network for 360-Degree No-Reference Image Quality Assessment

Omnidirectional Image Quality Assessment by Distortion Discrimination Assisted Multi-Stream Network

Multi-viewport Based 3D Convolutional Neural Network for 360-Degree Video Quality Assessment

ST360IQ: No-Reference Omnidirectional Image Quality Assessment with Spherical Vision Transformers

Quality Assessment of Stereoscopic 360-degree Images from Multi-viewports

Attentive Deep Stitching and Quality Assessment for 360 $^{\circ }$ Omnidirectional Images

No-reference Video Quality Assessment Based on Spatiotemporal Slice Images and Deep Convolutional Neural Networks

Attentive Deep Image Quality Assessment for Omnidirectional Stitching

No-reference Image Quality Assessment with Center-Surround Based Natural Scene Statistics

Saliency and Depth-aware Full Reference 360-degree Image Quality Assessment

Stereoscopic Omnidirectional Image Quality Assessment Based on Predictive Coding Theory

Monocular and Binocular Interactions Oriented Deformable Convolutional Networks for Blind Quality Assessment of Stereoscopic Omnidirectional Images

Perceptual Quality Assessment of Omnidirectional Images