Abstract:One key in image quality assessment (IQA) is the design of image representations that can capture the changes in image structures caused by distortions. In the last decades, local binary patterns (LBP) have been proven to be a powerful tool as a statistical model for texture and local structure representation. LBP and its variants, as the texture descriptor with low computational complexity, have been applied widely and successfully in several specific applications, such as texture classification, face recognition and IQA. Generally, visible impairments alter the statistics of LBP descriptors, making it possible to measure degradation and then estimate image quality. However, only a few variants of LBP are applied in no-reference (NR) IQA and a few characteristics of LBP descriptors are explored for quality prediction, while some characteristics useful in the rest variants are ignored for IQA. Two previous studies give a review of 16/4 LBP operators and compare the performance with them separately in IQA application only on synthetic distorted data. To extend this work, we provide a review of LBP methodologies to assist the scientific community and new researchers, as well as explore more LBP descriptors in NR-IQA methods under various distortion conditions, particularly real-world cases. Specifically, we comprehensively review 30 widely-used or effective LBP-based operators, including recent variations. We then utilize a common framework for applying LBP descriptors in NR-IQA. The practicality of the reviewed descriptors is demonstrated and analyzed using experimental results under synthetic and authentic cases, indicating suitable LBP descriptors and characteristics for NR-IQA. Codes implementing the reviewed LBP operators is available at https://github.com/csxwan/Local-Binary-Patterns-for-IQA.

Blind Image Quality Assessment Based on Local Quantized Pattern

Blind Quality Assessment for Screen Content Images by Combining Local and Global Features

Learning A Blind Image Quality Index Based On Visual Saliency Guided Sampling And Gabor Filtering

Blind Image Quality Assessment Using the Joint Statistics of Generalized Local Binary Pattern

No-reference Image Quality Assessment with Center-Surround Based Natural Scene Statistics

No Training Blind Image Quality Assessment.

Bag-of-words Feature Representation for Blind Image Quality Assessment with Local Quantized Pattern.

A Feature-Enriched Completely Blind Image Quality Evaluator

Blind Image Quality Assessment for Noise

No Reference Image Quality Assessment Based On Local Binary Pattern Statistics

Training Quality-Aware Filters for No-Reference Image Quality Assessment

Learning to integrate local and global features for a blind image quality measure

No-Reference Image Quality Assessment Using Local Binary Patterns: A Comprehensive Performance Evaluation

A Complete No-Reference Image Quality Assessment Method Based on Local Feature

Blind Image Quality Assessment with Complete Pixel-Level Information

Blind Image Quality Assessment in the Contourlet Domain

Blind image quality assessment with improved natural scene statistics model.

No-reference image quality assessment based on natural scene statistics and gradient magnitude similarity

Using Free Energy Principle for Blind Image Quality Assessment

A New Blind Image Quality Assessment Based on Pairwise.

Fast image quality assessment via supervised iterative quantization method.