Task-Specific Normalization for Continual Learning of Blind Image Quality Models

Weixia Zhang,Kede Ma,Guangtao Zhai,Xiaokang Yang
DOI: https://doi.org/10.1109/tip.2024.3371349
IF: 10.6
2024-03-15
IEEE Transactions on Image Processing
Abstract:In this paper, we present a simple yet effective continual learning method for blind image quality assessment (BIQA) with improved quality prediction accuracy, plasticity-stability trade-off, and task-order/-length robustness. The key step in our approach is to freeze all convolution filters of a pre-trained deep neural network (DNN) for an explicit promise of stability, and learn task-specific normalization parameters for plasticity. We assign each new IQA dataset (i.e., task) a prediction head, and load the corresponding normalization parameters to produce a quality score. The final quality estimate is computed by a weighted summation of predictions from all heads with a lightweight -means gating mechanism. Extensive experiments on six IQA datasets demonstrate the advantages of the proposed method in comparison to previous training techniques for BIQA.
computer science, artificial intelligence,engineering, electrical & electronic
What problem does this paper attempt to address?