Discriminative Information Restoration and Extraction for Weakly Supervised Low-Resolution Fine-Grained Image Recognition

Tiantian Yan,Jian Shi,Haojie Li,Zhongxuan Luo,Zhihui Wang
DOI: https://doi.org/10.1016/j.patcog.2022.108629
IF: 8
2022-01-01
Pattern Recognition
Abstract:The existing methods of fine-grained image recognition mainly devote to learning subtle yet discrimina-tive features from the high-resolution input. However, their performance deteriorates significantly when they are used for low quality images because a lot of discriminative details of images are missing. We propose a discriminative information restoration and extraction network, termed as DRE-Net, to address the problem of low-resolution fine-grained image recognition, which has widespread application poten-tial, such as shelf auditing and surveillance scenarios. DRE-Net is the first framework for weakly super -vised low-resolution fine-grained image recognition and consists of two sub-networks: (1) fine-grained discriminative information restoration sub-network (FDR) and (2) recognition sub-network with the se-mantic relation distillation loss (SRD-loss). The first module utilizes the structural characteristic of mini-mum spanning tree (MST) to establish context information for each pixel by employing the spatial struc-tures between each pixel and other pixels, which can help FDR focus on and restore the critical texture details. The second module employs the SRD-loss to calibrate recognition sub-network by transferring the correct relationships between every two pixels on the feature map. Meanwhile the SRD-loss can fur-ther prompt the FDR to recover reliable and accurate fine-grained details and guide the recognition sub-network to perceive the discriminative features from the correct relationships. Extensive experiments on three benchmark datasets and one retail product dataset demonstrate the effectiveness of our proposed framework.(c) 2022 Published by Elsevier Ltd.
What problem does this paper attempt to address?