Dual Self-Paced Hashing for Image Retrieval
Yuan Sun,Yang Qin,Dezhong Peng,Zhenwen Ren,Chao Yang,Peng Hu
DOI: https://doi.org/10.1109/tmm.2024.3395969
IF: 7.3
2024-01-01
IEEE Transactions on Multimedia
Abstract:In recent years, image hashing has attracted more and more attention in practical retrieval applications due to its low storage cost and high query speed. Although existing hashing methods have achieved promising performance, they always treat both easy and hard points without discrimination, thus easily getting stuck into bad local minima, especially in the presence of noise or outliers. In this paper, we reveal that there exist dual difficulty levels hindering binarization in learning to hash, i.e., samples and bits. To overcome this problem, we propose a novel Dual Self-Paced Hashing method (DSPH) for image retrieval, which learns binary codes by not only evolving from 'easy' to 'hard' samples but also from 'easy' to 'hard' bits, mimicking the cognitive learning process from easy to difficult. Specifically, we endow each sample and bit with a weight to estimate the reliability/ ease of the row and column, respectively. Then both sampleand bit-level weighting are conducted on rows and columns of Hamming space to enforce the model focus on reliable/easy examples and bits. By gradually increasing the weights during model optimization, more samples and bits are automatically involved in training from 'easy' to 'hard' via our dual self-paced method, thereby alleviating the adverse impact caused by noises or outliers to learn robust hashing models. Extensive experiments are conducted on four benchmark datasets to demonstrate the superiority and robustness of the proposed DSPH. Our source code has been released at https://github.com/sunyuan-cs/DSPH.