Image Retrieval via Gated Multiscale NetVLAD for Social Media Applications

Yunyin Cao,Jian Zhang,Jun Yu,Yang Wang
DOI: https://doi.org/10.1109/mmul.2020.3015990
IF: 3.4911
2020-10-01
IEEE Multimedia
Abstract:Image retrieval on the social media platforms propels the tourism information sharing on the Internet. Existing image retrieval methods lack the capability of discovering global statistical distribution of feature representations at multiple scales. In this article, we propose a gated multiscale NetVLAD network, which constructs feature pyramid network based on ResNet backbone and computes NetVLAD features at each pyramid level to capture the multiscale information. In addition, we use gate mechanism for each level of the pyramid to adaptively represent the contribution of each level of features to the retrieval task. Experimental results on CIFAR-10, MNIST, and the Google street view datasets show that our image retrieval method has achieved better results than several existed methods.
computer science, information systems, theory & methods, software engineering, hardware & architecture
What problem does this paper attempt to address?