DSSN: dual shallow Siamese network for fashion image retrieval

Sk Maidul Islam,Subhankar Joardar,Arif Ahmed Sekh
DOI: https://doi.org/10.1007/s11042-022-14204-0
IF: 2.577
2022-11-13
Multimedia Tools and Applications
Abstract:Image retrieval is a way to search similar images from a given query image. The method successfully applied to different fashion image retrieval over different garments and footwear. However, research over complex fashion products such as ornaments have not got much momentum due to the complex nature of similarity and unavailability of suitable datasets. In this paper we have proposed a Dual Shallow Siamese Network (DSSN) for the task. The model has two identical Siamese networks and takes the same images as input but in a different representation. One subnetwork takes input as RGB color images and the other as identical segmented images. First, the networks are trained using positive and negative image pairs. Next, the trained model is used to find the difference between gallery and query images. The similarity score of the Siamese networks are then fused using weighted averaging. The method is applied on two public datasets, namely, RingFIR (earring dataset) and UT-Zap50K (footwear dataset). We have compared the retrieval accuracy of our method with other state-of-the-art image retrieval methods. The result shows that our method outperforms state-of-the-art methods. The source code and dataset is available publicly (https://github.com/skarifahmed/DSSN).
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
What problem does this paper attempt to address?