Abstract:Visual search is of great assistance in reseller commerce, especially for non-tech savvy users with affinity towards regional languages. It allows resellers to accurately locate the products that they seek, unlike textual search which recommends products from head brands. Product attributes available in e-commerce have a great potential for building better visual search systems as they capture fine grained relations between data points. In this work, we design a visual search system for reseller commerce using a multi-task learning approach. We also highlight and address the challenges like image compression, cropping, scribbling on the image, etc, faced in reseller commerce. Our model consists of three different tasks: attribute classification, triplet ranking and variational autoencoder (VAE). Masking technique is used for designing the attribute classification. Next, we introduce an offline triplet mining technique which utilizes information from multiple attributes to capture relative order within the data. This technique displays a better performance compared to the traditional triplet mining baseline, which uses single label/attribute information. We also compare and report incremental gain achieved by our unified multi-task model over each individual task separately. The effectiveness of our method is demonstrated using the in-house dataset of product images from the Lifestyle business-unit of Flipkart, India's largest e-commerce company. To efficiently retrieve the images in production, we use the Approximate Nearest Neighbor (ANN) index. Finally, we highlight our production environment constraints and present the design choices and experiments conducted to select a suitable ANN index.

Visual Search Based on Contour Salient

Product Image Retrieval Based on Co-Features of the Object

Visually Similar Products Retrieval for Shopsy

Visual Search at Alibaba

Sketch-Based Image Retrieval by Salient Contour Reinforcement

Visual Fashion-Product Search at SK Planet

Visual Search at eBay

When Amazon Meets Google

Image Retrieval for Visual Localization via Scene Text Detection and Logo Filtering

Salient Object Detection Via Google Image Retrieval

Salient Object Extraction Based on Nonparametric Kernel Density Estimation

Robust Contour Visual Servoing Based on B-spline Features with Temporary Occlusion

A Shape-Based Image Retrieval Method Using Salient Edges

Virtual ID Discovery from E-commerce Media at Alibaba: Exploiting Richness of User Click Behavior for Visual Search Relevance

Salient Object Detection and Segmentation

ShoppingCat: Relocating Products from the Web in Online Shopping

Salient Object Detection for Searched Web Images Via Global Saliency

Unified Vision-Language Representation Modeling for E-Commerce Same-Style Products Retrieval

Multi-Scale Visual Words For Object-Based Web Image Search

Contour detection based on the interactive response and fusion model of bilateral attention pathways

Salient Object Detection using concavity context