Abstract:Nowadays, retail products recognition technologies are mostly based on traditional two-stages computer vision methods. Those methods first create features manually, followed by a classification algorithm to distinguish all products. Since deep learning methods have achieved state-of-the-art results on many tasks and have unified pipelines, it would be promising to apply deep models into products recognition. In this paper, we have built up a new light CNN architecture named ProNet for this task. The 27-layers ProNet combines the advantages of ResNet and Mobilenet. Depth-wise separable convolution and residual connection are two main operations in the architecture design. Depth-wise separable convolution is used to cut down the computation cost. Residual connection is used to help network learn better feature representations and converge to a better point during training. Compared with other commonly used CNN architectures, our ProNet is relatively computational efficient, but it can still get good performances on several public datasets. We first test ProNet architecture on ImageNet dataset. Top 1 average accuracy of 70.8% is got. After that, we test ProNet on another public dataset ALOI and our own task-specific retail products dataset GroOpt using transfer learning. Using this base model, we get an average accuracy of 98% on ALOI and 96% on GroOpt, which are both much higher than traditional SIFT based methods. Results show that ProNet is an accurate model. To make ProNet transferable in other environments, we apply the following two strategies: (1) a white balance augmentation algorithm to randomly change the RGB ratio of every image. (2) add another linear classifier on top feature maps to help distinguish very similar samples. Using augmented training set and modified model, we have trained ProNetV2. This improved version gets an accuracy of 99% on both ALOI and GroOpt. We have also embedded ProNetV2 model into a smart phone with 2GB RAM and test it under different situations, including different light illuminations, backgrounds, etc. An average accuracy of 96% and processing time of 0.1s per image are reached. Those results prove the effectiveness and usefulness of our proposed networks.

Product Detection Based on CNN and Transfer Learning

A Smart Surface Inspection System Using Faster R-CNN in Cloud-Edge Computing Environment

Building Unmanned Store Identification Systems Using YOLOv4 and Siamese Network

A Design of Smart Unmanned Vending Machine for New Retail Based on Binocular Camera and Machine Vision

Toward New Retail: A Benchmark Dataset for Smart Unmanned Vending Machines

Object detection and recognition system based on computer vision analysis

Real-time purchase behavior recognition system based on deep learning-based object detection and tracking for an unmanned product cabinet

A Smart Unstaffed Retail Shop Based on Artificial Intelligence and IoT.

Design and Implementation of a Vision- and Grating-Sensor-Based Intelligent Unmanned Settlement System

Transfer Learning for Urban Computing : A Case Study for Optimal Retail Store Placement

Smart retail SKUs checkout using improved residual network

Target Detection and Recognition for Wide Area Border Defense Intelligent Surveillance.

Designing a Supermarket Service Robot Based on Deep Convolutional Neural Networks

Design of Smart Unstaffed Retail Shop Based on IoT and Artificial Intelligence

A Region-Based Deep Learning Approach to Automated Retail Checkout

Unitail: Detecting, Reading, and Matching in Retail Scene

ProNet: an accurate and light-weight CNN model for retail products recognition

Supermarket commodity identification using convolutional neural networks

Target Recognition and Location Based on Deep Learning

BP-YOLO: A Real-Time Product Detection and Shopping Behaviors Recognition Model for Intelligent Unmanned Vending Machine

CNN and Binocular Vision-Based Target Detection and Ranging Framework of Intelligent Railway System