Abstract:Deep learning is a new research direction in the field of machine learning, which was introduced into machine learning to bring it closer to its original goal. Accurate dish recognition becomes increasingly important in the multimedia community since it can help cuisine recommendation, calorie management, service improvement, and other food computing tasks. Many novel approaches have been developed on web recipes and menu pictures, while few are concerned real-life dish image analysis. In this study, a deep learning-based prototype system is deployed in a Chinese canteen, and 28 dish types, 16,904 images, and 45,061 instances have been collected. Specifically, in the prototype system, three practical issues are explored, including the backbone network selection, the training strategy determination, and the minimum number of samples for model upgrading. Experimental results suggest that fine-tuned Faster-RCNN can serve as the backbone network of the prototype system since it outperforms the other four fine-tuned networks on dish recognition (accuracy, 98.10%; recall, 97.20%; MAP (mean average precession), 98.30%) and satisfies real-time requirement (0.15 second per image). Meanwhile, the transferred backbone network achieves superior results (MAP, 96.48%) over the same architecture trained from image scratches (MAP, 87.84%). On model upgrading, a good (MAP, 91.34%) to better (MAP, 96.48%) outcome is obtained when the training size is increased from 50 to 200 samples per dish type, and 150 and more instances should be annotated if a new dish type is added to the system’s recognition list. Conclusively, the real-life deployment and evaluation of the prototype system indicate that deep learning is full of potential to enhance customer experience through accurate daily dish recognition.

Chinese Dish Segmentation Based on Local Variation Driven Superpixel Grouping and Region Analysis

A novel segmentation algorithm for clustered flexional agricultural products based on image analysis.

A Chinese Dish Detector with Modified YOLO v3

Image segmentation and recognition for multi-class chinese food

Superpixel-Based Image Recognition For Food Images

Segmentation of Complex Food Images by Stick Growing and Merging Algorithm

Mixed Dish Recognition with Contextual Relation and Domain Alignment

Food Volume Estimation by Multi-Layer Superpixel.

A Large-Scale Benchmark for Food Image Segmentation

A Study of Multi-Task and Region-Wise Deep Learning for Food Ingredient Recognition.

S5Utis: Structured State-Space Sequence SegNeXt UNet-like Tongue Image Segmentation in Traditional Chinese Medicine

A Method of Apple Image Segmentation Based on Color-Texture Fusion Feature and Machine Learning

Accurate Real-Life Chinese Dish Recognition

Image-based Nutrient Estimation for Chinese Dishes Using Deep Learning.

Hierarchical segmentation for traditional cultural pattern based on iterative compression and clustering

A New CNN-Based Single-Ingredient Classification Model and its Application in Food Image Segmentation

Distance dependent Chinese restaurant process for VHR satellite image oversegmentation

Flavor analysis and region prediction of Chinese dishes based on food pairing

Edge Dependent Chinese Restaurant Process for Very High Resolution (VHR) Satellite Image Over-Segmentation.

Exploring PCA-based feature representations of image pixels via CNN to enhance food image segmentation

A New Method for Image Superpixel Segmentation