Abstract:In recent years, the technology of artificial intelligence (AI) and robots is rapidly spreading to countries around the world. More and more scholars and industry experts have proposed AI deep learning models and methods to solve human life problems and improve work efficiency. Modern people’s lives are very busy, which led us to investigate whether the demand for Bento buffet cafeterias has gradually increased in Taiwan. However, when eating at a buffet in a cafeteria, people often encounter two problems. The first problem is that customers need to queue up to check out after they have selected and filled their dishes from the buffet. However, it always takes too much time waiting, especially at lunch or dinner time. The second problem is sometimes customers question the charges calculated by cafeteria staff, claiming they are too expensive at the checkout counter. Therefore, it is necessary to develop an AI-enabled checkout system. The AI-enabled self-checkout system will help the Bento buffet cafeterias reduce long lineups without the need to add additional workers. In this paper, we used computer vision and deep-learning technology to design and implement an AI-enabled checkout system for Bento buffet cafeterias. The prototype contains an angle steel shelf, a Kinect camera, a light source, and a desktop computer. Six baseline convolutional neural networks were applied for comparison on food recognition. In our experiments, there were 22 different food categories in a Bento buffet cafeteria employed. Experimental results show that the inception_v4 model can achieve the highest average validation accuracy of 99.11% on food recognition, but it requires the most training and recognition time. AlexNet model achieves a 94.5% accuracy and requires the least training time and recognition time. We propose a hierarchical approach with two stages to achieve good performance in both the recognition accuracy rate and the required training and recognition time. The approach is designed to perform the first step of identification and the second step of recognizing similar food images, respectively. Experimental results show that the proposed approach can achieve a 96.3% accuracy rate on our test dataset and required very little recognition time for input images. In addition, food volumes could be estimated using the depth images captured by the Kinect camera, and a framework of visual checkout system was successfully built.

A Joint Learning Framework for Restaurant Survival Prediction and Explanation.

Advancing e-commerce user purchase prediction: Integration of time-series attention with event-based timestamp encoding and Graph Neural Network-Enhanced user profiling

Unboxing Deep Learning Model of Food Delivery Service Reviews Using Explainable Artificial Intelligence (XAI) Technique

Comparative study of deep learning models for analyzing online restaurant reviews in the era of the COVID-19 pandemic

Exploiting Dining Preference for Restaurant Recommendation.

Deep Learning-Based Prediction and Revenue Optimization for Online Platform User Journeys

A Framework of Visual Checkout System Using Convolutional Neural Networks for Bento Buffet

Inferring Restaurant Styles by Mining Crowd Sourced Photos from User-Review Websites

Predictive Modeling with Delayed Information: a Case Study in E-commerce Transaction Fraud Control

Prediction of Perceived Utility of Consumer Online Reviews Based on LSTM Neural Network

Machine Learning for Food Review and Recommendation

Restaurant recommendation model using textual information to estimate consumer preference: evidence from an online restaurant platform

Predicting the Influence of Group Buying on the Restaurant's Popularity by Online Reviews

MenuAI: Restaurant Food Recommendation System via a Transformer-based Deep Learning Model

AXCF: Aspect‐based collaborative filtering for explainable recommendations

An adaptive hybrid XdeepFM based deep Interest network model for click-through rate prediction system

An Integrated Machine Learning and Deep Learning Framework for Credit Card Approval Prediction

Explainable Deep Learning Framework for Human Activity Recognition

Sentiment Analysis of Customer Reviews of Food Delivery Services Using Deep Learning and Explainable Artificial Intelligence: Systematic Review

Restaurant Revenue Prediction using Machine Learning

Dynamical User Intention Prediction Via Multi-modal Learning