Abstract:Worldwide, in 2014, more than 1.9 billion adults, 18 years and older, were overweight. Of these, over 600 million were obese. Accurately documenting dietary caloric intake is crucial to manage weight loss, but also presents challenges because most of the current methods for dietary assessment must rely on memory to recall foods eaten. The ultimate goal of our research is to develop computer-aided technical solutions to enhance and improve the accuracy of current measurements of dietary intake. Our proposed system in this paper aims to improve the accuracy of dietary assessment by analyzing the food images captured by mobile devices (e.g., smartphone). The key technique innovation in this paper is the deep learning-based food image recognition algorithms. Substantial research has demonstrated that digital imaging accurately estimates dietary intake in many environments and it has many advantages over other methods. However, how to derive the food information (e.g., food type and portion size) from food image effectively and efficiently remains a challenging and open research problem. We propose a new Convolutional Neural Network (CNN)-based food image recognition algorithm to address this problem. We applied our proposed approach to two real-world food image data sets (UEC-256 and Food-101) and achieved impressive results. To the best of our knowledge, these results outperformed all other reported work using these two data sets. Our experiments have demonstrated that the proposed approach is a promising solution for addressing the food image recognition problem. Our future work includes further improving the performance of the algorithms and integrating our system into a real-world mobile and cloud computing-based system to enhance the accuracy of current measurements of dietary intake.

From Market To Dish: Multi-Ingredient Image Recognition For Personalized Recipe Recommendation

Recognizing Multiple Ingredients in Food Images Using a Single-Ingredient Classification Model

A Study of Multi-Task and Region-Wise Deep Learning for Food Ingredient Recognition.

Market2Dish: Health-aware Food Recommendation

Cross-Modal Recipe Retrieval: How to Cook This Dish?

Improved Ingredients-based Recipe Recommendation Software using Machine Learning

Multi-Task Learning for Food Identification and Analysis with Deep Convolutional Neural Networks

Deep-Learning-Assisted Multi-Dish Food Recognition Application for Dietary Intake Reporting

Self-Attention and Ingredient-Attention Based Model for Recipe Retrieval from Image Queries

Automated Recipe Generation using Ingredient Classification based on an Image from a Real-Time Photo Station

Food Ingredients Recognition through Multi-label Learning

A Chinese Dish Detector with Modified YOLO v3

DeepFood: Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment

Distillation-based Chinese Food Ingredient Recognition and Nutrition Estimation System

MCEN: Bridging Cross-Modal Gap Between Cooking Recipes and Dish Images with Latent Variable Model

Food Recipe Recommendation Based on Ingredients Detection Using Deep Learning

Multi-Task Image-Based Dietary Assessment for Food Recognition and Portion Size Estimation

Zero-Shot Ingredient Recognition by Multi-Relational Graph Convolutional Network

Food recognition and recipe analysis: integrating visual content, context and external knowledge

Deep Cooking: Predicting Relative Food Ingredient Amounts from Images

Deep-based Ingredient Recognition for Cooking Recipe Retrieval